-- Logs begin at Tue 2022-08-23 07:22:16 UTC, end at Tue 2022-08-23 08:37:00 UTC. -- Aug 23 07:54:45.095585 dv-cinder-854070-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 23 07:54:45.102833 dv-cinder-854070-4-smb devstack@keystone.service[81756]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 23 07:54:45.104813 dv-cinder-854070-4-smb devstack@keystone.service[81756]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 07:54:45 2022] *** Aug 23 07:54:45.104813 dv-cinder-854070-4-smb devstack@keystone.service[81756]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 07:54:45.104813 dv-cinder-854070-4-smb devstack@keystone.service[81756]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 07:54:45.104813 dv-cinder-854070-4-smb devstack@keystone.service[81756]: nodename: dv-cinder-854070-4-smb Aug 23 07:54:45.104813 dv-cinder-854070-4-smb devstack@keystone.service[81756]: machine: x86_64 Aug 23 07:54:45.104813 dv-cinder-854070-4-smb devstack@keystone.service[81756]: clock source: unix Aug 23 07:54:45.104813 dv-cinder-854070-4-smb devstack@keystone.service[81756]: pcre jit disabled Aug 23 07:54:45.105299 dv-cinder-854070-4-smb devstack@keystone.service[81756]: detected number of CPU cores: 4 Aug 23 07:54:45.105299 dv-cinder-854070-4-smb devstack@keystone.service[81756]: current working directory: / Aug 23 07:54:45.105299 dv-cinder-854070-4-smb devstack@keystone.service[81756]: detected binary path: /usr/bin/uwsgi-core Aug 23 07:54:45.105299 dv-cinder-854070-4-smb devstack@keystone.service[81756]: your processes number limit is 47680 Aug 23 07:54:45.105299 dv-cinder-854070-4-smb devstack@keystone.service[81756]: your memory page size is 4096 bytes Aug 23 07:54:45.105299 dv-cinder-854070-4-smb devstack@keystone.service[81756]: detected max file descriptor number: 2048 Aug 23 07:54:45.105299 dv-cinder-854070-4-smb devstack@keystone.service[81756]: lock engine: pthread robust mutexes Aug 23 07:54:45.105299 dv-cinder-854070-4-smb devstack@keystone.service[81756]: thunder lock: enabled Aug 23 07:54:45.105299 dv-cinder-854070-4-smb devstack@keystone.service[81756]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 23 07:54:45.105299 dv-cinder-854070-4-smb devstack@keystone.service[81756]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 07:54:45.145844 dv-cinder-854070-4-smb devstack@keystone.service[81756]: Python main interpreter initialized at 0x5613f9f5b9c0 Aug 23 07:54:45.145844 dv-cinder-854070-4-smb devstack@keystone.service[81756]: python threads support enabled Aug 23 07:54:45.145844 dv-cinder-854070-4-smb devstack@keystone.service[81756]: your server socket listen backlog is limited to 100 connections Aug 23 07:54:45.145844 dv-cinder-854070-4-smb devstack@keystone.service[81756]: your mercy for graceful operations on workers is 90 seconds Aug 23 07:54:45.146230 dv-cinder-854070-4-smb devstack@keystone.service[81756]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 07:54:45.146333 dv-cinder-854070-4-smb devstack@keystone.service[81756]: *** Operational MODE: preforking *** Aug 23 07:54:45.146595 dv-cinder-854070-4-smb devstack@keystone.service[81756]: *** uWSGI is running in multiple interpreter mode *** Aug 23 07:54:45.146595 dv-cinder-854070-4-smb devstack@keystone.service[81756]: spawned uWSGI master process (pid: 81756) Aug 23 07:54:45.146801 dv-cinder-854070-4-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 23 07:54:45.148200 dv-cinder-854070-4-smb devstack@keystone.service[81756]: spawned uWSGI worker 1 (pid: 81770, cores: 1) Aug 23 07:54:45.148200 dv-cinder-854070-4-smb devstack@keystone.service[81756]: spawned uWSGI worker 2 (pid: 81771, cores: 1) Aug 23 07:54:45.148200 dv-cinder-854070-4-smb devstack@keystone.service[81756]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 07:54:49.495672 dv-cinder-854070-4-smb devstack@keystone.service[81771]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 07:54:49.495672 dv-cinder-854070-4-smb devstack@keystone.service[81771]: from cryptography.utils import int_from_bytes Aug 23 07:54:49.496480 dv-cinder-854070-4-smb devstack@keystone.service[81771]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 07:54:49.496480 dv-cinder-854070-4-smb devstack@keystone.service[81771]: from cryptography.utils import int_from_bytes Aug 23 07:54:49.503279 dv-cinder-854070-4-smb devstack@keystone.service[81770]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 07:54:49.503279 dv-cinder-854070-4-smb devstack@keystone.service[81770]: from cryptography.utils import int_from_bytes Aug 23 07:54:49.506564 dv-cinder-854070-4-smb devstack@keystone.service[81770]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 07:54:49.506564 dv-cinder-854070-4-smb devstack@keystone.service[81770]: from cryptography.utils import int_from_bytes Aug 23 07:54:49.546902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 07:54:49.547106 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 07:54:49.547271 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] command line args: [] {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 07:54:49.547539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 07:54:49.547718 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ================================================================================ {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 07:54:49.547970 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] admin_token = **** {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.548214 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] config_dir = [] {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.548401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.548585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] config_source = [] {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.548765 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] debug = True {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.548966 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.550397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.550397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.550397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.550397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.550397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] list_limit = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.550397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] log_config_append = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.550846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.550846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] log_dir = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.550987 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] log_file = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.551124 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.551376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.551685 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.551948 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.552141 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.552343 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.552604 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.552838 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.553073 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.553306 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.553549 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.553768 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.554016 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.554261 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.554560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.555053 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.555233 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] publish_errors = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.555464 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.555586 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 07:54:49.555711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.555826 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 07:54:49.555938 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.556058 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] command line args: [] {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 07:54:49.556178 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.556303 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 07:54:49.556424 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.556547 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ================================================================================ {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 07:54:49.556668 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] standard_threads = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.556788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] admin_token = **** {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.556908 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.557030 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] config_dir = [] {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.557144 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.557263 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.557385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.557499 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] config_source = [] {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.557611 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] use_journal = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.557735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] debug = True {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.557846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] use_json = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.557965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.558105 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] use_stderr = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.558220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.558365 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] use_syslog = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.558490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.558611 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.558733 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.558847 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.558976 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.559102 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.559217 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] list_limit = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.559217 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] log_config_append = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.559444 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.559557 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.559677 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.559799 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] log_dir = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.559919 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.560040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] log_file = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.560160 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.560280 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.560393 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.560574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.560691 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.560821 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.560936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.561049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.561049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.561281 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.561395 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.561511 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.561624 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.561746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.561866 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.561981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.562095 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.562214 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.562353 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.562479 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.562595 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.562715 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.562829 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.562950 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.563071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.563194 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.563194 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.563408 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.563521 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.563635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.563826 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.563826 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.564052 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.564168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.564289 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] publish_errors = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.564289 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.564502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.564621 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.564736 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.564856 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.564978 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.565094 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.565207 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.565327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.565442 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.565555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] standard_threads = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.565677 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.565793 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.565906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.566027 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.566141 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.566261 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.566407 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.566523 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] use_journal = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.566641 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.566757 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] use_json = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.566757 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] use_stderr = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.566968 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.567093 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] use_syslog = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.567208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.567328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:54:49.567448 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.567563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.567676 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.567803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.567918 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.568031 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.568144 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.568257 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.568370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.568499 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.568615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.568842 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.568966 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.569086 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.569201 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.569201 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.569503 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.569625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.569740 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.569853 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.569968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.570093 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.570208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.570348 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.570476 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.570591 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.570704 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.570830 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.570947 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.571061 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.571174 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.571287 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.571400 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.571522 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.571644 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.571759 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.571872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.571987 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.572101 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.572223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.572338 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.572452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.572571 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.572686 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.572800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.572926 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.573048 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.573170 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.573285 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.573429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.573429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.573883 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.573991 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.574106 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.574106 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.574327 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.574431 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.575596 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.575745 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.575859 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.575859 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.576048 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.576147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.576260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.576260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.576452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.576558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.576661 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.576764 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.576863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.576988 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.577112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.577112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.577333 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.577448 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.577570 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.578193 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.578377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.578705 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.578844 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.578962 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.579084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.579211 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.579328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.579443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.579557 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.579671 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.579785 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.579909 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.580026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.580157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.580273 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.580390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.580504 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.580619 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.580734 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.580849 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.580964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.581078 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.581199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.581363 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.581522 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.581643 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.581759 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.581881 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.581996 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.582123 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.582245 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.582373 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.582489 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.582604 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.582719 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.582846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.582963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.583078 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.583199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.583315 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.583507 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.583626 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.583742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.583856 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.583970 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.584091 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.584220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.584345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.584468 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.584586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.584701 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.584825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.584941 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.585056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.585179 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.585296 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.585523 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.585676 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.585815 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.585931 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] auth.external = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.586055 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.586172 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.586329 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.586447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.586563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.586680 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.586808 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.586925 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] auth.password = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.587040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.587155 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] auth.token = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.587270 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.587388 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.587512 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.587628 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.587744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.587859 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.587973 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.588095 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.588219 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.588336 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.588451 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.588572 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.588698 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.588815 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.588938 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.589054 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] credential.caching = True {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.589176 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.589291 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.589406 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.589521 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.589647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.589763 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.589879 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.589994 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.590108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.590223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.590364 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.590484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.590599 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.590714 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.590828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.590975 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.591101 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.591219 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.591343 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.591459 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.591574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.591690 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.591813 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.591938 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.592066 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.592183 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.592299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.592421 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.592544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.592660 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.592785 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.592901 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] federation.caching = True {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.593024 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.593141 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.593289 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.594094 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.594233 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.594376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.594505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.594623 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.594738 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.594854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.594979 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.595098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.595214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.595330 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.595446 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.595570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.595687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] auth.external = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.595812 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.595929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.596054 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.596172 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.596297 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.596414 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.596530 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] identity.caching = True {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.596646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] auth.password = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.596762 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.596868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] auth.token = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.597004 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.597111 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.597227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.597343 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.597463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.597588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.597780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.597906 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.598023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.598139 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.598255 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.598390 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.598519 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.598637 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.598752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.598866 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] credential.caching = True {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.598982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.599104 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.599229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.599347 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.599447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.599544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.599650 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.599751 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.599860 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.599965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.600064 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.600162 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.600266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.600367 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.600473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.600573 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.600670 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.600767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.600872 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.600970 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.601075 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.601175 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.601279 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.601378 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.601474 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.601571 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.601677 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.601677 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.601864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.601967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.602066 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.602172 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.602279 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] federation.caching = True {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.602433 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.602532 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.602636 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.602733 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.604283 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.604437 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.604573 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.604651 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.604724 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.604797 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.604869 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.604951 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.605026 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.605099 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.605171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.605243 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.605315 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.605395 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.605469 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.605543 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.605615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.605687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.605770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.605845 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] identity.caching = True {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.605918 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.605990 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.606062 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.606134 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.606214 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.606308 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.606385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.606458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.606530 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.606602 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.606687 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.606763 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.606835 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.606907 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.606979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.607047 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.607131 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.607206 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.607284 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.607358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.607429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.607501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.607581 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.607656 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.607728 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.user = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.607800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.607871 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.607944 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.608023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.608098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.608170 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.608248 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.608325 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.608417 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.608490 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.608565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.608633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.608705 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.608781 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.608853 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.608933 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.609008 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.609080 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.609152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.609224 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.609296 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.609382 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.609458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.609530 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.609602 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.609673 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.609745 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.609825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.609913 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.609988 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.610056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.610122 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.610220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.610385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.610464 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.610538 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.610538 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.610668 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.610740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.610820 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.610895 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.610967 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.611039 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.611111 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.611182 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.611266 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.611340 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.611413 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.611485 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.611557 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.611628 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.611709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.611783 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.611855 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.611927 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.611999 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.612070 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.612151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.612225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.612297 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.612369 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.612441 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.612512 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.612593 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.612668 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.612740 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.612811 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.612996 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.613079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.613231 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.613311 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.613473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] resource.caching = True {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.613553 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.613712 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.613790 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.613952 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.614034 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.614188 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.614266 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.user = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.614458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.614551 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.614758 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.614850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.614964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.615052 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.615212 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.615301 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.615449 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.615530 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.615689 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.615770 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.615924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] role.caching = True {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.616013 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.616157 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.616236 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] role.driver = sql {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.616394 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.616473 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.616630 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.616783 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.616862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.616936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.617090 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.617171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.617351 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.617438 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.617600 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.617702 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.617848 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.617958 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.618097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.618213 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.618373 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.618495 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.618645 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.618719 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.618845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.618974 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.619094 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.619217 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.619344 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.619459 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.619593 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.619703 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.619943 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.620022 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.620195 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.620276 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.620447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.620535 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.620687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.620769 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.620935 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.621015 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.621169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.621257 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.621405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.621485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.621643 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.621722 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.621883 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.621971 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.622123 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.622202 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.622378 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.622463 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.622612 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.622706 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.622844 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.622925 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.623082 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.623160 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.623328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] resource.caching = True {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.623417 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.623571 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.623651 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.623807 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.623887 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.624041 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.624123 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.624271 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.624351 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.624543 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] token.caching = True {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.624623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.624787 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.624985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.625100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.625258 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.625407 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.625513 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.625656 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.625760 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.625906 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.625986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.626184 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] role.caching = True {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.626272 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.626413 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] role.driver = sql {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.626490 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.626658 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.626738 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.626914 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.626993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.627170 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.627252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.627426 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.627506 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.627671 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.627749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.627921 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.628003 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.628152 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.628232 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.628395 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.628475 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.628654 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.628734 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.628893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.628972 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] database.connection = **** {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.629147 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.629237 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.629399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.629478 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.629639 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.629721 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.629879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.629959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.630113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.630277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.630379 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.630538 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.630617 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.630792 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.630872 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.631049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.631130 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.631284 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.631364 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.631525 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.631605 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.631760 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.631843 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.632016 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.632095 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.632273 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.632353 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.632514 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.632594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.632745 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.632826 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.632979 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.633058 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.633210 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.633290 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.633363 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 07:54:49.633461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.633723 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.633974 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.634214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.634478 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.634715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.634955 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] token.caching = True {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.635203 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.635455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.635697 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.635960 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.636213 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.636455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.636703 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.636951 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.637210 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.637446 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.637689 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.637928 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.638178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.638461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.638698 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.638944 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.639241 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.639505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] database.connection = **** {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.639754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.640005 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.640789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.641170 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.641413 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.641653 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.641894 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.642135 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.642408 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.642652 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.642901 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.643141 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.643394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.643636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.643892 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.644131 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.644374 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.644613 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:54:49.644787 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 07:54:49.670336 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.670572 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.670799 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.670954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.671195 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.671457 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.679488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.679916 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.709957 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.710185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.712908 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.713330 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.770449 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.770734 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.822471 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.822712 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.822803 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.822998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.982199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.982477 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.982682 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.982913 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.983137 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.983230 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.983356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.983439 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.983586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.983811 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.984174 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:49.984400 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.014241 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.014465 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.014577 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.014703 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.014822 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.014933 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.015269 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.015916 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.016060 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.016163 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.016269 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.016528 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.016640 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.016922 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.031972 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.032118 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.044898 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.045129 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.045362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.045492 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.045582 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.045659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.045798 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.045884 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.046014 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.046100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.046227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81771) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.046328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.046562 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.046785 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81770) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:54:50.063982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.064122 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.064226 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 07:54:50.064311 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 07:54:50.064519 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.064608 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.064720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 07:54:50.064808 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 07:54:50.064994 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.065080 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.065258 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.065345 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.065778 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.065864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.066047 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.066187 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.075691 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.075793 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.075978 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.076064 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.076247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.076347 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.076534 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.076620 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.084170 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.084283 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.087373 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.087473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.087658 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.087741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.087942 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.088039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.088223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.088305 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.088505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.088587 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.088767 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.088858 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.089039 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.089121 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.089313 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.089394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.089694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.089777 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.089972 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.090056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.090247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.090360 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.112864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.113081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.114355 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.114558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.114641 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.114845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.119338 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.119575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.119679 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.119861 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.119964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.120143 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.126958 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.127062 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.127244 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.127329 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.131362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.131457 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.131658 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.131741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.131945 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.132042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.132230 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.132312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.132501 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.132624 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.132763 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.132843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.133038 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.133122 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.133312 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.133405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.150985 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.151152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.151319 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.151431 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.155150 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.155310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.158566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.158654 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.158867 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.158949 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.163088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.163184 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.166237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.166386 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.169505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.169662 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.169806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.169968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.170100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.170232 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.170384 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.170469 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.170666 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.170751 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.170954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.171044 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.186618 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.186819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.186908 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.187634 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.187840 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.187923 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.188144 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.188227 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.195074 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.195181 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.196596 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.196679 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.196873 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.196954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.199764 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.199858 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.200050 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.200146 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.200344 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.200427 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.200649 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.200734 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.200932 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.201015 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.212381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.212591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.212681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.212884 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.212968 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.213173 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.213266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.213463 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.213547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.213753 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.213836 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.214039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.214125 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.214357 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.230128 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.230246 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.233145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.233286 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.236138 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.236322 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.237612 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.237774 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.239110 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.239283 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.239405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.239601 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.239692 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.239880 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.246088 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.246388 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.247556 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.247866 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.250562 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.256573 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.256661 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.256728 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.256804 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.256895 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.257022 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.257022 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.259315 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.259611 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.259834 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.259919 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.260134 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.260424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.267456 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81771) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.267738 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.267954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81770) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:54:50.268040 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.268247 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.268342 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.268536 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.268631 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.268819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.268905 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.269101 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.269186 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.269381 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.269475 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.269665 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.269748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.269940 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.270022 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.270221 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.270328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.270509 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.270593 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.270784 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.270881 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.271045 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81771) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.271129 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.271331 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.271607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81770) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:54:50.305728 dv-cinder-854070-4-smb devstack@keystone.service[81771]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5613f9f5b9c0 pid: 81771 (default app) Aug 23 07:54:50.305846 dv-cinder-854070-4-smb devstack@keystone.service[81770]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5613f9f5b9c0 pid: 81770 (default app) Aug 23 07:54:50.309111 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e36cb-d459-4e00-be5d-18b5dcd8dd68 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:54:50.309400 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e36cb-d459-4e00-be5d-18b5dcd8dd68 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:54:50.309676 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e36cb-d459-4e00-be5d-18b5dcd8dd68 None None] PATH_INFO: `/v3` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:54:50.314130 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 791 bytes} [Tue Aug 23 07:54:50 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:54:57.922849 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19531d65-2030-48f8-9970-39bfe8b35e8c None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:54:57.923344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19531d65-2030-48f8-9970-39bfe8b35e8c None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:54:57.923344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19531d65-2030-48f8-9970-39bfe8b35e8c None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:54:57.927569 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1/2] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:54:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:54:57.934258 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc023af1-ba20-4960-82bd-953e2a1919df None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:54:57.934695 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc023af1-ba20-4960-82bd-953e2a1919df None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:54:57.934831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc023af1-ba20-4960-82bd-953e2a1919df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:54:58.005823 dv-cinder-854070-4-smb devstack@keystone.service[81771]: INFO dbcounter [None req-fc023af1-ba20-4960-82bd-953e2a1919df None None] Registered counter for database keystone Aug 23 07:54:58.026713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG oslo_db.sqlalchemy.engines [None req-fc023af1-ba20-4960-82bd-953e2a1919df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 07:54:58.033113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writer thread running {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 07:54:58.212848 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG passlib.handlers.bcrypt [None req-fc023af1-ba20-4960-82bd-953e2a1919df None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81771) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 07:54:58.213267 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG passlib.handlers.bcrypt [None req-fc023af1-ba20-4960-82bd-953e2a1919df None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81771) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 07:54:58.267624 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-fc023af1-ba20-4960-82bd-953e2a1919df None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:54:58.269202 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-fc023af1-ba20-4960-82bd-953e2a1919df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:54:58.396706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 2/3] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:54:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 23 07:54:58.722372 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19531d65-2030-48f8-9970-39bfe8b35e8c None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:54:58.790600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: INFO dbcounter [None req-19531d65-2030-48f8-9970-39bfe8b35e8c None None] Registered counter for database keystone Aug 23 07:54:58.809591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG oslo_db.sqlalchemy.engines [None req-19531d65-2030-48f8-9970-39bfe8b35e8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 07:54:58.815749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writer thread running {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 07:54:58.933847 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19531d65-2030-48f8-9970-39bfe8b35e8c None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:54:58.938747 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061b885-a052-4e61-b27e-b6dc57897569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:54:58.939372 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061b885-a052-4e61-b27e-b6dc57897569 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:54:58.939652 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061b885-a052-4e61-b27e-b6dc57897569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:54:58.939923 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061b885-a052-4e61-b27e-b6dc57897569 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:54:58.948291 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061b885-a052-4e61-b27e-b6dc57897569 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:54:59.000951 dv-cinder-854070-4-smb devstack@keystone.service[81770]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f061b885-a052-4e61-b27e-b6dc57897569 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 07:54:59.001304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061b885-a052-4e61-b27e-b6dc57897569 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:54:59.011316 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 2/4] 10.222.0.57 () {58 vars in 1324 bytes} [Tue Aug 23 07:54:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 07:54:59.018102 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc023af1-ba20-4960-82bd-953e2a1919df None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:54:59.032348 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc023af1-ba20-4960-82bd-953e2a1919df None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:54:59.036707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64dffc-cc9a-4801-a2ed-4c5f4694a09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:54:59.037796 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64dffc-cc9a-4801-a2ed-4c5f4694a09c admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:54:59.038077 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64dffc-cc9a-4801-a2ed-4c5f4694a09c admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:54:59.038381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64dffc-cc9a-4801-a2ed-4c5f4694a09c admin admin] PATH_INFO: `/v3/projects/89fa3cf81b7a47a1bca14aee1213ee84` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:54:59.039927 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64dffc-cc9a-4801-a2ed-4c5f4694a09c admin admin] RBAC: Authorizing `identity:get_project(project_id=89fa3cf81b7a47a1bca14aee1213ee84)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:54:59.093156 dv-cinder-854070-4-smb devstack@keystone.service[81771]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3d64dffc-cc9a-4801-a2ed-4c5f4694a09c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 07:54:59.093591 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64dffc-cc9a-4801-a2ed-4c5f4694a09c admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:54:59.098025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 3/5] 10.222.0.57 () {56 vars in 1207 bytes} [Tue Aug 23 07:54:59 2022] GET /identity/v3/projects/89fa3cf81b7a47a1bca14aee1213ee84 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:00.978727 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bcce2-a3a7-45cc-b63d-28aedf0cbc69 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:00.979240 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bcce2-a3a7-45cc-b63d-28aedf0cbc69 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:00.979323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bcce2-a3a7-45cc-b63d-28aedf0cbc69 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:00.983884 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 3/6] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:00.989521 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78d6ab-d678-45b6-9cda-25b0aefa16c7 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:00.989905 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78d6ab-d678-45b6-9cda-25b0aefa16c7 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:00.990084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78d6ab-d678-45b6-9cda-25b0aefa16c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:01.010258 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-ff78d6ab-d678-45b6-9cda-25b0aefa16c7 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:01.011818 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-ff78d6ab-d678-45b6-9cda-25b0aefa16c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:01.019654 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 4/7] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 23 07:55:01.285649 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691bcce2-a3a7-45cc-b63d-28aedf0cbc69 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:01.297707 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691bcce2-a3a7-45cc-b63d-28aedf0cbc69 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:01.301904 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5de299-2684-4afc-a203-4e9b0eebf50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:01.302529 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5de299-2684-4afc-a203-4e9b0eebf50b admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:01.302815 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5de299-2684-4afc-a203-4e9b0eebf50b admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:01.303093 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5de299-2684-4afc-a203-4e9b0eebf50b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:01.310662 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5de299-2684-4afc-a203-4e9b0eebf50b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:01.313097 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5de299-2684-4afc-a203-4e9b0eebf50b admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:01.321756 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 4/8] 10.222.0.57 () {58 vars in 1324 bytes} [Tue Aug 23 07:55:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 07:55:01.327322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78d6ab-d678-45b6-9cda-25b0aefa16c7 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:01.336401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78d6ab-d678-45b6-9cda-25b0aefa16c7 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:01.340772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ed04f-6692-44ec-a03b-9d567418ba20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:01.341387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ed04f-6692-44ec-a03b-9d567418ba20 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:01.341668 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ed04f-6692-44ec-a03b-9d567418ba20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:01.341942 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ed04f-6692-44ec-a03b-9d567418ba20 admin admin] PATH_INFO: `/v3/users/168687f5011542bc8d7ca334411c2990` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:01.343921 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ed04f-6692-44ec-a03b-9d567418ba20 admin admin] RBAC: Authorizing `identity:get_user(user_id=168687f5011542bc8d7ca334411c2990)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:01.345741 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ed04f-6692-44ec-a03b-9d567418ba20 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:01.347291 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 5/9] 10.222.0.57 () {56 vars in 1198 bytes} [Tue Aug 23 07:55:01 2022] GET /identity/v3/users/168687f5011542bc8d7ca334411c2990 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:03.340002 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b0146-39a7-4d5e-9f14-f59583d06b2e None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:03.340568 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b0146-39a7-4d5e-9f14-f59583d06b2e None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:03.340568 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b0146-39a7-4d5e-9f14-f59583d06b2e None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:03.341882 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 5/10] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:03.347713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ddf36-24f9-4007-8c3d-6255b9cb5580 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:03.348144 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a10b27-c7fa-475e-aa58-435ed4f874d1 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:03.348249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ddf36-24f9-4007-8c3d-6255b9cb5580 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:03.348337 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a10b27-c7fa-475e-aa58-435ed4f874d1 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:03.348422 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ddf36-24f9-4007-8c3d-6255b9cb5580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:03.348508 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a10b27-c7fa-475e-aa58-435ed4f874d1 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:03.349639 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 6/11] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:55:03.354726 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7e948-bba8-43af-9d36-c253e786d2a6 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:03.355017 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7e948-bba8-43af-9d36-c253e786d2a6 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:03.355299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7e948-bba8-43af-9d36-c253e786d2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:03.366979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-1b8ddf36-24f9-4007-8c3d-6255b9cb5580 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:03.368146 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-1b8ddf36-24f9-4007-8c3d-6255b9cb5580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:03.397508 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG passlib.handlers.bcrypt [None req-8cc7e948-bba8-43af-9d36-c253e786d2a6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81770) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 07:55:03.397929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG passlib.handlers.bcrypt [None req-8cc7e948-bba8-43af-9d36-c253e786d2a6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81770) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 07:55:03.443715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-8cc7e948-bba8-43af-9d36-c253e786d2a6 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:03.445322 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-8cc7e948-bba8-43af-9d36-c253e786d2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:03.447246 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 6/12] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:03.545307 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 7/13] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:55:03.718792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ddf36-24f9-4007-8c3d-6255b9cb5580 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:03.742425 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:03.814708 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7e948-bba8-43af-9d36-c253e786d2a6 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:03.822258 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ddf36-24f9-4007-8c3d-6255b9cb5580 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:03.856413 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df96f2-33a0-460a-b18a-1dc6c62e90b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:03.857048 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df96f2-33a0-460a-b18a-1dc6c62e90b5 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:03.857331 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df96f2-33a0-460a-b18a-1dc6c62e90b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:03.857605 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df96f2-33a0-460a-b18a-1dc6c62e90b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:03.872257 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df96f2-33a0-460a-b18a-1dc6c62e90b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:03.885463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-71df96f2-33a0-460a-b18a-1dc6c62e90b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:55:03.885463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:03.885463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:03.885463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:03.885463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:03.885463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:03.885463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:03.885463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:03.885463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:03.885463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:03.885463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:03.885463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:03.885463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:03.885463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:03.885463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:03.885463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:03.886444 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:03.886444 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:03.886444 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:03.886444 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:03.886444 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:03.886444 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:03.886444 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:03.886444 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:03.886444 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:03.886444 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:03.886444 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:03.886444 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:03.886444 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:03.886444 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:03.886444 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:03.886444 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:03.887311 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:03.887311 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:03.887311 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:03.887311 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:03.887311 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:03.887311 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:03.887311 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:03.887311 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:03.887311 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:03.887311 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:03.887311 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:55:03.887311 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:55:03.887311 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 7/14] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:55:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:03.896404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df96f2-33a0-460a-b18a-1dc6c62e90b5 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:03.921891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7e948-bba8-43af-9d36-c253e786d2a6 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:03.924213 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:03.962442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919c03c-0359-4d63-99e3-85c4022c15e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:03.963302 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919c03c-0359-4d63-99e3-85c4022c15e4 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:03.963593 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919c03c-0359-4d63-99e3-85c4022c15e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:03.963871 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919c03c-0359-4d63-99e3-85c4022c15e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:03.986022 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:04.003641 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df96f2-33a0-460a-b18a-1dc6c62e90b5 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:04.030059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919c03c-0359-4d63-99e3-85c4022c15e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:04.032243 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919c03c-0359-4d63-99e3-85c4022c15e4 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:04.037986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ed26a-ac3c-454d-b87d-11a9189e37ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:04.038622 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ed26a-ac3c-454d-b87d-11a9189e37ab None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:04.038901 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ed26a-ac3c-454d-b87d-11a9189e37ab None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:04.039238 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ed26a-ac3c-454d-b87d-11a9189e37ab None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:04.039915 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ed26a-ac3c-454d-b87d-11a9189e37ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:04.040217 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ed26a-ac3c-454d-b87d-11a9189e37ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:04.041602 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ed26a-ac3c-454d-b87d-11a9189e37ab None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:04.053899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 8/15] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:55:04.059361 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ed26a-ac3c-454d-b87d-11a9189e37ab None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:04.130552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 8/16] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:55:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:55:04.136030 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919c03c-0359-4d63-99e3-85c4022c15e4 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:04.139647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:04.159669 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ed26a-ac3c-454d-b87d-11a9189e37ab None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:04.194329 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dba42c-cf3d-4ffe-9303-142b981aded5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:04.194908 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dba42c-cf3d-4ffe-9303-142b981aded5 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:04.195191 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dba42c-cf3d-4ffe-9303-142b981aded5 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:04.195480 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dba42c-cf3d-4ffe-9303-142b981aded5 None admin] PATH_INFO: `/v3/users/168687f5011542bc8d7ca334411c2990` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:04.196639 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dba42c-cf3d-4ffe-9303-142b981aded5 None admin] RBAC: Authorizing `identity:get_user(user_id=168687f5011542bc8d7ca334411c2990)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:04.198115 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dba42c-cf3d-4ffe-9303-142b981aded5 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:04.200688 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 9/17] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:04 2022] GET /identity/v3/users/168687f5011542bc8d7ca334411c2990 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:55:04.208060 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dba42c-cf3d-4ffe-9303-142b981aded5 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:04.224991 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:04.236019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919c03c-0359-4d63-99e3-85c4022c15e4 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:04.269216 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9850b4b-01e4-4103-933e-98b3dbade80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:04.270076 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9850b4b-01e4-4103-933e-98b3dbade80f None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:04.270398 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9850b4b-01e4-4103-933e-98b3dbade80f None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:04.270704 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9850b4b-01e4-4103-933e-98b3dbade80f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:04.289189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9850b4b-01e4-4103-933e-98b3dbade80f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:04.290712 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9850b4b-01e4-4103-933e-98b3dbade80f None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:04.309169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-a9850b4b-01e4-4103-933e-98b3dbade80f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:55:04.309169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:04.309169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:04.309169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:04.309169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:04.309169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:04.309169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:04.309169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:04.309169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:04.309169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:04.309169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:04.309169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:04.309169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:55:04.309169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:55:04.309169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:55:04.309169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:55:04.310113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:04.310113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:04.310113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:04.310113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:04.310113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:04.310113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:04.310113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:04.310113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:04.310113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:04.310113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:04.310113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:04.310113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:04.310113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:04.310113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:04.310113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:04.310113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:04.310113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:55:04.311026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:55:04.311026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:55:04.311026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:55:04.311190 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dba42c-cf3d-4ffe-9303-142b981aded5 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:04.311271 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 9/18] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:55:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:55:04.316143 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9850b4b-01e4-4103-933e-98b3dbade80f None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:04.345699 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044702b-c6e5-4c14-9ebc-9d6b5bd2f2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:04.346358 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044702b-c6e5-4c14-9ebc-9d6b5bd2f2bb None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:04.346642 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044702b-c6e5-4c14-9ebc-9d6b5bd2f2bb None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:04.346915 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044702b-c6e5-4c14-9ebc-9d6b5bd2f2bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:04.348034 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044702b-c6e5-4c14-9ebc-9d6b5bd2f2bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:04.349500 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044702b-c6e5-4c14-9ebc-9d6b5bd2f2bb None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:04.351070 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 10/19] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:55:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:04.356844 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044702b-c6e5-4c14-9ebc-9d6b5bd2f2bb None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:04.373550 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:04.417011 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9850b4b-01e4-4103-933e-98b3dbade80f None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:04.435758 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:04.450365 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a5dfc-f046-4abf-9e58-a1a530c04712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:04.450926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a5dfc-f046-4abf-9e58-a1a530c04712 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:04.451210 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a5dfc-f046-4abf-9e58-a1a530c04712 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:04.451487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a5dfc-f046-4abf-9e58-a1a530c04712 None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:04.452197 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a5dfc-f046-4abf-9e58-a1a530c04712 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:04.452588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a5dfc-f046-4abf-9e58-a1a530c04712 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:04.454012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a5dfc-f046-4abf-9e58-a1a530c04712 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:04.455277 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044702b-c6e5-4c14-9ebc-9d6b5bd2f2bb None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:04.471559 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 10/20] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:55:04.493533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd291d1a-71bb-42b8-800e-9f147a2b82a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:04.494170 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd291d1a-71bb-42b8-800e-9f147a2b82a8 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:04.494487 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd291d1a-71bb-42b8-800e-9f147a2b82a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:04.494767 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd291d1a-71bb-42b8-800e-9f147a2b82a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:04.495529 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd291d1a-71bb-42b8-800e-9f147a2b82a8 None admin] RBAC: Adding query filter params (role.id=e905040849d04aadbb8da8b0d216c92c, scope.domain.id=default, user.id=168687f5011542bc8d7ca334411c2990) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:04.495840 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd291d1a-71bb-42b8-800e-9f147a2b82a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:04.497381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd291d1a-71bb-42b8-800e-9f147a2b82a8 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:04.505067 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 11/21] 10.222.0.57 () {56 vars in 1322 bytes} [Tue Aug 23 07:55:04 2022] GET /identity/v3/role_assignments?user.id=168687f5011542bc8d7ca334411c2990&scope.domain.id=default&role.id=e905040849d04aadbb8da8b0d216c92c => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:55:06.805475 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe9ec4-adac-4690-bf18-6453f0bfeced None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:06.805475 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe9ec4-adac-4690-bf18-6453f0bfeced None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:06.805475 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe9ec4-adac-4690-bf18-6453f0bfeced None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:06.805475 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 11/22] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:06.810923 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef0c64-01c3-4c5b-89c5-2f08f2b93a75 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:06.811343 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef0c64-01c3-4c5b-89c5-2f08f2b93a75 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:06.811571 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef0c64-01c3-4c5b-89c5-2f08f2b93a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:06.830568 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97caa6e-e124-4066-b448-8ddac6b0ea85 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:06.831200 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97caa6e-e124-4066-b448-8ddac6b0ea85 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:06.831682 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97caa6e-e124-4066-b448-8ddac6b0ea85 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:06.833458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 12/23] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:06.839591 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-43ef0c64-01c3-4c5b-89c5-2f08f2b93a75 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:06.840861 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-43ef0c64-01c3-4c5b-89c5-2f08f2b93a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:06.844201 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abdcf9-1807-449c-8626-d3e8acbc45a7 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:06.844743 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abdcf9-1807-449c-8626-d3e8acbc45a7 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:06.845248 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abdcf9-1807-449c-8626-d3e8acbc45a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:06.883307 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-b2abdcf9-1807-449c-8626-d3e8acbc45a7 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:06.884864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-b2abdcf9-1807-449c-8626-d3e8acbc45a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:06.954873 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 12/24] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:06.956305 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ba743-c8f3-4175-9333-a339ec537f71 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:06.956597 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ba743-c8f3-4175-9333-a339ec537f71 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:06.956872 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ba743-c8f3-4175-9333-a339ec537f71 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:06.964422 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 13/25] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:06.971602 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e820a79-8135-476b-91bf-e8f1a1d3eeb2 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:06.972079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e820a79-8135-476b-91bf-e8f1a1d3eeb2 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:06.972502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e820a79-8135-476b-91bf-e8f1a1d3eeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:07.013780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-9e820a79-8135-476b-91bf-e8f1a1d3eeb2 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:07.016736 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-9e820a79-8135-476b-91bf-e8f1a1d3eeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:07.018213 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 13/26] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:55:07.128394 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 14/27] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:07.367639 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abdcf9-1807-449c-8626-d3e8acbc45a7 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:07.416802 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:07.478168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e820a79-8135-476b-91bf-e8f1a1d3eeb2 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:07.481982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:07.484850 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abdcf9-1807-449c-8626-d3e8acbc45a7 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:07.539741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261ec18-ead2-4e71-89e6-3d9511c8faff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:07.540375 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261ec18-ead2-4e71-89e6-3d9511c8faff None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:07.540651 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261ec18-ead2-4e71-89e6-3d9511c8faff None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:07.540955 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261ec18-ead2-4e71-89e6-3d9511c8faff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:07.559665 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261ec18-ead2-4e71-89e6-3d9511c8faff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:07.561169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261ec18-ead2-4e71-89e6-3d9511c8faff None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:07.591744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-1261ec18-ead2-4e71-89e6-3d9511c8faff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:55:07.591744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:07.591744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:07.591744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:07.591744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:07.591744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:07.591744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:07.591744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:07.591744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:07.591744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:07.591744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:07.591744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:07.591744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:55:07.591744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:55:07.591744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:55:07.591744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:55:07.592729 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:07.592729 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:07.592729 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:07.592729 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:07.592729 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:07.592729 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:07.592729 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:07.592729 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:07.592729 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:07.592729 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:07.592729 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:07.592729 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:07.592729 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:07.592729 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:07.592729 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:07.592729 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:07.592729 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:55:07.593531 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:55:07.593531 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:55:07.593531 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:55:07.593531 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 14/28] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:55:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:07.604939 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261ec18-ead2-4e71-89e6-3d9511c8faff None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:07.664231 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e820a79-8135-476b-91bf-e8f1a1d3eeb2 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:07.725398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6235aab-f8a8-4bf0-b602-40d03cc05124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:07.727261 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6235aab-f8a8-4bf0-b602-40d03cc05124 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:07.727841 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6235aab-f8a8-4bf0-b602-40d03cc05124 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:07.729359 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6235aab-f8a8-4bf0-b602-40d03cc05124 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:07.748356 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6235aab-f8a8-4bf0-b602-40d03cc05124 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:07.753946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-e6235aab-f8a8-4bf0-b602-40d03cc05124 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:55:07.753946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:07.753946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:07.753946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:07.753946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:07.753946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:07.753946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:07.753946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:07.753946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:07.753946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:07.753946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:07.753946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:07.753946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:07.753946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:07.753946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:07.753946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:07.755011 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:07.755011 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:07.755011 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:07.755011 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:07.755011 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:07.755011 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:07.755011 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:07.755011 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:07.755011 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:07.755011 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:07.755011 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:07.755011 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:07.755011 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:07.755011 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:07.755011 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:07.755011 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:07.755946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:07.755946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:07.755946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:07.755946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:07.755946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:07.755946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:07.755946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:07.755946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:07.755946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:07.755946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:07.755946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:55:07.755946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:55:07.761100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 15/29] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:55:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:55:07.772061 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6235aab-f8a8-4bf0-b602-40d03cc05124 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:07.794956 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:07.800354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261ec18-ead2-4e71-89e6-3d9511c8faff None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:07.840555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1499d-c045-4562-a49d-a7fe3151baa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:07.841873 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1499d-c045-4562-a49d-a7fe3151baa8 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:07.842333 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1499d-c045-4562-a49d-a7fe3151baa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:07.842983 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1499d-c045-4562-a49d-a7fe3151baa8 None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:07.844112 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1499d-c045-4562-a49d-a7fe3151baa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:07.845051 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1499d-c045-4562-a49d-a7fe3151baa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:07.847120 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1499d-c045-4562-a49d-a7fe3151baa8 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:07.862970 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 15/30] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:07.866720 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1499d-c045-4562-a49d-a7fe3151baa8 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:07.895231 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:07.936287 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6235aab-f8a8-4bf0-b602-40d03cc05124 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:07.978062 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2445222-5f83-45f3-a4f5-c2c9faebaf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:07.978711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2445222-5f83-45f3-a4f5-c2c9faebaf5f None admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:07.978997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2445222-5f83-45f3-a4f5-c2c9faebaf5f None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:07.979274 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2445222-5f83-45f3-a4f5-c2c9faebaf5f None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:07.979938 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2445222-5f83-45f3-a4f5-c2c9faebaf5f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:07.981356 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2445222-5f83-45f3-a4f5-c2c9faebaf5f None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:07.997183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1499d-c045-4562-a49d-a7fe3151baa8 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:08.032527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fce5e-fb21-46e9-80e3-b70c98625af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:08.033149 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fce5e-fb21-46e9-80e3-b70c98625af8 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:08.033489 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fce5e-fb21-46e9-80e3-b70c98625af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:08.033771 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fce5e-fb21-46e9-80e3-b70c98625af8 None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:08.034471 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1fce5e-fb21-46e9-80e3-b70c98625af8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:08.034777 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1fce5e-fb21-46e9-80e3-b70c98625af8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:08.036156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1fce5e-fb21-46e9-80e3-b70c98625af8 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:08.053060 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 16/31] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:08.053060 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccfb57-ce6e-4b26-9123-175cdafc4f29 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:08.053060 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccfb57-ce6e-4b26-9123-175cdafc4f29 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:08.053060 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccfb57-ce6e-4b26-9123-175cdafc4f29 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:08.053060 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 17/32] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:08.053598 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dccfb57-ce6e-4b26-9123-175cdafc4f29 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:08.084091 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:08.169115 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dccfb57-ce6e-4b26-9123-175cdafc4f29 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:08.219320 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e98c40-43f5-4aef-b27c-1770c3e035a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:08.220115 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e98c40-43f5-4aef-b27c-1770c3e035a7 None admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:08.220354 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 16/33] 10.222.0.57 () {60 vars in 1131 bytes} [Tue Aug 23 07:55:07 2022] POST /identity/v3/roles => generated 219 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:55:08.220648 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e98c40-43f5-4aef-b27c-1770c3e035a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:08.221029 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e98c40-43f5-4aef-b27c-1770c3e035a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:08.221822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2445222-5f83-45f3-a4f5-c2c9faebaf5f None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:08.222322 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e98c40-43f5-4aef-b27c-1770c3e035a7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:08.224042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e98c40-43f5-4aef-b27c-1770c3e035a7 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:08.356778 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2445222-5f83-45f3-a4f5-c2c9faebaf5f None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:08.384473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:08.396148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0fcb6-6321-4c96-96f2-097715136587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:08.397046 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0fcb6-6321-4c96-96f2-097715136587 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:08.397481 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0fcb6-6321-4c96-96f2-097715136587 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:08.397759 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0fcb6-6321-4c96-96f2-097715136587 None admin] PATH_INFO: `/v3/users/168687f5011542bc8d7ca334411c2990` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:08.399067 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0fcb6-6321-4c96-96f2-097715136587 None admin] RBAC: Authorizing `identity:get_user(user_id=168687f5011542bc8d7ca334411c2990)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:08.400703 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0fcb6-6321-4c96-96f2-097715136587 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:08.402514 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 17/34] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:08 2022] GET /identity/v3/users/168687f5011542bc8d7ca334411c2990 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:08.403579 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a62623-dfdd-473b-a235-59e8d74d8dac None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:08.403973 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a62623-dfdd-473b-a235-59e8d74d8dac None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:08.404133 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a62623-dfdd-473b-a235-59e8d74d8dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:08.423958 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-30a62623-dfdd-473b-a235-59e8d74d8dac None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:08.425457 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-30a62623-dfdd-473b-a235-59e8d74d8dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:08.464126 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 18/35] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 23 07:55:08 2022] POST /identity/v3/projects => generated 301 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:55:08.465424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ad08a-96ea-4965-9c63-dec1c5631eef None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:08.465732 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ad08a-96ea-4965-9c63-dec1c5631eef None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:08.465993 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ad08a-96ea-4965-9c63-dec1c5631eef None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:08.467649 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 19/36] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:08.468267 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ad08a-96ea-4965-9c63-dec1c5631eef None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:08.526942 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 18/37] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:08.528516 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fc313-26f8-4467-9c3b-2d7ec9204105 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:08.528809 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fc313-26f8-4467-9c3b-2d7ec9204105 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:08.529083 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fc313-26f8-4467-9c3b-2d7ec9204105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:08.549242 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-1b2fc313-26f8-4467-9c3b-2d7ec9204105 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:08.550651 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-1b2fc313-26f8-4467-9c3b-2d7ec9204105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:08.553718 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:08.607095 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ad08a-96ea-4965-9c63-dec1c5631eef None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:08.644858 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 19/38] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:08.644858 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da4dca-72d2-4248-bb08-b76836fd25c3 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:08.644858 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da4dca-72d2-4248-bb08-b76836fd25c3 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:08.644858 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da4dca-72d2-4248-bb08-b76836fd25c3 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:08.644858 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 20/39] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:08.652063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2ab6b-9009-4f73-bcd0-8b21e287586c None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:08.652346 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2ab6b-9009-4f73-bcd0-8b21e287586c None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:08.652630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2ab6b-9009-4f73-bcd0-8b21e287586c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:08.660720 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e9e32-b13f-42ce-9c72-2560bd20ca6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:08.661629 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e9e32-b13f-42ce-9c72-2560bd20ca6b None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:08.662120 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e9e32-b13f-42ce-9c72-2560bd20ca6b None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:08.662753 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e9e32-b13f-42ce-9c72-2560bd20ca6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:08.668237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e9e32-b13f-42ce-9c72-2560bd20ca6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:08.670179 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e9e32-b13f-42ce-9c72-2560bd20ca6b None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:08.673183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 20/40] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:55:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:08.677806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-67c2ab6b-9009-4f73-bcd0-8b21e287586c None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:08.677806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-67c2ab6b-9009-4f73-bcd0-8b21e287586c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:08.679023 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e9e32-b13f-42ce-9c72-2560bd20ca6b None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:08.728197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:08.752359 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 21/41] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:55:08.788909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e9e32-b13f-42ce-9c72-2560bd20ca6b None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:08.825054 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2ab6b-9009-4f73-bcd0-8b21e287586c None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:08.825853 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35f58e-2f8a-4b09-b34d-bed20a994ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:08.826551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35f58e-2f8a-4b09-b34d-bed20a994ce3 None admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:08.826943 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35f58e-2f8a-4b09-b34d-bed20a994ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:08.827728 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35f58e-2f8a-4b09-b34d-bed20a994ce3 None admin] PATH_INFO: `/v3/domains/default/users/168687f5011542bc8d7ca334411c2990/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:08.830045 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35f58e-2f8a-4b09-b34d-bed20a994ce3 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=168687f5011542bc8d7ca334411c2990, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:08.831543 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35f58e-2f8a-4b09-b34d-bed20a994ce3 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:08.914526 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:08.918907 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 21/42] 10.222.0.57 () {58 vars in 1361 bytes} [Tue Aug 23 07:55:08 2022] PUT /identity/v3/domains/default/users/168687f5011542bc8d7ca334411c2990/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:55:08.943089 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35f58e-2f8a-4b09-b34d-bed20a994ce3 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:08.944656 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2ab6b-9009-4f73-bcd0-8b21e287586c None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:08.989971 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905556d5-96e5-4ef5-b390-b50a7e56654d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:08.990729 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905556d5-96e5-4ef5-b390-b50a7e56654d None admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:08.991019 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905556d5-96e5-4ef5-b390-b50a7e56654d None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:08.996115 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905556d5-96e5-4ef5-b390-b50a7e56654d None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:08.996115 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905556d5-96e5-4ef5-b390-b50a7e56654d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:08.996115 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905556d5-96e5-4ef5-b390-b50a7e56654d None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:09.064931 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35f58e-2f8a-4b09-b34d-bed20a994ce3 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:09.090540 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 22/43] 10.222.0.57 () {60 vars in 1131 bytes} [Tue Aug 23 07:55:08 2022] POST /identity/v3/roles => generated 225 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:55:09.091470 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905556d5-96e5-4ef5-b390-b50a7e56654d None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:09.104062 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09726005-2fc8-4cf3-822c-bbfcd074a800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:09.104706 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09726005-2fc8-4cf3-822c-bbfcd074a800 None admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:09.105322 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09726005-2fc8-4cf3-822c-bbfcd074a800 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:09.105322 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09726005-2fc8-4cf3-822c-bbfcd074a800 None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:09.106077 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09726005-2fc8-4cf3-822c-bbfcd074a800 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:09.107591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09726005-2fc8-4cf3-822c-bbfcd074a800 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:09.151143 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:09.188246 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 22/44] 10.222.0.57 () {60 vars in 1131 bytes} [Tue Aug 23 07:55:08 2022] POST /identity/v3/roles => generated 223 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 07:55:09.240135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905556d5-96e5-4ef5-b390-b50a7e56654d None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:09.281403 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f296287-88ea-4f31-a58a-354bb5b7b2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:09.282076 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f296287-88ea-4f31-a58a-354bb5b7b2ef None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:09.282397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f296287-88ea-4f31-a58a-354bb5b7b2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:09.282683 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f296287-88ea-4f31-a58a-354bb5b7b2ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:09.283940 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f296287-88ea-4f31-a58a-354bb5b7b2ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:09.285595 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f296287-88ea-4f31-a58a-354bb5b7b2ef None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:09.287354 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 23/45] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:55:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:09.293745 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09726005-2fc8-4cf3-822c-bbfcd074a800 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:09.360975 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:09.402909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09726005-2fc8-4cf3-822c-bbfcd074a800 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:09.440622 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd595cd5-5479-4a2f-a7ea-8f0ceff3b2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:09.441245 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd595cd5-5479-4a2f-a7ea-8f0ceff3b2c2 None admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:09.441534 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd595cd5-5479-4a2f-a7ea-8f0ceff3b2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:09.441820 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd595cd5-5479-4a2f-a7ea-8f0ceff3b2c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:09.442603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd595cd5-5479-4a2f-a7ea-8f0ceff3b2c2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:09.444063 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd595cd5-5479-4a2f-a7ea-8f0ceff3b2c2 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:09.530795 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 23/46] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 23 07:55:09 2022] POST /identity/v3/projects => generated 312 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:55:10.879285 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a537b7e-08d0-4e47-b066-9e4b5b312653 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:10.879789 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a537b7e-08d0-4e47-b066-9e4b5b312653 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:10.879873 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a537b7e-08d0-4e47-b066-9e4b5b312653 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:10.881198 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 24/47] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:10.886464 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410316fb-e67e-469b-b3dd-8dc1684ba460 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:10.886908 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410316fb-e67e-469b-b3dd-8dc1684ba460 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:10.887159 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410316fb-e67e-469b-b3dd-8dc1684ba460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:11.009427 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-410316fb-e67e-469b-b3dd-8dc1684ba460 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:11.011012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-410316fb-e67e-469b-b3dd-8dc1684ba460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:11.085948 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 24/48] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:11.355806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a537b7e-08d0-4e47-b066-9e4b5b312653 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:11.421688 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a144c-2d8b-43ce-a03e-535cdf954134 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:11.422158 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a144c-2d8b-43ce-a03e-535cdf954134 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:11.422475 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a144c-2d8b-43ce-a03e-535cdf954134 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:11.423886 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 25/49] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:55:11.429723 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c7ede-f142-4f07-bd71-005a5ba9258a None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:11.430103 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c7ede-f142-4f07-bd71-005a5ba9258a None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:11.430473 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c7ede-f142-4f07-bd71-005a5ba9258a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:11.450215 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-4c3c7ede-f142-4f07-bd71-005a5ba9258a None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:11.451487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-4c3c7ede-f142-4f07-bd71-005a5ba9258a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:11.489368 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:11.522365 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 26/50] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:55:11.569933 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a537b7e-08d0-4e47-b066-9e4b5b312653 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:11.581267 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:11.603359 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b80a6-b350-43c4-8c4d-504a2b8106b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:11.603987 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b80a6-b350-43c4-8c4d-504a2b8106b9 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:11.604270 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b80a6-b350-43c4-8c4d-504a2b8106b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:11.604546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b80a6-b350-43c4-8c4d-504a2b8106b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:11.615371 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b80a6-b350-43c4-8c4d-504a2b8106b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:11.620452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-3c3b80a6-b350-43c4-8c4d-504a2b8106b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:55:11.620452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:11.620452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:11.620452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:11.620452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:11.620452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:11.620452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:11.620452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:11.620452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:11.620452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:11.620452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:11.620452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:11.620452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:11.620452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:11.620452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:11.620452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:11.621281 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:11.621281 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:11.621281 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:11.621281 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:11.621281 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:11.621281 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:11.621281 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:11.621281 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:11.621281 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:11.621281 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:11.621281 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:11.621281 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:11.621281 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:11.621281 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:11.621281 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:11.621281 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:11.622018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:11.622018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:11.622018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:11.622018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:11.622018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:11.622018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:11.622018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:11.622018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:11.622018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:11.622018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:11.622018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:55:11.622018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:55:11.622018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 25/51] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:55:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:11.627494 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c7ede-f142-4f07-bd71-005a5ba9258a None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:11.725891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c7ede-f142-4f07-bd71-005a5ba9258a None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:11.758566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb0f51-f95d-4a4f-809d-e2401d24cbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:11.759176 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb0f51-f95d-4a4f-809d-e2401d24cbb8 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:11.759464 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb0f51-f95d-4a4f-809d-e2401d24cbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:11.759746 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb0f51-f95d-4a4f-809d-e2401d24cbb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:11.760404 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb0f51-f95d-4a4f-809d-e2401d24cbb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:11.760710 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb0f51-f95d-4a4f-809d-e2401d24cbb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:11.762100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb0f51-f95d-4a4f-809d-e2401d24cbb8 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:11.770152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 27/52] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:11.775717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b80a6-b350-43c4-8c4d-504a2b8106b9 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:11.802053 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb0f51-f95d-4a4f-809d-e2401d24cbb8 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:11.835720 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:11.879229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b80a6-b350-43c4-8c4d-504a2b8106b9 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:11.901124 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb0f51-f95d-4a4f-809d-e2401d24cbb8 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:11.912805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223a606-3ec2-45e9-81c6-5e21c26af9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:11.913448 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223a606-3ec2-45e9-81c6-5e21c26af9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:11.913724 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223a606-3ec2-45e9-81c6-5e21c26af9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:11.914001 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223a606-3ec2-45e9-81c6-5e21c26af9d5 None admin] PATH_INFO: `/v3/users/168687f5011542bc8d7ca334411c2990` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:11.915153 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223a606-3ec2-45e9-81c6-5e21c26af9d5 None admin] RBAC: Authorizing `identity:get_user(user_id=168687f5011542bc8d7ca334411c2990)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:11.916595 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223a606-3ec2-45e9-81c6-5e21c26af9d5 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:11.918169 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 26/53] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:11 2022] GET /identity/v3/users/168687f5011542bc8d7ca334411c2990 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:11.923710 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223a606-3ec2-45e9-81c6-5e21c26af9d5 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:11.936696 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871599f-bdc1-4374-b03f-766d8bd585ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:11.937492 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871599f-bdc1-4374-b03f-766d8bd585ea None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:11.937783 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871599f-bdc1-4374-b03f-766d8bd585ea None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:11.938062 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871599f-bdc1-4374-b03f-766d8bd585ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:11.939235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871599f-bdc1-4374-b03f-766d8bd585ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:11.940700 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871599f-bdc1-4374-b03f-766d8bd585ea None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:11.942294 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 28/54] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:55:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:55:11.947624 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871599f-bdc1-4374-b03f-766d8bd585ea None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:11.962595 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:12.022833 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223a606-3ec2-45e9-81c6-5e21c26af9d5 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:12.045321 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871599f-bdc1-4374-b03f-766d8bd585ea None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:12.047459 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:12.056862 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9724a8f-e556-4144-82d3-a40a82e66e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:12.057487 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9724a8f-e556-4144-82d3-a40a82e66e81 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:12.057767 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9724a8f-e556-4144-82d3-a40a82e66e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:12.058041 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9724a8f-e556-4144-82d3-a40a82e66e81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:12.062045 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9724a8f-e556-4144-82d3-a40a82e66e81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:12.062045 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9724a8f-e556-4144-82d3-a40a82e66e81 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:12.062991 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 27/55] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:55:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:55:12.068677 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9724a8f-e556-4144-82d3-a40a82e66e81 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:12.079847 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501e62f-e6d3-48e6-9f8f-f72824c54623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:12.080525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501e62f-e6d3-48e6-9f8f-f72824c54623 None admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:12.080832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501e62f-e6d3-48e6-9f8f-f72824c54623 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:12.081314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501e62f-e6d3-48e6-9f8f-f72824c54623 None admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:12.082117 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501e62f-e6d3-48e6-9f8f-f72824c54623 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:12.083931 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501e62f-e6d3-48e6-9f8f-f72824c54623 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:12.165235 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9724a8f-e556-4144-82d3-a40a82e66e81 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:12.169854 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 29/56] 10.222.0.57 () {60 vars in 1140 bytes} [Tue Aug 23 07:55:11 2022] POST /identity/v3/projects => generated 298 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 07:55:12.172971 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:12.202539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33947b-84f8-4784-a657-11aa9324f196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:12.202756 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33947b-84f8-4784-a657-11aa9324f196 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:12.203040 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33947b-84f8-4784-a657-11aa9324f196 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:12.203324 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33947b-84f8-4784-a657-11aa9324f196 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:12.204080 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33947b-84f8-4784-a657-11aa9324f196 None admin] RBAC: Adding query filter params (role.id=e905040849d04aadbb8da8b0d216c92c, scope.domain.id=default, user.id=168687f5011542bc8d7ca334411c2990) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:12.204398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33947b-84f8-4784-a657-11aa9324f196 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:12.205893 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33947b-84f8-4784-a657-11aa9324f196 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:12.212478 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 28/57] 10.222.0.57 () {56 vars in 1322 bytes} [Tue Aug 23 07:55:12 2022] GET /identity/v3/role_assignments?user.id=168687f5011542bc8d7ca334411c2990&scope.domain.id=default&role.id=e905040849d04aadbb8da8b0d216c92c => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:55:14.080663 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cfeb6-ee0e-4361-8669-6e059a49b4e8 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:14.081199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cfeb6-ee0e-4361-8669-6e059a49b4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:14.081199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cfeb6-ee0e-4361-8669-6e059a49b4e8 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:14.082612 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 30/58] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:14.087829 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b78ea-2cc7-4517-8a4a-271942bc1b41 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:14.088216 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b78ea-2cc7-4517-8a4a-271942bc1b41 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:14.088384 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b78ea-2cc7-4517-8a4a-271942bc1b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:14.106491 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-503b78ea-2cc7-4517-8a4a-271942bc1b41 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:14.107674 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-503b78ea-2cc7-4517-8a4a-271942bc1b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:14.171881 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 29/59] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:14.437426 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cfeb6-ee0e-4361-8669-6e059a49b4e8 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:14.536144 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cfeb6-ee0e-4361-8669-6e059a49b4e8 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:14.569678 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be8773-4622-44f7-a777-98ee0fdcd8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:14.570323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be8773-4622-44f7-a777-98ee0fdcd8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:14.570612 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be8773-4622-44f7-a777-98ee0fdcd8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:14.570888 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be8773-4622-44f7-a777-98ee0fdcd8c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:14.572003 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be8773-4622-44f7-a777-98ee0fdcd8c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:14.573455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be8773-4622-44f7-a777-98ee0fdcd8c5 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:14.575293 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 31/60] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:55:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:14.581274 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b78ea-2cc7-4517-8a4a-271942bc1b41 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:14.675145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:14.678048 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b78ea-2cc7-4517-8a4a-271942bc1b41 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:14.711824 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d76a8-05e3-47e5-8e71-09db78f5c09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:14.712581 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d76a8-05e3-47e5-8e71-09db78f5c09a None admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:14.713173 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d76a8-05e3-47e5-8e71-09db78f5c09a None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:14.713450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d76a8-05e3-47e5-8e71-09db78f5c09a None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:14.714081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d76a8-05e3-47e5-8e71-09db78f5c09a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:14.715559 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d76a8-05e3-47e5-8e71-09db78f5c09a None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:14.815143 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 30/61] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 23 07:55:14 2022] POST /identity/v3/users => generated 275 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:55:17.749640 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6895e-af54-47a1-82df-3eb4710d2eea None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:17.750136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6895e-af54-47a1-82df-3eb4710d2eea None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:17.750248 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6895e-af54-47a1-82df-3eb4710d2eea None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:17.751554 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 32/62] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:17.767803 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53516e54-413d-4c7c-a938-9b5383473b10 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:17.768204 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53516e54-413d-4c7c-a938-9b5383473b10 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:17.768361 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53516e54-413d-4c7c-a938-9b5383473b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:17.795453 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-53516e54-413d-4c7c-a938-9b5383473b10 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:17.797119 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-53516e54-413d-4c7c-a938-9b5383473b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:17.888508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 31/63] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:17.983716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f190868-942e-4963-8a91-dfc638cd38d2 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:17.984002 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f190868-942e-4963-8a91-dfc638cd38d2 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:17.984284 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f190868-942e-4963-8a91-dfc638cd38d2 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:17.985628 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 33/64] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:17.991077 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66c76f-f675-4d2c-aa1c-97c6f9bc4cba None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:17.991532 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66c76f-f675-4d2c-aa1c-97c6f9bc4cba None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:17.991959 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66c76f-f675-4d2c-aa1c-97c6f9bc4cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:18.019331 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-9d66c76f-f675-4d2c-aa1c-97c6f9bc4cba None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:18.020757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-9d66c76f-f675-4d2c-aa1c-97c6f9bc4cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:18.112665 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 32/65] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:18.137179 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f37bb9-f6a9-4193-8332-c8ba3700ff93 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:18.137789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f37bb9-f6a9-4193-8332-c8ba3700ff93 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:18.138279 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f37bb9-f6a9-4193-8332-c8ba3700ff93 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:18.140546 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 34/66] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:18.145907 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5525d52-685f-43da-90f7-48668d52a75f None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:18.146202 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5525d52-685f-43da-90f7-48668d52a75f None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:18.146510 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5525d52-685f-43da-90f7-48668d52a75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:18.175250 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-a5525d52-685f-43da-90f7-48668d52a75f None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:18.176443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-a5525d52-685f-43da-90f7-48668d52a75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:18.189822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:18.266084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 33/67] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:18.359583 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f37bb9-f6a9-4193-8332-c8ba3700ff93 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:18.392948 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:18.419805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5525d52-685f-43da-90f7-48668d52a75f None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:18.490824 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f37bb9-f6a9-4193-8332-c8ba3700ff93 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:18.530263 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc827dfc-9123-4053-9623-5e703f04f665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:18.531278 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc827dfc-9123-4053-9623-5e703f04f665 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:18.531750 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc827dfc-9123-4053-9623-5e703f04f665 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:18.532255 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc827dfc-9123-4053-9623-5e703f04f665 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:18.544749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc827dfc-9123-4053-9623-5e703f04f665 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:18.552426 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-dc827dfc-9123-4053-9623-5e703f04f665 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:55:18.552426 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:18.552426 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:18.552426 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:18.552426 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:18.552426 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:18.552426 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:18.552426 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:18.552426 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:18.552426 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:18.552426 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:18.552426 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:18.552426 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:18.552426 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:18.552426 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:18.552426 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:18.553505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:18.553505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:18.553505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:18.553505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:18.553505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:18.553505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:18.553505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:18.553505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:18.553505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:18.553505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:18.553505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:18.553505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:18.553505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:18.553505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:18.553505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:18.553505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:18.554312 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:18.554312 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:18.554312 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:18.554312 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:18.554312 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:18.554312 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:18.554312 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:18.554312 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:18.554312 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:18.554312 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:18.554312 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:55:18.554312 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:55:18.556399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 35/68] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:55:18.557745 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128add0-0404-4dd6-a1a9-eb4a96edd7bd None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:18.558166 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128add0-0404-4dd6-a1a9-eb4a96edd7bd None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:18.558629 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128add0-0404-4dd6-a1a9-eb4a96edd7bd None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:18.560221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 36/69] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:18.565252 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9128add0-0404-4dd6-a1a9-eb4a96edd7bd None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:18.581742 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5525d52-685f-43da-90f7-48668d52a75f None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:18.622370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a298f-31f9-46e9-aab7-7f6351d430ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:18.623571 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a298f-31f9-46e9-aab7-7f6351d430ad None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:18.624101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a298f-31f9-46e9-aab7-7f6351d430ad None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:18.624621 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a298f-31f9-46e9-aab7-7f6351d430ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:18.635903 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a298f-31f9-46e9-aab7-7f6351d430ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:18.641245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-aa3a298f-31f9-46e9-aab7-7f6351d430ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:55:18.641245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:18.641245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:18.641245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:18.641245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:18.641245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:18.641245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:18.641245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:18.641245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:18.641245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:18.641245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:18.641245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:18.641245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:18.641245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:18.641245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:18.641245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:18.642154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:18.642154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:18.642154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:18.642154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:18.642154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:18.642154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:18.642154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:18.642154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:18.642154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:18.642154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:18.642154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:18.642154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:18.642154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:18.642154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:18.642154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:18.642154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:18.643025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:18.643025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:18.643025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:18.643025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:18.643025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:18.643025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:18.643025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:18.643025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:18.643025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:18.643025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:18.643025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:55:18.643025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:55:18.643025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 34/70] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 23 07:55:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:18.644373 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a48d5-29eb-4aa7-9fd6-f745a99edbfd None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:18.644655 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a48d5-29eb-4aa7-9fd6-f745a99edbfd None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:18.644930 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a48d5-29eb-4aa7-9fd6-f745a99edbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:18.657470 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:18.657945 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:18.663245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-de8a48d5-29eb-4aa7-9fd6-f745a99edbfd None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:18.664468 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-de8a48d5-29eb-4aa7-9fd6-f745a99edbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:18.678784 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9128add0-0404-4dd6-a1a9-eb4a96edd7bd None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:18.713468 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc33bf-7573-4f19-aa93-014ed1c8cbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:18.714070 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc33bf-7573-4f19-aa93-014ed1c8cbe4 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:18.714383 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc33bf-7573-4f19-aa93-014ed1c8cbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:18.714661 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc33bf-7573-4f19-aa93-014ed1c8cbe4 None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:18.715322 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc33bf-7573-4f19-aa93-014ed1c8cbe4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:18.715619 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc33bf-7573-4f19-aa93-014ed1c8cbe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:18.717593 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc33bf-7573-4f19-aa93-014ed1c8cbe4 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:18.725449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 37/71] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 23 07:55:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:18.726261 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc33bf-7573-4f19-aa93-014ed1c8cbe4 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:18.732165 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 35/72] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:18.734265 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7aff5-e095-4b40-b97b-d6f7e448830e None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:18.734586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7aff5-e095-4b40-b97b-d6f7e448830e None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:18.734866 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7aff5-e095-4b40-b97b-d6f7e448830e None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:18.736107 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 36/73] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:18.738489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7aff5-e095-4b40-b97b-d6f7e448830e None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:18.847340 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc33bf-7573-4f19-aa93-014ed1c8cbe4 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:18.848098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7aff5-e095-4b40-b97b-d6f7e448830e None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:18.881726 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09fbc7-f1ca-4ca0-9bac-36e8e629e324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:18.882395 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09fbc7-f1ca-4ca0-9bac-36e8e629e324 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:18.882685 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09fbc7-f1ca-4ca0-9bac-36e8e629e324 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:18.882964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09fbc7-f1ca-4ca0-9bac-36e8e629e324 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:18.884685 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc76de-a4b4-4f14-b3db-69c14249c3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:18.885191 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc76de-a4b4-4f14-b3db-69c14249c3b0 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:18.885478 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc76de-a4b4-4f14-b3db-69c14249c3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:18.885762 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc76de-a4b4-4f14-b3db-69c14249c3b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:18.886459 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc76de-a4b4-4f14-b3db-69c14249c3b0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:18.886769 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc76de-a4b4-4f14-b3db-69c14249c3b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:18.888169 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc76de-a4b4-4f14-b3db-69c14249c3b0 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:18.891523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:18.894997 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09fbc7-f1ca-4ca0-9bac-36e8e629e324 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:18.902138 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 37/74] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:55:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:18.902138 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc76de-a4b4-4f14-b3db-69c14249c3b0 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:18.902380 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-0a09fbc7-f1ca-4ca0-9bac-36e8e629e324 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:55:18.902380 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:18.902380 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:18.902380 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:18.902380 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:18.902380 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:18.902380 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:18.902380 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:18.902380 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:18.902380 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:18.902380 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:18.902380 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:18.902380 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:18.902380 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:18.902380 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:18.902380 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:18.903742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:18.903742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:18.903742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:18.903742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:18.903742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:18.903742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:18.903742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:18.903742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:18.903742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:18.903742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:18.903742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:18.903742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:18.903742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:18.903742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:18.903742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:18.903742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:18.904642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:18.904642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:18.904642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:18.904642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:18.904642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:18.904642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:18.904642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:18.904642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:18.904642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:18.904642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:18.904642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:55:18.904642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:55:18.904642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 38/75] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:55:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:18.904642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b3c63-9348-4247-84bc-cf58760e8921 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:18.905520 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b3c63-9348-4247-84bc-cf58760e8921 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:18.905520 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b3c63-9348-4247-84bc-cf58760e8921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:18.912243 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:18.922915 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-591b3c63-9348-4247-84bc-cf58760e8921 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:18.924130 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-591b3c63-9348-4247-84bc-cf58760e8921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:18.996404 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 39/76] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:18.997075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b3c63-9348-4247-84bc-cf58760e8921 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:19.028208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc76de-a4b4-4f14-b3db-69c14249c3b0 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:19.068120 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98201aea-d596-4589-9d31-ceee3ccfe1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:19.068765 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98201aea-d596-4589-9d31-ceee3ccfe1ff None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:19.069039 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98201aea-d596-4589-9d31-ceee3ccfe1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:19.069386 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98201aea-d596-4589-9d31-ceee3ccfe1ff None admin] PATH_INFO: `/v3/users/f209424acda544bf9bd23d4759bc040d` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:19.089463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98201aea-d596-4589-9d31-ceee3ccfe1ff None admin] RBAC: Authorizing `identity:get_user(user_id=f209424acda544bf9bd23d4759bc040d)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:19.090978 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98201aea-d596-4589-9d31-ceee3ccfe1ff None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:19.097544 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 38/77] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:18 2022] GET /identity/v3/users/f209424acda544bf9bd23d4759bc040d => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:19.097544 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98201aea-d596-4589-9d31-ceee3ccfe1ff None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:19.116734 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b3c63-9348-4247-84bc-cf58760e8921 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:19.150891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607ed7e-2aaa-4591-8429-4bd5ff958834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:19.151527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607ed7e-2aaa-4591-8429-4bd5ff958834 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:19.151809 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607ed7e-2aaa-4591-8429-4bd5ff958834 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:19.152084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607ed7e-2aaa-4591-8429-4bd5ff958834 None admin] PATH_INFO: `/v3/users/f209424acda544bf9bd23d4759bc040d` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:19.153302 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607ed7e-2aaa-4591-8429-4bd5ff958834 None admin] RBAC: Authorizing `identity:get_user(user_id=f209424acda544bf9bd23d4759bc040d)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:19.155488 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607ed7e-2aaa-4591-8429-4bd5ff958834 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:19.157080 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 40/78] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:18 2022] GET /identity/v3/users/f209424acda544bf9bd23d4759bc040d => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:19.162049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607ed7e-2aaa-4591-8429-4bd5ff958834 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:19.162049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:19.164440 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:19.207414 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98201aea-d596-4589-9d31-ceee3ccfe1ff None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:19.242713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0141d-3612-41bc-a70b-927a9be5d5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:19.243325 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0141d-3612-41bc-a70b-927a9be5d5c9 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:19.243609 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0141d-3612-41bc-a70b-927a9be5d5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:19.243884 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0141d-3612-41bc-a70b-927a9be5d5c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:19.244539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0141d-3612-41bc-a70b-927a9be5d5c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:19.244848 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0141d-3612-41bc-a70b-927a9be5d5c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:19.246306 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0141d-3612-41bc-a70b-927a9be5d5c9 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:19.254474 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 39/79] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:19.255330 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0141d-3612-41bc-a70b-927a9be5d5c9 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:19.270574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607ed7e-2aaa-4591-8429-4bd5ff958834 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:19.304646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084dc0f2-7e68-4f45-9acd-ad8c80b7eacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:19.305278 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084dc0f2-7e68-4f45-9acd-ad8c80b7eacf None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:19.305559 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084dc0f2-7e68-4f45-9acd-ad8c80b7eacf None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:19.305832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084dc0f2-7e68-4f45-9acd-ad8c80b7eacf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:19.316046 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084dc0f2-7e68-4f45-9acd-ad8c80b7eacf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:19.321500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-084dc0f2-7e68-4f45-9acd-ad8c80b7eacf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:55:19.321500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:19.321500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:19.321500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:19.321500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:19.321500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:19.321500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:19.321500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:19.321500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:19.321500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:19.321500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:19.321500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:19.321500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:19.321500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:19.321500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:19.321500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:19.322449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:19.322449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:19.322449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:19.322449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:19.322449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:19.322449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:19.322449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:19.322449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:19.322449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:19.322449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:19.322449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:19.322449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:19.322449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:19.322449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:19.322449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:19.322449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:19.323197 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:19.323197 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:19.323197 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:19.323197 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:19.323197 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:19.323197 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:19.323197 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:19.323197 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:19.323197 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:19.323197 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:19.323197 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:55:19.323197 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:55:19.323197 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 41/80] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:19.324089 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084dc0f2-7e68-4f45-9acd-ad8c80b7eacf None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:19.364295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0141d-3612-41bc-a70b-927a9be5d5c9 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:19.381375 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:19.389144 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:19.397707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b93fb5-2280-4e43-9b90-637534b648dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:19.398339 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b93fb5-2280-4e43-9b90-637534b648dd None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:19.398624 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b93fb5-2280-4e43-9b90-637534b648dd None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:19.399099 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b93fb5-2280-4e43-9b90-637534b648dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:19.428259 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084dc0f2-7e68-4f45-9acd-ad8c80b7eacf None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:19.460789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f509f-9f45-4e8d-9d09-c512960c488b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:19.461386 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f509f-9f45-4e8d-9d09-c512960c488b None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:19.461671 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f509f-9f45-4e8d-9d09-c512960c488b None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:19.461942 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f509f-9f45-4e8d-9d09-c512960c488b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:19.465341 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b93fb5-2280-4e43-9b90-637534b648dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:19.466873 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b93fb5-2280-4e43-9b90-637534b648dd None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:19.528025 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f509f-9f45-4e8d-9d09-c512960c488b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:19.530098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f509f-9f45-4e8d-9d09-c512960c488b None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:19.565296 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 40/81] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:55:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:55:19.566131 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b93fb5-2280-4e43-9b90-637534b648dd None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:19.586258 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:19.587620 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:19.626002 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 42/82] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:55:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:55:19.626588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f509f-9f45-4e8d-9d09-c512960c488b None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:19.672483 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b93fb5-2280-4e43-9b90-637534b648dd None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:19.707255 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565d1cf-01ad-4b54-9e05-5cba92a031d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:19.707885 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565d1cf-01ad-4b54-9e05-5cba92a031d2 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:19.708169 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565d1cf-01ad-4b54-9e05-5cba92a031d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:19.708447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565d1cf-01ad-4b54-9e05-5cba92a031d2 None admin] PATH_INFO: `/v3/users/168687f5011542bc8d7ca334411c2990` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:19.709551 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565d1cf-01ad-4b54-9e05-5cba92a031d2 None admin] RBAC: Authorizing `identity:get_user(user_id=168687f5011542bc8d7ca334411c2990)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:19.711073 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565d1cf-01ad-4b54-9e05-5cba92a031d2 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:19.712638 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 41/83] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:19 2022] GET /identity/v3/users/168687f5011542bc8d7ca334411c2990 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:19.713387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565d1cf-01ad-4b54-9e05-5cba92a031d2 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:19.733523 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f509f-9f45-4e8d-9d09-c512960c488b None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:19.767657 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a77c26-4532-4c5c-844d-936b74ae1e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:19.768289 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a77c26-4532-4c5c-844d-936b74ae1e8a None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:19.768575 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a77c26-4532-4c5c-844d-936b74ae1e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:19.768863 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a77c26-4532-4c5c-844d-936b74ae1e8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:19.769964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a77c26-4532-4c5c-844d-936b74ae1e8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:19.771455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a77c26-4532-4c5c-844d-936b74ae1e8a None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:19.773023 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 43/84] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:55:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:19.774419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a77c26-4532-4c5c-844d-936b74ae1e8a None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:19.801043 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:19.803558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:19.815701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565d1cf-01ad-4b54-9e05-5cba92a031d2 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:19.848701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79130b0-2c6f-4a00-8319-3708704315ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:19.849328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79130b0-2c6f-4a00-8319-3708704315ba None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:19.849604 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79130b0-2c6f-4a00-8319-3708704315ba None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:19.849883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79130b0-2c6f-4a00-8319-3708704315ba None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:19.850567 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79130b0-2c6f-4a00-8319-3708704315ba None admin] RBAC: Adding query filter params (name=member) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:19.850872 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79130b0-2c6f-4a00-8319-3708704315ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:19.852257 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79130b0-2c6f-4a00-8319-3708704315ba None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:19.860909 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 42/85] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 23 07:55:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:19.861717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79130b0-2c6f-4a00-8319-3708704315ba None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:19.872169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a77c26-4532-4c5c-844d-936b74ae1e8a None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:19.905888 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0000ae6-cfa9-43d6-94ff-e54b8e55fb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:19.906500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0000ae6-cfa9-43d6-94ff-e54b8e55fb15 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:19.906783 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0000ae6-cfa9-43d6-94ff-e54b8e55fb15 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:19.907057 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0000ae6-cfa9-43d6-94ff-e54b8e55fb15 None admin] PATH_INFO: `/v3/projects/dbd8608370894c55b5729ce6902c5722` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:19.908184 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0000ae6-cfa9-43d6-94ff-e54b8e55fb15 None admin] RBAC: Authorizing `identity:get_project(project_id=dbd8608370894c55b5729ce6902c5722)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:19.909645 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0000ae6-cfa9-43d6-94ff-e54b8e55fb15 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:19.911465 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 44/86] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:19 2022] GET /identity/v3/projects/dbd8608370894c55b5729ce6902c5722 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:19.912046 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0000ae6-cfa9-43d6-94ff-e54b8e55fb15 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:19.964782 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79130b0-2c6f-4a00-8319-3708704315ba None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:19.998940 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81519c1e-b652-4265-b6fd-15f15d95806d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:19.999579 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81519c1e-b652-4265-b6fd-15f15d95806d None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:19.999860 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81519c1e-b652-4265-b6fd-15f15d95806d None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:20.000144 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81519c1e-b652-4265-b6fd-15f15d95806d None admin] PATH_INFO: `/v3/projects/dbd8608370894c55b5729ce6902c5722` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:20.001258 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81519c1e-b652-4265-b6fd-15f15d95806d None admin] RBAC: Authorizing `identity:get_project(project_id=dbd8608370894c55b5729ce6902c5722)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:20.002760 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81519c1e-b652-4265-b6fd-15f15d95806d None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:20.004380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 43/87] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:19 2022] GET /identity/v3/projects/dbd8608370894c55b5729ce6902c5722 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:20.005113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81519c1e-b652-4265-b6fd-15f15d95806d None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:20.013780 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:20.017605 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0000ae6-cfa9-43d6-94ff-e54b8e55fb15 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:20.022990 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:20.052062 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd819753-a868-45b3-b3be-6da7339e534e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:20.052679 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd819753-a868-45b3-b3be-6da7339e534e None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:20.052950 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd819753-a868-45b3-b3be-6da7339e534e None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:20.053224 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd819753-a868-45b3-b3be-6da7339e534e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:20.106055 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81519c1e-b652-4265-b6fd-15f15d95806d None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:20.118995 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd819753-a868-45b3-b3be-6da7339e534e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:20.120480 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd819753-a868-45b3-b3be-6da7339e534e None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:20.139787 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851749a-477c-4cc5-904f-e23843eb26a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:20.140390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851749a-477c-4cc5-904f-e23843eb26a9 None admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:20.140672 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851749a-477c-4cc5-904f-e23843eb26a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:20.140948 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851749a-477c-4cc5-904f-e23843eb26a9 None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:20.141592 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851749a-477c-4cc5-904f-e23843eb26a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:20.143039 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851749a-477c-4cc5-904f-e23843eb26a9 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:20.211959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:20.216217 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 45/88] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:55:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:55:20.217557 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd819753-a868-45b3-b3be-6da7339e534e None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:20.249462 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 44/89] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 23 07:55:20 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:55:20.249462 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851749a-477c-4cc5-904f-e23843eb26a9 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:20.322365 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:20.335755 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd819753-a868-45b3-b3be-6da7339e534e None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:20.355740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851749a-477c-4cc5-904f-e23843eb26a9 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:20.374662 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554530d1-2d8a-4736-8ff7-57e433f209de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:20.375321 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554530d1-2d8a-4736-8ff7-57e433f209de None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:20.375620 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554530d1-2d8a-4736-8ff7-57e433f209de None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:20.375889 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554530d1-2d8a-4736-8ff7-57e433f209de None admin] PATH_INFO: `/v3/users/f209424acda544bf9bd23d4759bc040d` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:20.377083 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554530d1-2d8a-4736-8ff7-57e433f209de None admin] RBAC: Authorizing `identity:get_user(user_id=f209424acda544bf9bd23d4759bc040d)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:20.378662 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554530d1-2d8a-4736-8ff7-57e433f209de None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:20.380381 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 46/90] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:20 2022] GET /identity/v3/users/f209424acda544bf9bd23d4759bc040d => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:20.381169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554530d1-2d8a-4736-8ff7-57e433f209de None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:20.398693 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc3823-1761-4449-95c6-3d9292046290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:20.399970 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc3823-1761-4449-95c6-3d9292046290 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:20.400466 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc3823-1761-4449-95c6-3d9292046290 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:20.400751 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc3823-1761-4449-95c6-3d9292046290 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:20.401501 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc3823-1761-4449-95c6-3d9292046290 None admin] RBAC: Adding query filter params (role.id=4ed852223bc54be09a9487ff788b7644, scope.project.id=dbd8608370894c55b5729ce6902c5722, user.id=f209424acda544bf9bd23d4759bc040d) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:20.401813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc3823-1761-4449-95c6-3d9292046290 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:20.403297 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc3823-1761-4449-95c6-3d9292046290 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:20.409261 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 45/91] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:55:20 2022] GET /identity/v3/role_assignments?user.id=f209424acda544bf9bd23d4759bc040d&scope.project.id=dbd8608370894c55b5729ce6902c5722&role.id=4ed852223bc54be09a9487ff788b7644 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:20.409905 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc3823-1761-4449-95c6-3d9292046290 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:20.484336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:20.544620 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc3823-1761-4449-95c6-3d9292046290 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:20.579829 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554530d1-2d8a-4736-8ff7-57e433f209de None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:20.600674 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123a97d-8671-4b89-8079-d23e9a5c1fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:20.602010 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123a97d-8671-4b89-8079-d23e9a5c1fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:20.602319 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123a97d-8671-4b89-8079-d23e9a5c1fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:20.602632 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123a97d-8671-4b89-8079-d23e9a5c1fa7 None admin] PATH_INFO: `/v3/projects/dbd8608370894c55b5729ce6902c5722` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:20.603857 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123a97d-8671-4b89-8079-d23e9a5c1fa7 None admin] RBAC: Authorizing `identity:get_project(project_id=dbd8608370894c55b5729ce6902c5722)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:20.606689 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123a97d-8671-4b89-8079-d23e9a5c1fa7 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:20.609280 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 46/92] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:20 2022] GET /identity/v3/projects/dbd8608370894c55b5729ce6902c5722 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:20.612253 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123a97d-8671-4b89-8079-d23e9a5c1fa7 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:20.621536 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:20.631901 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9832b-7b7f-45f3-ab6b-c6d98ee84696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:20.631901 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9832b-7b7f-45f3-ab6b-c6d98ee84696 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:20.631901 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9832b-7b7f-45f3-ab6b-c6d98ee84696 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:20.631901 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9832b-7b7f-45f3-ab6b-c6d98ee84696 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:20.636750 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9832b-7b7f-45f3-ab6b-c6d98ee84696 None admin] RBAC: Adding query filter params (role.id=4e9a14889d764731b59323f764f1bb85, scope.project.id=dbd8608370894c55b5729ce6902c5722, user.id=f209424acda544bf9bd23d4759bc040d) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:20.636750 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9832b-7b7f-45f3-ab6b-c6d98ee84696 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:20.636750 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9832b-7b7f-45f3-ab6b-c6d98ee84696 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:20.642050 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 47/93] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:55:20 2022] GET /identity/v3/role_assignments?user.id=f209424acda544bf9bd23d4759bc040d&scope.project.id=dbd8608370894c55b5729ce6902c5722&role.id=4e9a14889d764731b59323f764f1bb85 => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:20.643097 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9832b-7b7f-45f3-ab6b-c6d98ee84696 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:20.810181 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123a97d-8671-4b89-8079-d23e9a5c1fa7 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:20.849450 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9832b-7b7f-45f3-ab6b-c6d98ee84696 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:20.870641 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75612a-da2b-487a-b836-0cfa79538f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:20.871351 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75612a-da2b-487a-b836-0cfa79538f65 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:20.871712 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75612a-da2b-487a-b836-0cfa79538f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:20.872066 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75612a-da2b-487a-b836-0cfa79538f65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:20.924817 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:20.943044 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d81bb-7f63-4a4d-9316-b84032d454e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:20.944958 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d81bb-7f63-4a4d-9316-b84032d454e7 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:20.946788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d81bb-7f63-4a4d-9316-b84032d454e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:20.950790 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d81bb-7f63-4a4d-9316-b84032d454e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:20.950790 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d81bb-7f63-4a4d-9316-b84032d454e7 None admin] RBAC: Adding query filter params (role.id=e905040849d04aadbb8da8b0d216c92c, scope.project.id=dbd8608370894c55b5729ce6902c5722, user.id=168687f5011542bc8d7ca334411c2990) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:20.950790 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d81bb-7f63-4a4d-9316-b84032d454e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:20.950790 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d81bb-7f63-4a4d-9316-b84032d454e7 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:20.961269 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75612a-da2b-487a-b836-0cfa79538f65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:20.963206 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75612a-da2b-487a-b836-0cfa79538f65 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:20.964239 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 48/94] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:55:20 2022] GET /identity/v3/role_assignments?user.id=168687f5011542bc8d7ca334411c2990&scope.project.id=dbd8608370894c55b5729ce6902c5722&role.id=e905040849d04aadbb8da8b0d216c92c => generated 259 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:20.973874 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:21.129371 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 47/95] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:55:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:55:21.135464 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d81bb-7f63-4a4d-9316-b84032d454e7 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:21.294389 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d81bb-7f63-4a4d-9316-b84032d454e7 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:21.344790 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5538e9-75ce-4cb7-b05d-ee5f88330294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:21.345437 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5538e9-75ce-4cb7-b05d-ee5f88330294 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:21.345731 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5538e9-75ce-4cb7-b05d-ee5f88330294 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:21.346013 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5538e9-75ce-4cb7-b05d-ee5f88330294 None admin] PATH_INFO: `/v3/projects/8506ab1b0abf4200b752dffbf2b058e9` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:21.351010 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5538e9-75ce-4cb7-b05d-ee5f88330294 None admin] RBAC: Authorizing `identity:get_project(project_id=8506ab1b0abf4200b752dffbf2b058e9)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:21.352521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5538e9-75ce-4cb7-b05d-ee5f88330294 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:21.354215 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 49/96] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:21 2022] GET /identity/v3/projects/8506ab1b0abf4200b752dffbf2b058e9 => generated 312 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:21.361336 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75612a-da2b-487a-b836-0cfa79538f65 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:21.491190 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75612a-da2b-487a-b836-0cfa79538f65 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:21.493602 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:21.531345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef01f1-32c3-4830-98a1-076ec83c6177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:21.531965 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef01f1-32c3-4830-98a1-076ec83c6177 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:21.532253 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef01f1-32c3-4830-98a1-076ec83c6177 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:21.532534 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef01f1-32c3-4830-98a1-076ec83c6177 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:21.533265 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef01f1-32c3-4830-98a1-076ec83c6177 None admin] RBAC: Adding query filter params (role.id=4ed852223bc54be09a9487ff788b7644, scope.project.id=8506ab1b0abf4200b752dffbf2b058e9, user.id=f209424acda544bf9bd23d4759bc040d) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:21.533577 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef01f1-32c3-4830-98a1-076ec83c6177 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:21.535071 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef01f1-32c3-4830-98a1-076ec83c6177 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:21.540795 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 48/97] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:55:21 2022] GET /identity/v3/role_assignments?user.id=f209424acda544bf9bd23d4759bc040d&scope.project.id=8506ab1b0abf4200b752dffbf2b058e9&role.id=4ed852223bc54be09a9487ff788b7644 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:23.062381 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db79c3d-5ccc-4b13-bcb6-a03778f87e35 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:23.062955 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db79c3d-5ccc-4b13-bcb6-a03778f87e35 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:23.062955 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db79c3d-5ccc-4b13-bcb6-a03778f87e35 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:23.064596 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 50/98] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:23.069916 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17993c7e-1e5d-489b-97a7-ac55154853b3 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:23.070383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17993c7e-1e5d-489b-97a7-ac55154853b3 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:23.070557 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17993c7e-1e5d-489b-97a7-ac55154853b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:23.095927 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-17993c7e-1e5d-489b-97a7-ac55154853b3 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:23.097216 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-17993c7e-1e5d-489b-97a7-ac55154853b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:23.132967 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fe3d1-33d1-4041-ba3f-24140e331477 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:23.133285 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fe3d1-33d1-4041-ba3f-24140e331477 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:23.133527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fe3d1-33d1-4041-ba3f-24140e331477 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:23.134899 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 51/99] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:55:23.140289 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cd31e-6062-4578-8460-552c8af7d71d None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:23.140577 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cd31e-6062-4578-8460-552c8af7d71d None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:23.140886 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cd31e-6062-4578-8460-552c8af7d71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:23.161061 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-0c8cd31e-6062-4578-8460-552c8af7d71d None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:23.162419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-0c8cd31e-6062-4578-8460-552c8af7d71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:23.204814 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 49/100] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:23.222675 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3231902-5de3-4bfe-b2b2-d5eeb63ab64d None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:23.222982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3231902-5de3-4bfe-b2b2-d5eeb63ab64d None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:23.223231 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3231902-5de3-4bfe-b2b2-d5eeb63ab64d None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:23.224545 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 50/101] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:55:23.229508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a4ee6-ba24-4e96-82ad-2ec28f2187ad None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:23.229789 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a4ee6-ba24-4e96-82ad-2ec28f2187ad None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:23.230062 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a4ee6-ba24-4e96-82ad-2ec28f2187ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:23.256041 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-544a4ee6-ba24-4e96-82ad-2ec28f2187ad None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:23.257224 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-544a4ee6-ba24-4e96-82ad-2ec28f2187ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:23.280038 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:23.302466 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 52/102] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:23.381270 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 51/103] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 23 07:55:23.677539 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cd31e-6062-4578-8460-552c8af7d71d None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:23.782855 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a4ee6-ba24-4e96-82ad-2ec28f2187ad None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:23.818606 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:23.832051 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cd31e-6062-4578-8460-552c8af7d71d None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:23.891446 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badba62-94ea-47a4-b854-164f284a7a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:23.892103 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badba62-94ea-47a4-b854-164f284a7a82 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:23.892384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badba62-94ea-47a4-b854-164f284a7a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:23.892658 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badba62-94ea-47a4-b854-164f284a7a82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:23.894863 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4badba62-94ea-47a4-b854-164f284a7a82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:23.896614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4badba62-94ea-47a4-b854-164f284a7a82 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:23.899630 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 53/104] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:55:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:23.907283 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badba62-94ea-47a4-b854-164f284a7a82 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:23.919370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a4ee6-ba24-4e96-82ad-2ec28f2187ad None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:23.983257 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72444da-ab41-422f-b0c0-98ac23f0a17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:23.984004 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72444da-ab41-422f-b0c0-98ac23f0a17d None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:23.984286 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72444da-ab41-422f-b0c0-98ac23f0a17d None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:23.984558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72444da-ab41-422f-b0c0-98ac23f0a17d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:24.005513 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:24.013235 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72444da-ab41-422f-b0c0-98ac23f0a17d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:24.019322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-c72444da-ab41-422f-b0c0-98ac23f0a17d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:55:24.019322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:24.019322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:24.019322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:24.019322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:24.019322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:24.019322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:24.019322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:24.019322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:24.019322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:24.019322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:24.019322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:24.019322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:24.019322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:24.019322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:24.019322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:24.020197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:24.020197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:24.020197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:24.020197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:24.020197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:24.020197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:24.020197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:24.020197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:24.020197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:24.020197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:24.020197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:24.020197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:24.020197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:24.020197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:24.020197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:24.020197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:24.021341 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:24.021341 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:24.021341 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:24.021341 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:24.021341 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:24.021341 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:24.021341 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:24.021341 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:24.021341 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:24.021341 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:24.021341 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:55:24.021341 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:55:24.021341 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 52/105] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:55:24.021341 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72444da-ab41-422f-b0c0-98ac23f0a17d None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:24.066876 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badba62-94ea-47a4-b854-164f284a7a82 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:24.111122 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f1546-79e5-41f0-a36d-1c51f22233fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:24.112117 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f1546-79e5-41f0-a36d-1c51f22233fd None admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:24.112601 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f1546-79e5-41f0-a36d-1c51f22233fd None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:24.113075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f1546-79e5-41f0-a36d-1c51f22233fd None admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:24.113912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f1546-79e5-41f0-a36d-1c51f22233fd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:24.115643 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f1546-79e5-41f0-a36d-1c51f22233fd None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:24.133164 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:24.147003 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72444da-ab41-422f-b0c0-98ac23f0a17d None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:24.189930 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e315f-cf1f-457f-8f4c-f00f3ffcf1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:24.190714 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e315f-cf1f-457f-8f4c-f00f3ffcf1bb None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:24.191023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e315f-cf1f-457f-8f4c-f00f3ffcf1bb None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:24.191313 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e315f-cf1f-457f-8f4c-f00f3ffcf1bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:24.204508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e315f-cf1f-457f-8f4c-f00f3ffcf1bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:24.209443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-cf1e315f-cf1f-457f-8f4c-f00f3ffcf1bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:55:24.209443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:24.209443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:24.209443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:24.209443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:24.209443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:24.209443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:24.209443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:24.209443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:24.209443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:24.209443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:24.209443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:24.209443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:24.209443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:24.209443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:24.209443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:24.210391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:24.210391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:24.210391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:24.210391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:24.210391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:24.210391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:24.210391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:24.210391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:24.210391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:24.210391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:24.210391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:24.210391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:24.210391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:24.210391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:24.210391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:24.210391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:24.211505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:24.211505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:24.211505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:24.211505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:24.211505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:24.211505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:24.211505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:24.211505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:24.211505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:24.211505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:24.211505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:55:24.211505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:55:24.211505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 53/106] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:24.212378 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbe677-60be-421b-8e37-2f5f7c58d914 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:24.212378 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbe677-60be-421b-8e37-2f5f7c58d914 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:24.212378 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbe677-60be-421b-8e37-2f5f7c58d914 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:24.213780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 54/107] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:24.214315 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbe677-60be-421b-8e37-2f5f7c58d914 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:24.233004 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 54/108] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 23 07:55:23 2022] POST /identity/v3/projects => generated 302 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 07:55:24.234782 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd8a63-5bdf-4d18-be1b-2c87ed5128f3 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:24.235263 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd8a63-5bdf-4d18-be1b-2c87ed5128f3 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:24.235367 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd8a63-5bdf-4d18-be1b-2c87ed5128f3 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:24.236809 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 55/109] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:24.237573 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd8a63-5bdf-4d18-be1b-2c87ed5128f3 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:24.368264 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbe677-60be-421b-8e37-2f5f7c58d914 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:24.400961 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd8a63-5bdf-4d18-be1b-2c87ed5128f3 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:24.417935 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7303244-075d-492e-a1d7-fd2b56dc64c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:24.419679 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7303244-075d-492e-a1d7-fd2b56dc64c5 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:24.420318 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:24.420546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7303244-075d-492e-a1d7-fd2b56dc64c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:24.420809 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7303244-075d-492e-a1d7-fd2b56dc64c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:24.421813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7303244-075d-492e-a1d7-fd2b56dc64c5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:24.422207 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7303244-075d-492e-a1d7-fd2b56dc64c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:24.423840 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7303244-075d-492e-a1d7-fd2b56dc64c5 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:24.435155 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 55/110] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 23 07:55:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:24.440856 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf48ff4-2b66-4676-81e7-b25f7158667f None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:24.440856 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf48ff4-2b66-4676-81e7-b25f7158667f None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:24.440856 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf48ff4-2b66-4676-81e7-b25f7158667f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:24.460814 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a573691-184e-42ca-8a61-71923b91f410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:24.461477 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a573691-184e-42ca-8a61-71923b91f410 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:24.461593 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-abf48ff4-2b66-4676-81e7-b25f7158667f None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:24.461776 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a573691-184e-42ca-8a61-71923b91f410 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:24.462093 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a573691-184e-42ca-8a61-71923b91f410 None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:24.462832 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-abf48ff4-2b66-4676-81e7-b25f7158667f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:24.462944 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a573691-184e-42ca-8a61-71923b91f410 None admin] RBAC: Adding query filter params (name=member) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:24.463131 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a573691-184e-42ca-8a61-71923b91f410 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:24.464532 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a573691-184e-42ca-8a61-71923b91f410 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:24.465952 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:24.475603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 56/111] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 23 07:55:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:24.477128 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891ea10-9887-46a3-9427-490fa75f4b16 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:24.477601 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891ea10-9887-46a3-9427-490fa75f4b16 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:24.478037 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891ea10-9887-46a3-9427-490fa75f4b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:24.498590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-5891ea10-9887-46a3-9427-490fa75f4b16 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:24.500406 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-5891ea10-9887-46a3-9427-490fa75f4b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:24.552064 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 56/112] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:24.553056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf48ff4-2b66-4676-81e7-b25f7158667f None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:24.572234 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 57/113] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:24.573493 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891ea10-9887-46a3-9427-490fa75f4b16 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:24.688190 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891ea10-9887-46a3-9427-490fa75f4b16 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:24.690172 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf48ff4-2b66-4676-81e7-b25f7158667f None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:24.694080 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:24.730798 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953f1bd-2607-4a53-bcba-ed05e199c448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:24.731438 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953f1bd-2607-4a53-bcba-ed05e199c448 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:24.732032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953f1bd-2607-4a53-bcba-ed05e199c448 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:24.732875 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953f1bd-2607-4a53-bcba-ed05e199c448 None admin] PATH_INFO: `/v3/users/a9a504a7a9164cd2b64ee8ca16cf8af4` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:24.743190 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60fb63a-2782-44da-93d9-595910a80a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:24.744362 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fb63a-2782-44da-93d9-595910a80a3b None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:24.745132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:24.745592 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fb63a-2782-44da-93d9-595910a80a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:24.746886 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fb63a-2782-44da-93d9-595910a80a3b None admin] PATH_INFO: `/v3/users/f209424acda544bf9bd23d4759bc040d` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:24.748843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953f1bd-2607-4a53-bcba-ed05e199c448 None admin] RBAC: Authorizing `identity:get_user(user_id=a9a504a7a9164cd2b64ee8ca16cf8af4)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:24.749067 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60fb63a-2782-44da-93d9-595910a80a3b None admin] RBAC: Authorizing `identity:get_user(user_id=f209424acda544bf9bd23d4759bc040d)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:24.750424 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953f1bd-2607-4a53-bcba-ed05e199c448 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:24.751052 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60fb63a-2782-44da-93d9-595910a80a3b None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:24.752229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 57/114] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:24 2022] GET /identity/v3/users/a9a504a7a9164cd2b64ee8ca16cf8af4 => generated 289 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:24.756683 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 58/115] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:24 2022] GET /identity/v3/users/f209424acda544bf9bd23d4759bc040d => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:24.757910 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953f1bd-2607-4a53-bcba-ed05e199c448 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:24.758672 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60fb63a-2782-44da-93d9-595910a80a3b None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:24.953810 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953f1bd-2607-4a53-bcba-ed05e199c448 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:24.954889 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60fb63a-2782-44da-93d9-595910a80a3b None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:24.991144 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62592fd5-7654-405b-9f12-401322e809d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:24.991775 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62592fd5-7654-405b-9f12-401322e809d3 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:24.992055 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62592fd5-7654-405b-9f12-401322e809d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:24.992327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62592fd5-7654-405b-9f12-401322e809d3 None admin] PATH_INFO: `/v3/projects/dbd8608370894c55b5729ce6902c5722` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:24.992634 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67dbc1-a90f-4c50-b950-4b7eb70084c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:24.993273 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67dbc1-a90f-4c50-b950-4b7eb70084c8 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:24.993494 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62592fd5-7654-405b-9f12-401322e809d3 None admin] RBAC: Authorizing `identity:get_project(project_id=dbd8608370894c55b5729ce6902c5722)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:24.993587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67dbc1-a90f-4c50-b950-4b7eb70084c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:24.993829 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67dbc1-a90f-4c50-b950-4b7eb70084c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:24.994992 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62592fd5-7654-405b-9f12-401322e809d3 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:25.006492 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 59/116] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:24 2022] GET /identity/v3/projects/dbd8608370894c55b5729ce6902c5722 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:25.006492 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00450c-ace0-475d-9006-725f67aec77d None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:25.006492 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00450c-ace0-475d-9006-725f67aec77d None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:25.006492 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00450c-ace0-475d-9006-725f67aec77d None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:25.006492 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 60/117] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:25.006492 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00450c-ace0-475d-9006-725f67aec77d None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:25.043787 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:25.071788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:25.076700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67dbc1-a90f-4c50-b950-4b7eb70084c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:25.078756 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67dbc1-a90f-4c50-b950-4b7eb70084c8 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:25.104596 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00450c-ace0-475d-9006-725f67aec77d None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:25.146007 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77000129-ac17-45d9-944f-7d48ad0d986b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:25.146753 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77000129-ac17-45d9-944f-7d48ad0d986b None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:25.146957 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77000129-ac17-45d9-944f-7d48ad0d986b None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:25.147238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77000129-ac17-45d9-944f-7d48ad0d986b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:25.159091 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77000129-ac17-45d9-944f-7d48ad0d986b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:25.163867 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-77000129-ac17-45d9-944f-7d48ad0d986b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:55:25.163867 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:25.163867 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:25.163867 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:25.163867 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:25.163867 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:25.163867 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:25.163867 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:25.163867 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:25.163867 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:25.163867 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:25.163867 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:25.163867 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:25.163867 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:25.163867 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:25.163867 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:25.164687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:25.164687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:25.164687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:25.164687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:25.164687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:25.164687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:25.164687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:25.164687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:25.164687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:25.164687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:25.164687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:25.164687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:25.164687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:25.164687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:25.164687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:25.164687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:25.171626 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:25.171626 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:25.171626 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:25.171626 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:25.171626 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:25.171626 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:25.171626 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:25.171626 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:25.171626 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:25.171626 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:25.171626 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:55:25.171626 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:55:25.171626 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 61/118] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 23 07:55:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:25.171626 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77000129-ac17-45d9-944f-7d48ad0d986b None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:25.196200 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 58/119] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:55:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:55:25.197609 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc25476-1659-4749-ae93-3731fb565c17 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:25.197905 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc25476-1659-4749-ae93-3731fb565c17 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:25.198183 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc25476-1659-4749-ae93-3731fb565c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:25.216234 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-afc25476-1659-4749-ae93-3731fb565c17 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:25.218121 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-afc25476-1659-4749-ae93-3731fb565c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:25.275438 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:25.278474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77000129-ac17-45d9-944f-7d48ad0d986b None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:25.290630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 59/120] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:25.291689 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc25476-1659-4749-ae93-3731fb565c17 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:25.323246 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043dad16-7979-4150-93c8-84199ec6feed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:25.324642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dad16-7979-4150-93c8-84199ec6feed None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:25.325018 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dad16-7979-4150-93c8-84199ec6feed None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:25.325352 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dad16-7979-4150-93c8-84199ec6feed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:25.329313 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:25.340985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043dad16-7979-4150-93c8-84199ec6feed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:25.346760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-043dad16-7979-4150-93c8-84199ec6feed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:55:25.346760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:25.346760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:25.346760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:25.346760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:25.346760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:25.346760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:25.346760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:25.346760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:25.346760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:25.346760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:25.346760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:25.346760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:25.346760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:25.346760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:25.346760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:25.347625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:25.347625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:25.347625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:25.347625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:25.347625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:25.347625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:25.347625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:25.347625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:25.347625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:25.347625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:25.347625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:25.347625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:25.347625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:25.347625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:25.347625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:25.347625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:25.353384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:25.353384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:25.353384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:25.353384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:25.353384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:25.353384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:25.353384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:25.353384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:25.353384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:25.353384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:25.353384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:55:25.353384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:55:25.353384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 62/121] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:55:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:25.353384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043dad16-7979-4150-93c8-84199ec6feed None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:25.428387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc25476-1659-4749-ae93-3731fb565c17 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:25.460099 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043dad16-7979-4150-93c8-84199ec6feed None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:25.467350 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a3afd-3870-4d90-969b-c8fcded2ba59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:25.468620 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a3afd-3870-4d90-969b-c8fcded2ba59 None admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:25.469182 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a3afd-3870-4d90-969b-c8fcded2ba59 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:25.469653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a3afd-3870-4d90-969b-c8fcded2ba59 None admin] PATH_INFO: `/v3/projects/dbd8608370894c55b5729ce6902c5722/users/f209424acda544bf9bd23d4759bc040d/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:25.471958 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a3afd-3870-4d90-969b-c8fcded2ba59 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbd8608370894c55b5729ce6902c5722, user_id=f209424acda544bf9bd23d4759bc040d, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:25.473748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a3afd-3870-4d90-969b-c8fcded2ba59 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:25.496627 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869108e5-3a31-462b-bc95-3024dc2a7ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:25.497243 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869108e5-3a31-462b-bc95-3024dc2a7ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:25.497527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869108e5-3a31-462b-bc95-3024dc2a7ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:25.497803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869108e5-3a31-462b-bc95-3024dc2a7ad0 None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:25.498597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869108e5-3a31-462b-bc95-3024dc2a7ad0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:25.498979 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869108e5-3a31-462b-bc95-3024dc2a7ad0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:25.500427 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869108e5-3a31-462b-bc95-3024dc2a7ad0 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:25.508662 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 63/122] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:55:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:25.514568 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869108e5-3a31-462b-bc95-3024dc2a7ad0 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:25.539784 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:25.566349 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 60/123] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 23 07:55:25 2022] PUT /identity/v3/projects/dbd8608370894c55b5729ce6902c5722/users/f209424acda544bf9bd23d4759bc040d/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:55:25.568020 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a3afd-3870-4d90-969b-c8fcded2ba59 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:25.632250 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869108e5-3a31-462b-bc95-3024dc2a7ad0 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:25.676106 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c25e5c-d9e9-475d-98c7-58e056e6f1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:25.677027 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c25e5c-d9e9-475d-98c7-58e056e6f1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:25.677530 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c25e5c-d9e9-475d-98c7-58e056e6f1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:25.677915 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c25e5c-d9e9-475d-98c7-58e056e6f1f5 None admin] PATH_INFO: `/v3/projects/dbd8608370894c55b5729ce6902c5722` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:25.679346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c25e5c-d9e9-475d-98c7-58e056e6f1f5 None admin] RBAC: Authorizing `identity:get_project(project_id=dbd8608370894c55b5729ce6902c5722)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:25.681091 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c25e5c-d9e9-475d-98c7-58e056e6f1f5 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:25.684116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 64/124] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:25 2022] GET /identity/v3/projects/dbd8608370894c55b5729ce6902c5722 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:25.685801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c25e5c-d9e9-475d-98c7-58e056e6f1f5 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:25.701878 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:25.728132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a3afd-3870-4d90-969b-c8fcded2ba59 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:25.770338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc904314-2366-41ec-b4be-b1c1176d5dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:25.771332 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc904314-2366-41ec-b4be-b1c1176d5dbb None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:25.772294 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc904314-2366-41ec-b4be-b1c1176d5dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:25.772717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc904314-2366-41ec-b4be-b1c1176d5dbb None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:25.773800 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc904314-2366-41ec-b4be-b1c1176d5dbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:25.774273 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc904314-2366-41ec-b4be-b1c1176d5dbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:25.776770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc904314-2366-41ec-b4be-b1c1176d5dbb None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:25.790716 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 61/125] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:25.791813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc904314-2366-41ec-b4be-b1c1176d5dbb None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:25.805244 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:25.818220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c25e5c-d9e9-475d-98c7-58e056e6f1f5 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:25.866525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7e874-9a59-4aaf-ad91-b8d3b59f41c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:25.867422 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7e874-9a59-4aaf-ad91-b8d3b59f41c9 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:25.867710 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7e874-9a59-4aaf-ad91-b8d3b59f41c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:25.868408 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7e874-9a59-4aaf-ad91-b8d3b59f41c9 None admin] PATH_INFO: `/v3/users/f209424acda544bf9bd23d4759bc040d` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:25.869844 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7e874-9a59-4aaf-ad91-b8d3b59f41c9 None admin] RBAC: Authorizing `identity:get_user(user_id=f209424acda544bf9bd23d4759bc040d)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:25.872013 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7e874-9a59-4aaf-ad91-b8d3b59f41c9 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:25.874743 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 65/126] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:25 2022] GET /identity/v3/users/f209424acda544bf9bd23d4759bc040d => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:25.876061 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7e874-9a59-4aaf-ad91-b8d3b59f41c9 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:25.923490 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc904314-2366-41ec-b4be-b1c1176d5dbb None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:25.970492 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc27678-1759-4d9b-9bd0-bd115ba7798c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:25.971163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc27678-1759-4d9b-9bd0-bd115ba7798c None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:25.971448 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc27678-1759-4d9b-9bd0-bd115ba7798c None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:25.971725 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc27678-1759-4d9b-9bd0-bd115ba7798c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:25.987883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc27678-1759-4d9b-9bd0-bd115ba7798c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:25.994252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-fcc27678-1759-4d9b-9bd0-bd115ba7798c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:55:25.994252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:25.994252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:25.994252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:25.994252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:25.994252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:25.994252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:25.994252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:25.994252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:25.994252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:25.994252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:25.994252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:25.994252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:25.994252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:25.994252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:25.994252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:25.995256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:25.995256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:25.995256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:25.995256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:25.995256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:25.995256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:25.995256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:25.995256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:25.995256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:25.995256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:25.995256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:25.995256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:25.995256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:25.995256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:25.995256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:25.995256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:25.996012 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:25.996012 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:25.996012 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:25.996012 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:25.996012 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:25.996012 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:25.996012 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:25.996012 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:25.996012 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:25.996012 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:25.996012 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:55:25.996012 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:55:25.999157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 62/127] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:26.004204 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc27678-1759-4d9b-9bd0-bd115ba7798c None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:26.012294 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7e874-9a59-4aaf-ad91-b8d3b59f41c9 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:26.017235 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:26.049411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b89e9-a87a-4f06-8f25-c92c053c3381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:26.050396 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b89e9-a87a-4f06-8f25-c92c053c3381 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:26.050905 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b89e9-a87a-4f06-8f25-c92c053c3381 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:26.051463 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b89e9-a87a-4f06-8f25-c92c053c3381 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:26.052435 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b89e9-a87a-4f06-8f25-c92c053c3381 None admin] RBAC: Adding query filter params (role.id=530235f994134c70a0beaef3ed1b650c, scope.project.id=dbd8608370894c55b5729ce6902c5722, user.id=a9a504a7a9164cd2b64ee8ca16cf8af4) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:26.052910 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b89e9-a87a-4f06-8f25-c92c053c3381 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:26.054485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b89e9-a87a-4f06-8f25-c92c053c3381 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:26.061400 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 66/128] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:55:25 2022] GET /identity/v3/role_assignments?user.id=a9a504a7a9164cd2b64ee8ca16cf8af4&scope.project.id=dbd8608370894c55b5729ce6902c5722&role.id=530235f994134c70a0beaef3ed1b650c => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:26.062325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b89e9-a87a-4f06-8f25-c92c053c3381 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:26.090404 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:26.115248 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc27678-1759-4d9b-9bd0-bd115ba7798c None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:26.153155 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8b8bd-2a7c-4440-a7cf-0d8445b00bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:26.154207 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8b8bd-2a7c-4440-a7cf-0d8445b00bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:26.154725 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8b8bd-2a7c-4440-a7cf-0d8445b00bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:26.155382 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8b8bd-2a7c-4440-a7cf-0d8445b00bb7 None admin] PATH_INFO: `/v3/users/168687f5011542bc8d7ca334411c2990` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:26.156864 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8b8bd-2a7c-4440-a7cf-0d8445b00bb7 None admin] RBAC: Authorizing `identity:get_user(user_id=168687f5011542bc8d7ca334411c2990)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:26.158685 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8b8bd-2a7c-4440-a7cf-0d8445b00bb7 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:26.160814 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 63/129] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:26 2022] GET /identity/v3/users/168687f5011542bc8d7ca334411c2990 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:26.161895 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8b8bd-2a7c-4440-a7cf-0d8445b00bb7 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:26.175649 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b89e9-a87a-4f06-8f25-c92c053c3381 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:26.213462 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c78986-cc2c-42a0-8e9e-58f4648dd8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:26.214103 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c78986-cc2c-42a0-8e9e-58f4648dd8ef None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:26.214467 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c78986-cc2c-42a0-8e9e-58f4648dd8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:26.214748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c78986-cc2c-42a0-8e9e-58f4648dd8ef None admin] PATH_INFO: `/v3/projects/dbd8608370894c55b5729ce6902c5722` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:26.215886 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c78986-cc2c-42a0-8e9e-58f4648dd8ef None admin] RBAC: Authorizing `identity:get_project(project_id=dbd8608370894c55b5729ce6902c5722)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:26.222696 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c78986-cc2c-42a0-8e9e-58f4648dd8ef None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:26.222696 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 67/130] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:26 2022] GET /identity/v3/projects/dbd8608370894c55b5729ce6902c5722 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:26.222696 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c78986-cc2c-42a0-8e9e-58f4648dd8ef None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:26.326604 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:26.341745 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8b8bd-2a7c-4440-a7cf-0d8445b00bb7 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:26.346071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:26.356775 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c78986-cc2c-42a0-8e9e-58f4648dd8ef None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:26.381171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434158f-c620-4f71-957c-1603a8bbedcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:26.382169 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434158f-c620-4f71-957c-1603a8bbedcc None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:26.382812 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434158f-c620-4f71-957c-1603a8bbedcc None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:26.383326 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434158f-c620-4f71-957c-1603a8bbedcc None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:26.384192 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434158f-c620-4f71-957c-1603a8bbedcc None admin] RBAC: Adding query filter params (name=member) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:26.384714 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434158f-c620-4f71-957c-1603a8bbedcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:26.386326 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434158f-c620-4f71-957c-1603a8bbedcc None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:26.394858 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38a613-0603-4d2e-9453-b8560e556829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:26.396353 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38a613-0603-4d2e-9453-b8560e556829 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:26.396562 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 64/131] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 23 07:55:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:26.397471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434158f-c620-4f71-957c-1603a8bbedcc None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:26.398050 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38a613-0603-4d2e-9453-b8560e556829 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:26.402533 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38a613-0603-4d2e-9453-b8560e556829 None admin] PATH_INFO: `/v3/projects/dbd8608370894c55b5729ce6902c5722` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:26.404166 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38a613-0603-4d2e-9453-b8560e556829 None admin] RBAC: Authorizing `identity:get_project(project_id=dbd8608370894c55b5729ce6902c5722)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:26.406021 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38a613-0603-4d2e-9453-b8560e556829 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:26.407712 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 68/132] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:26 2022] GET /identity/v3/projects/dbd8608370894c55b5729ce6902c5722 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:26.408482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38a613-0603-4d2e-9453-b8560e556829 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:26.514768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38a613-0603-4d2e-9453-b8560e556829 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:26.549993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434158f-c620-4f71-957c-1603a8bbedcc None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:26.550492 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a150f-b236-41b9-83a1-b5e4f095916e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:26.551133 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a150f-b236-41b9-83a1-b5e4f095916e None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:26.551413 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a150f-b236-41b9-83a1-b5e4f095916e None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:26.551689 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a150f-b236-41b9-83a1-b5e4f095916e None admin] PATH_INFO: `/v3/users/f209424acda544bf9bd23d4759bc040d` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:26.552842 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a150f-b236-41b9-83a1-b5e4f095916e None admin] RBAC: Authorizing `identity:get_user(user_id=f209424acda544bf9bd23d4759bc040d)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:26.554393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a150f-b236-41b9-83a1-b5e4f095916e None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:26.556191 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 69/133] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:26 2022] GET /identity/v3/users/f209424acda544bf9bd23d4759bc040d => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:26.556714 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a150f-b236-41b9-83a1-b5e4f095916e None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:26.591084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:26.593938 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdf2e9-b4b4-4fc9-b24c-33f1337838c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:26.594862 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdf2e9-b4b4-4fc9-b24c-33f1337838c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:26.595465 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdf2e9-b4b4-4fc9-b24c-33f1337838c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:26.596218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdf2e9-b4b4-4fc9-b24c-33f1337838c1 None admin] PATH_INFO: `/v3/projects/dbd8608370894c55b5729ce6902c5722/users/f209424acda544bf9bd23d4759bc040d/roles/4e9a14889d764731b59323f764f1bb85` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:26.598957 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdf2e9-b4b4-4fc9-b24c-33f1337838c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbd8608370894c55b5729ce6902c5722, user_id=f209424acda544bf9bd23d4759bc040d, role_id=4e9a14889d764731b59323f764f1bb85)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:26.601595 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdf2e9-b4b4-4fc9-b24c-33f1337838c1 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:26.673659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a150f-b236-41b9-83a1-b5e4f095916e None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:26.708854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:26.713690 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0dcd0-e90b-49f3-816b-13313324e52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:26.714201 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 65/134] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 23 07:55:26 2022] PUT /identity/v3/projects/dbd8608370894c55b5729ce6902c5722/users/f209424acda544bf9bd23d4759bc040d/roles/4e9a14889d764731b59323f764f1bb85 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:55:26.714686 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0dcd0-e90b-49f3-816b-13313324e52a None admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:26.714973 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0dcd0-e90b-49f3-816b-13313324e52a None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:26.715309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0dcd0-e90b-49f3-816b-13313324e52a None admin] PATH_INFO: `/v3/projects/dbd8608370894c55b5729ce6902c5722/users/168687f5011542bc8d7ca334411c2990/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:26.717522 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3317020-f4ce-4e82-af82-6f692b95c0e0 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:26.717998 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0dcd0-e90b-49f3-816b-13313324e52a None admin] RBAC: Authorizing `identity:create_grant(project_id=dbd8608370894c55b5729ce6902c5722, user_id=168687f5011542bc8d7ca334411c2990, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:26.718306 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3317020-f4ce-4e82-af82-6f692b95c0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:26.721341 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3317020-f4ce-4e82-af82-6f692b95c0e0 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:26.721498 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0dcd0-e90b-49f3-816b-13313324e52a None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:26.721578 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 66/135] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:26.722711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3317020-f4ce-4e82-af82-6f692b95c0e0 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:26.817016 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 70/136] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 23 07:55:26 2022] PUT /identity/v3/projects/dbd8608370894c55b5729ce6902c5722/users/168687f5011542bc8d7ca334411c2990/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:55:26.818038 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcca28-69e5-4161-af2e-3f553c14fe98 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:26.818494 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcca28-69e5-4161-af2e-3f553c14fe98 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:26.818818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcca28-69e5-4161-af2e-3f553c14fe98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:26.857430 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3317020-f4ce-4e82-af82-6f692b95c0e0 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:26.859555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-c4bcca28-69e5-4161-af2e-3f553c14fe98 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:26.860802 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-c4bcca28-69e5-4161-af2e-3f553c14fe98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:26.900818 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8c50f-cd1e-4766-9a6f-79949ae972bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:26.901477 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8c50f-cd1e-4766-9a6f-79949ae972bf None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:26.901764 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8c50f-cd1e-4766-9a6f-79949ae972bf None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:26.902043 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8c50f-cd1e-4766-9a6f-79949ae972bf None admin] PATH_INFO: `/v3/projects/8506ab1b0abf4200b752dffbf2b058e9` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:26.903270 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8c50f-cd1e-4766-9a6f-79949ae972bf None admin] RBAC: Authorizing `identity:get_project(project_id=8506ab1b0abf4200b752dffbf2b058e9)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:26.905972 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8c50f-cd1e-4766-9a6f-79949ae972bf None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:26.907836 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 67/137] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:26 2022] GET /identity/v3/projects/8506ab1b0abf4200b752dffbf2b058e9 => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:26.914787 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8c50f-cd1e-4766-9a6f-79949ae972bf None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:26.993901 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 71/138] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:26.997165 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:27.035578 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8c50f-cd1e-4766-9a6f-79949ae972bf None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:27.071902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3391dbb-0500-4400-9184-e802d149e98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:27.072705 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3391dbb-0500-4400-9184-e802d149e98d None admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:27.072997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3391dbb-0500-4400-9184-e802d149e98d None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:27.073281 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3391dbb-0500-4400-9184-e802d149e98d None admin] PATH_INFO: `/v3/projects/8506ab1b0abf4200b752dffbf2b058e9/users/f209424acda544bf9bd23d4759bc040d/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:27.079678 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3391dbb-0500-4400-9184-e802d149e98d None admin] RBAC: Authorizing `identity:create_grant(project_id=8506ab1b0abf4200b752dffbf2b058e9, user_id=f209424acda544bf9bd23d4759bc040d, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:27.081163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3391dbb-0500-4400-9184-e802d149e98d None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:27.150821 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 68/139] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 23 07:55:26 2022] PUT /identity/v3/projects/8506ab1b0abf4200b752dffbf2b058e9/users/f209424acda544bf9bd23d4759bc040d/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 07:55:27.472022 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcca28-69e5-4161-af2e-3f553c14fe98 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:27.490964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:27.586562 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcca28-69e5-4161-af2e-3f553c14fe98 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:27.631631 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d561a86-f83d-4be9-adfe-a539139c9567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:27.632281 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d561a86-f83d-4be9-adfe-a539139c9567 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:27.632561 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d561a86-f83d-4be9-adfe-a539139c9567 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:27.632836 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d561a86-f83d-4be9-adfe-a539139c9567 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:27.633964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d561a86-f83d-4be9-adfe-a539139c9567 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:27.635547 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d561a86-f83d-4be9-adfe-a539139c9567 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:27.637138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 72/140] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:55:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:27.643252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3391dbb-0500-4400-9184-e802d149e98d None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:27.707142 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fca667-774a-4298-8815-7257edce30cc None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:27.707806 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fca667-774a-4298-8815-7257edce30cc None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:27.708295 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fca667-774a-4298-8815-7257edce30cc None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:27.709837 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 73/141] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:55:27.715267 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdb95c-1d79-4894-b25e-1ef4b6a55cde None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:27.715828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdb95c-1d79-4894-b25e-1ef4b6a55cde None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:27.716322 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdb95c-1d79-4894-b25e-1ef4b6a55cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:27.738007 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-a7bdb95c-1d79-4894-b25e-1ef4b6a55cde None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:27.740619 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a7bdb95c-1d79-4894-b25e-1ef4b6a55cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:27.797819 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3391dbb-0500-4400-9184-e802d149e98d None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:27.847461 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:27.859910 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14251ba0-a901-4c0f-be3f-e1cc464ab95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:27.860550 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14251ba0-a901-4c0f-be3f-e1cc464ab95e None admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:27.860836 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14251ba0-a901-4c0f-be3f-e1cc464ab95e None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:27.861117 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14251ba0-a901-4c0f-be3f-e1cc464ab95e None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:27.861770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14251ba0-a901-4c0f-be3f-e1cc464ab95e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:27.868269 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14251ba0-a901-4c0f-be3f-e1cc464ab95e None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:27.905486 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 74/142] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:27.953326 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 69/143] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 23 07:55:27 2022] POST /identity/v3/users => generated 283 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:55:28.323263 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdb95c-1d79-4894-b25e-1ef4b6a55cde None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:28.339405 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:28.437344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdb95c-1d79-4894-b25e-1ef4b6a55cde None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:28.473496 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc4726-de47-4c40-ac7a-548524f8f5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:28.474251 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc4726-de47-4c40-ac7a-548524f8f5de None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:28.474464 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc4726-de47-4c40-ac7a-548524f8f5de None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:28.474715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc4726-de47-4c40-ac7a-548524f8f5de None admin] PATH_INFO: `/v3/roles/member` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:28.495353 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc4726-de47-4c40-ac7a-548524f8f5de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:28.500659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-5efc4726-de47-4c40-ac7a-548524f8f5de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:55:28.500659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:28.500659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:28.500659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:28.500659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:28.500659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:28.500659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:28.500659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:28.500659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:28.500659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:28.500659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:28.500659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:28.500659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:28.500659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:28.500659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:28.500659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:28.501567 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:28.501567 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:28.501567 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:28.501567 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:28.501567 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:28.501567 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:28.501567 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:28.501567 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:28.501567 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:28.501567 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:28.501567 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:28.501567 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:28.501567 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:28.501567 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:28.501567 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:28.501567 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:28.502358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:28.502358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:28.502358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:28.502358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:28.502358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:28.502358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:28.502358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:28.502358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:28.502358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:28.502358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:28.502358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:55:28.502358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:55:28.502358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 75/144] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:28.511435 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14251ba0-a901-4c0f-be3f-e1cc464ab95e None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:28.638141 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14251ba0-a901-4c0f-be3f-e1cc464ab95e None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:28.677598 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d961d-e0e4-419e-a19d-fc2919ad669a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:28.678353 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d961d-e0e4-419e-a19d-fc2919ad669a None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:28.678554 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d961d-e0e4-419e-a19d-fc2919ad669a None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:28.678840 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d961d-e0e4-419e-a19d-fc2919ad669a None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:28.679516 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d961d-e0e4-419e-a19d-fc2919ad669a None admin] RBAC: Adding query filter params (name=member) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:28.679826 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d961d-e0e4-419e-a19d-fc2919ad669a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:28.681224 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d961d-e0e4-419e-a19d-fc2919ad669a None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:28.690566 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 70/145] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 23 07:55:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:28.699913 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc4726-de47-4c40-ac7a-548524f8f5de None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:28.807383 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:28.837461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc4726-de47-4c40-ac7a-548524f8f5de None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:28.878245 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b715b76-5c58-4a4e-930f-be81dbd07913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:28.878911 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b715b76-5c58-4a4e-930f-be81dbd07913 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:28.879183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b715b76-5c58-4a4e-930f-be81dbd07913 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:28.879455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b715b76-5c58-4a4e-930f-be81dbd07913 None admin] PATH_INFO: `/v3/users/f209424acda544bf9bd23d4759bc040d` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:28.882968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b715b76-5c58-4a4e-930f-be81dbd07913 None admin] RBAC: Authorizing `identity:get_user(user_id=f209424acda544bf9bd23d4759bc040d)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:28.884503 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b715b76-5c58-4a4e-930f-be81dbd07913 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:28.886330 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 76/146] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:28 2022] GET /identity/v3/users/f209424acda544bf9bd23d4759bc040d => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:28.892300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d961d-e0e4-419e-a19d-fc2919ad669a None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:28.962789 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:29.027686 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d961d-e0e4-419e-a19d-fc2919ad669a None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:29.068615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81860339-0336-4c08-b03a-2ce15b44b356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:29.069244 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81860339-0336-4c08-b03a-2ce15b44b356 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:29.069556 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81860339-0336-4c08-b03a-2ce15b44b356 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:29.069828 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81860339-0336-4c08-b03a-2ce15b44b356 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:29.150012 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81860339-0336-4c08-b03a-2ce15b44b356 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:29.151461 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81860339-0336-4c08-b03a-2ce15b44b356 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:29.204296 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:29.273473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 71/147] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:55:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:55:29.279496 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b715b76-5c58-4a4e-930f-be81dbd07913 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:29.398854 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b715b76-5c58-4a4e-930f-be81dbd07913 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:29.425714 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2419fb-038b-4a4a-8781-8323ca683b00 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:29.425986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2419fb-038b-4a4a-8781-8323ca683b00 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:29.426188 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2419fb-038b-4a4a-8781-8323ca683b00 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:29.427547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 72/148] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:55:29.443734 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c2847-50b4-43d9-9cb5-0da9c18bc61b None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:29.444014 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c2847-50b4-43d9-9cb5-0da9c18bc61b None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:29.444286 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c2847-50b4-43d9-9cb5-0da9c18bc61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:29.469449 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-eb1c2847-50b4-43d9-9cb5-0da9c18bc61b None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:29.470167 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c43403-670e-445d-93d2-a15e075bf805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:29.470747 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-eb1c2847-50b4-43d9-9cb5-0da9c18bc61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:29.471311 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c43403-670e-445d-93d2-a15e075bf805 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:29.471797 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c43403-670e-445d-93d2-a15e075bf805 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:29.472525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c43403-670e-445d-93d2-a15e075bf805 None admin] PATH_INFO: `/v3/projects/dbd8608370894c55b5729ce6902c5722` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:29.474247 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c43403-670e-445d-93d2-a15e075bf805 None admin] RBAC: Authorizing `identity:get_project(project_id=dbd8608370894c55b5729ce6902c5722)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:29.476403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c43403-670e-445d-93d2-a15e075bf805 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:29.478233 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 77/149] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:29 2022] GET /identity/v3/projects/dbd8608370894c55b5729ce6902c5722 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:29.490990 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c43403-670e-445d-93d2-a15e075bf805 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:29.512937 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:29.609834 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c43403-670e-445d-93d2-a15e075bf805 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:29.654470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1e618-2e37-475d-b62a-2807386fba1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:29.654470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1e618-2e37-475d-b62a-2807386fba1a None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:29.654470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1e618-2e37-475d-b62a-2807386fba1a None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:29.654470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1e618-2e37-475d-b62a-2807386fba1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:29.654807 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1e618-2e37-475d-b62a-2807386fba1a None admin] RBAC: Adding query filter params (role.id=4ed852223bc54be09a9487ff788b7644, scope.project.id=dbd8608370894c55b5729ce6902c5722, user.id=f209424acda544bf9bd23d4759bc040d) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:29.654807 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1e618-2e37-475d-b62a-2807386fba1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:29.656289 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1e618-2e37-475d-b62a-2807386fba1a None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:29.666344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 78/150] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:55:29 2022] GET /identity/v3/role_assignments?user.id=f209424acda544bf9bd23d4759bc040d&scope.project.id=dbd8608370894c55b5729ce6902c5722&role.id=4ed852223bc54be09a9487ff788b7644 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:55:29.666344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f349b7-dafa-4646-b5bd-acfac8e40f5d None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:29.666344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f349b7-dafa-4646-b5bd-acfac8e40f5d None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:29.666344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f349b7-dafa-4646-b5bd-acfac8e40f5d None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:29.668929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 79/151] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:29.675472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60109284-2a01-4e6d-b0f9-5b27492004de None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:29.675826 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60109284-2a01-4e6d-b0f9-5b27492004de None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:29.676244 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60109284-2a01-4e6d-b0f9-5b27492004de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:29.676360 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 73/152] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:55:29.697080 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-60109284-2a01-4e6d-b0f9-5b27492004de None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:29.698373 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-60109284-2a01-4e6d-b0f9-5b27492004de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:29.773981 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 80/153] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:55:29.858597 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d402a64-d16a-4496-a5fa-c5015336d1eb None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:29.859127 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d402a64-d16a-4496-a5fa-c5015336d1eb None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:29.859127 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d402a64-d16a-4496-a5fa-c5015336d1eb None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:29.860519 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 74/154] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:29.866578 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f60b4-909c-419e-92c3-edca9cb8e132 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:29.866876 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f60b4-909c-419e-92c3-edca9cb8e132 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:29.867148 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f60b4-909c-419e-92c3-edca9cb8e132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:29.877292 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:29.894545 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-6c0f60b4-909c-419e-92c3-edca9cb8e132 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:29.895762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-6c0f60b4-909c-419e-92c3-edca9cb8e132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:29.968831 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 81/155] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:30.161967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d402a64-d16a-4496-a5fa-c5015336d1eb None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:30.257250 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f60b4-909c-419e-92c3-edca9cb8e132 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:30.265388 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:30.310996 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d402a64-d16a-4496-a5fa-c5015336d1eb None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:30.372216 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96099e6f-cf40-42e4-9efc-7c3973ce5066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:30.373756 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96099e6f-cf40-42e4-9efc-7c3973ce5066 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:30.373756 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96099e6f-cf40-42e4-9efc-7c3973ce5066 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:30.373756 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96099e6f-cf40-42e4-9efc-7c3973ce5066 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:30.408772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96099e6f-cf40-42e4-9efc-7c3973ce5066 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:30.422089 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-96099e6f-cf40-42e4-9efc-7c3973ce5066 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:55:30.422089 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:30.422089 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:30.422089 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:30.422089 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:30.422089 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:30.422089 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:30.422089 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:30.422089 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:30.422089 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:30.422089 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:30.422089 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:30.422089 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:30.422089 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:30.422089 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:30.422089 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:30.423017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:30.423017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:30.423017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:30.423017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:30.423017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:30.423017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:30.423017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:30.423017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:30.423017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:30.423017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:30.423017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:30.423017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:30.423017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:30.423017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:30.423017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:30.423017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:30.424205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:30.424205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:30.424205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:30.424205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:30.424205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:30.424205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:30.424205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:30.424205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:30.424205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:30.424205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:30.424205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:55:30.424205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:55:30.424205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 75/156] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:55:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:30.425028 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb6879-dcf2-4c9f-9e3f-a8c8272a3ca4 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:30.425028 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb6879-dcf2-4c9f-9e3f-a8c8272a3ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:30.425028 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb6879-dcf2-4c9f-9e3f-a8c8272a3ca4 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:30.431546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 76/157] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:30.432600 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb6879-dcf2-4c9f-9e3f-a8c8272a3ca4 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:30.512311 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f60b4-909c-419e-92c3-edca9cb8e132 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:30.560018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb6879-dcf2-4c9f-9e3f-a8c8272a3ca4 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:30.579203 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c414c-771f-4049-bc2a-4e7bd4951428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:30.580171 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c414c-771f-4049-bc2a-4e7bd4951428 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:30.581342 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c414c-771f-4049-bc2a-4e7bd4951428 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:30.582419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c414c-771f-4049-bc2a-4e7bd4951428 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:30.587059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:30.604980 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c414c-771f-4049-bc2a-4e7bd4951428 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:30.613326 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-bb1c414c-771f-4049-bc2a-4e7bd4951428 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:55:30.613326 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:30.613326 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:30.613326 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:30.613326 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:30.613326 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:30.613326 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:30.613326 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:30.613326 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:30.613326 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:30.613326 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:30.613326 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:30.613326 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:30.613326 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:30.613326 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:30.613326 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:30.614199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:30.614199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:30.614199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:30.614199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:30.614199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:30.614199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:30.614199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:30.614199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:30.614199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:30.614199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:30.614199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:30.614199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:30.614199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:30.614199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:30.614199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:30.614199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:30.615064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:30.615064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:30.615064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:30.615064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:30.615064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:30.615064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:30.615064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:30.615064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:30.615064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:30.615064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:30.615064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:55:30.615064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:55:30.615064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 82/158] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:55:30.616193 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c414c-771f-4049-bc2a-4e7bd4951428 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:30.634865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa848dff-7cbd-4098-ac80-82eb7c719e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:30.635507 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa848dff-7cbd-4098-ac80-82eb7c719e4c None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:30.635814 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa848dff-7cbd-4098-ac80-82eb7c719e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:30.636101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa848dff-7cbd-4098-ac80-82eb7c719e4c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:30.642372 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:30.671281 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa848dff-7cbd-4098-ac80-82eb7c719e4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:30.676097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-fa848dff-7cbd-4098-ac80-82eb7c719e4c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:55:30.676097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:30.676097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:30.676097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:30.676097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:30.676097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:30.676097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:30.676097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:30.676097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:30.676097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:30.676097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:30.676097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:30.676097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:30.676097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:30.676097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:30.676097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:30.676998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:30.676998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:30.676998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:30.676998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:30.676998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:30.676998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:30.676998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:30.676998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:30.676998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:30.676998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:30.676998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:30.676998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:30.676998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:30.676998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:30.676998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:30.676998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:30.677760 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:30.677760 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:30.677760 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:30.677760 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:30.677760 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:30.677760 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:30.677760 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:30.677760 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:30.677760 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:30.677760 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:30.677760 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:55:30.677760 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:55:30.677760 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 77/159] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 23 07:55:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:30.679342 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa99b8a-30d1-4f7c-bfc0-8626f28cad45 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:30.679630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa99b8a-30d1-4f7c-bfc0-8626f28cad45 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:30.679906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa99b8a-30d1-4f7c-bfc0-8626f28cad45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:30.722199 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-cfa99b8a-30d1-4f7c-bfc0-8626f28cad45 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:30.723431 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-cfa99b8a-30d1-4f7c-bfc0-8626f28cad45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:30.785506 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c414c-771f-4049-bc2a-4e7bd4951428 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:30.833661 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 78/160] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:30.839419 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa99b8a-30d1-4f7c-bfc0-8626f28cad45 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:30.870985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95623bc1-32f6-4600-af99-51a000ea3af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:30.871603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95623bc1-32f6-4600-af99-51a000ea3af7 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:30.871883 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95623bc1-32f6-4600-af99-51a000ea3af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:30.872159 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95623bc1-32f6-4600-af99-51a000ea3af7 None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:30.872932 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95623bc1-32f6-4600-af99-51a000ea3af7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:30.873237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95623bc1-32f6-4600-af99-51a000ea3af7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:30.874655 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95623bc1-32f6-4600-af99-51a000ea3af7 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:30.892382 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 83/161] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:30.893225 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95623bc1-32f6-4600-af99-51a000ea3af7 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:30.978089 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:31.047601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa99b8a-30d1-4f7c-bfc0-8626f28cad45 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:31.051974 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95623bc1-32f6-4600-af99-51a000ea3af7 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:31.120811 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b017822-015a-46d6-822d-5c4d27fa0591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:31.121436 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b017822-015a-46d6-822d-5c4d27fa0591 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:31.121714 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b017822-015a-46d6-822d-5c4d27fa0591 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:31.121987 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b017822-015a-46d6-822d-5c4d27fa0591 None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:31.122789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b017822-015a-46d6-822d-5c4d27fa0591 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:31.123595 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b017822-015a-46d6-822d-5c4d27fa0591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:31.124985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b017822-015a-46d6-822d-5c4d27fa0591 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:31.140891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 84/162] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:55:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:31.141225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:31.141750 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b017822-015a-46d6-822d-5c4d27fa0591 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:31.164179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3586bc-86c1-453b-9965-c75eab6b5830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:31.164803 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3586bc-86c1-453b-9965-c75eab6b5830 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:31.165083 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3586bc-86c1-453b-9965-c75eab6b5830 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:31.165357 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3586bc-86c1-453b-9965-c75eab6b5830 None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:31.166041 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3586bc-86c1-453b-9965-c75eab6b5830 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:31.166369 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3586bc-86c1-453b-9965-c75eab6b5830 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:31.167841 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3586bc-86c1-453b-9965-c75eab6b5830 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:31.187670 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 79/163] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 23 07:55:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:31.188523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3586bc-86c1-453b-9965-c75eab6b5830 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:31.318344 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3586bc-86c1-453b-9965-c75eab6b5830 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:31.353876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34736770-383e-4d80-a562-0a120999eef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:31.354554 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34736770-383e-4d80-a562-0a120999eef8 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:31.354832 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34736770-383e-4d80-a562-0a120999eef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:31.355103 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34736770-383e-4d80-a562-0a120999eef8 None admin] PATH_INFO: `/v3/users/f209424acda544bf9bd23d4759bc040d` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:31.356237 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34736770-383e-4d80-a562-0a120999eef8 None admin] RBAC: Authorizing `identity:get_user(user_id=f209424acda544bf9bd23d4759bc040d)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:31.357803 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34736770-383e-4d80-a562-0a120999eef8 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:31.359434 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 80/164] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:31 2022] GET /identity/v3/users/f209424acda544bf9bd23d4759bc040d => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:31.360203 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34736770-383e-4d80-a562-0a120999eef8 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:31.362521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b017822-015a-46d6-822d-5c4d27fa0591 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:31.396928 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:31.413891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8313697-787a-4c1a-979a-5c383642a26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:31.416753 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8313697-787a-4c1a-979a-5c383642a26a None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:31.417031 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8313697-787a-4c1a-979a-5c383642a26a None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:31.417303 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8313697-787a-4c1a-979a-5c383642a26a None admin] PATH_INFO: `/v3/users/168687f5011542bc8d7ca334411c2990` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:31.419159 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8313697-787a-4c1a-979a-5c383642a26a None admin] RBAC: Authorizing `identity:get_user(user_id=168687f5011542bc8d7ca334411c2990)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:31.420935 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8313697-787a-4c1a-979a-5c383642a26a None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:31.422566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 85/165] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:31 2022] GET /identity/v3/users/168687f5011542bc8d7ca334411c2990 => generated 247 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:31.423358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8313697-787a-4c1a-979a-5c383642a26a None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:31.434742 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:31.501204 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34736770-383e-4d80-a562-0a120999eef8 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:31.548270 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10db12-717a-499e-bd03-57f9d19602ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:31.549000 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10db12-717a-499e-bd03-57f9d19602ba None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:31.549287 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10db12-717a-499e-bd03-57f9d19602ba None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:31.549560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10db12-717a-499e-bd03-57f9d19602ba None admin] PATH_INFO: `/v3/users/a9a504a7a9164cd2b64ee8ca16cf8af4` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:31.550835 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10db12-717a-499e-bd03-57f9d19602ba None admin] RBAC: Authorizing `identity:get_user(user_id=a9a504a7a9164cd2b64ee8ca16cf8af4)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:31.552293 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10db12-717a-499e-bd03-57f9d19602ba None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:31.554075 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 81/166] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:31 2022] GET /identity/v3/users/a9a504a7a9164cd2b64ee8ca16cf8af4 => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:31.554639 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10db12-717a-499e-bd03-57f9d19602ba None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:31.581925 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8313697-787a-4c1a-979a-5c383642a26a None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:31.616017 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5148005-be33-4ff0-8a04-8c06a01b7ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:31.616653 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5148005-be33-4ff0-8a04-8c06a01b7ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:31.616938 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5148005-be33-4ff0-8a04-8c06a01b7ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:31.617217 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5148005-be33-4ff0-8a04-8c06a01b7ee5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:31.628662 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5148005-be33-4ff0-8a04-8c06a01b7ee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:31.634265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-b5148005-be33-4ff0-8a04-8c06a01b7ee5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:55:31.634265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:31.634265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:31.634265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:31.634265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:31.634265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:31.634265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:31.634265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:31.634265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:31.634265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:31.634265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:31.634265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:31.634265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:31.634265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:31.634265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:31.634265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:31.635155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:31.635155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:31.635155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:31.635155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:31.635155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:31.635155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:31.635155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:31.635155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:31.635155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:31.635155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:31.635155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:31.635155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:31.635155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:31.635155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:31.635155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:31.635155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:31.636510 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:31.636510 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:31.636510 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:31.636510 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:31.636510 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:31.636510 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:31.636510 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:31.636510 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:31.636510 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:31.636510 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:31.636510 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:55:31.636510 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:55:31.636510 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 86/167] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:31.637246 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5148005-be33-4ff0-8a04-8c06a01b7ee5 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:31.665367 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10db12-717a-499e-bd03-57f9d19602ba None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:31.687279 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:31.691364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:31.703327 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df43c6-5358-42d6-8ce9-2bd3cec0a464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:31.704108 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df43c6-5358-42d6-8ce9-2bd3cec0a464 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:31.704554 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df43c6-5358-42d6-8ce9-2bd3cec0a464 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:31.704979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df43c6-5358-42d6-8ce9-2bd3cec0a464 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:31.744832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5148005-be33-4ff0-8a04-8c06a01b7ee5 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:31.781666 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df43c6-5358-42d6-8ce9-2bd3cec0a464 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:31.783440 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df43c6-5358-42d6-8ce9-2bd3cec0a464 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:31.788654 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870f057-1f69-41c0-add6-649379bc604a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:31.789536 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870f057-1f69-41c0-add6-649379bc604a None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:31.790023 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870f057-1f69-41c0-add6-649379bc604a None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:31.790527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870f057-1f69-41c0-add6-649379bc604a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:31.866833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870f057-1f69-41c0-add6-649379bc604a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:31.868911 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870f057-1f69-41c0-add6-649379bc604a None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:31.888520 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 82/168] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:55:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:55:31.890037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbe8db-208b-4000-ae44-aee4f76401d9 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:31.890340 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbe8db-208b-4000-ae44-aee4f76401d9 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:31.890620 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbe8db-208b-4000-ae44-aee4f76401d9 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:31.896072 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 83/169] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:31.896072 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbe8db-208b-4000-ae44-aee4f76401d9 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:31.920076 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:31.925734 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:31.991258 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 87/170] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:55:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:55:31.991258 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870f057-1f69-41c0-add6-649379bc604a None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:32.007647 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbe8db-208b-4000-ae44-aee4f76401d9 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:32.045162 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85439ac9-8424-4f82-9317-2efb763ede33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:32.046254 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85439ac9-8424-4f82-9317-2efb763ede33 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:32.046734 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85439ac9-8424-4f82-9317-2efb763ede33 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:32.047175 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85439ac9-8424-4f82-9317-2efb763ede33 None admin] PATH_INFO: `/v3/projects/dbd8608370894c55b5729ce6902c5722` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:32.048510 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85439ac9-8424-4f82-9317-2efb763ede33 None admin] RBAC: Authorizing `identity:get_project(project_id=dbd8608370894c55b5729ce6902c5722)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:32.050821 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85439ac9-8424-4f82-9317-2efb763ede33 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:32.052843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 84/171] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:31 2022] GET /identity/v3/projects/dbd8608370894c55b5729ce6902c5722 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:32.053861 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85439ac9-8424-4f82-9317-2efb763ede33 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:32.097851 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870f057-1f69-41c0-add6-649379bc604a None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:32.135098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1becd0a1-577e-44e5-b1e0-bbb51109bd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:32.135630 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becd0a1-577e-44e5-b1e0-bbb51109bd82 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:32.135915 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becd0a1-577e-44e5-b1e0-bbb51109bd82 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:32.136193 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becd0a1-577e-44e5-b1e0-bbb51109bd82 None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:32.137101 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1becd0a1-577e-44e5-b1e0-bbb51109bd82 None admin] RBAC: Adding query filter params (name=member) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:32.137293 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1becd0a1-577e-44e5-b1e0-bbb51109bd82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:32.139004 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1becd0a1-577e-44e5-b1e0-bbb51109bd82 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:32.148369 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 88/172] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 23 07:55:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:32.152913 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe6953-791f-4662-8fbe-9b1d1f530119 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:32.152913 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe6953-791f-4662-8fbe-9b1d1f530119 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:32.152913 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe6953-791f-4662-8fbe-9b1d1f530119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:32.160707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:32.169647 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85439ac9-8424-4f82-9317-2efb763ede33 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:32.170719 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-43fe6953-791f-4662-8fbe-9b1d1f530119 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:32.172071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-43fe6953-791f-4662-8fbe-9b1d1f530119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:32.174759 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:32.207670 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d2060-d759-4e63-b2cb-b536c67c93a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:32.208406 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d2060-d759-4e63-b2cb-b536c67c93a9 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:32.208687 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d2060-d759-4e63-b2cb-b536c67c93a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:32.208959 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d2060-d759-4e63-b2cb-b536c67c93a9 None admin] PATH_INFO: `/v3/projects/dbd8608370894c55b5729ce6902c5722` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:32.210106 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d2060-d759-4e63-b2cb-b536c67c93a9 None admin] RBAC: Authorizing `identity:get_project(project_id=dbd8608370894c55b5729ce6902c5722)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:32.212600 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d2060-d759-4e63-b2cb-b536c67c93a9 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:32.214667 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 85/173] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:32 2022] GET /identity/v3/projects/dbd8608370894c55b5729ce6902c5722 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:32.215619 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d2060-d759-4e63-b2cb-b536c67c93a9 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:32.248871 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 89/174] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:32.255527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe6953-791f-4662-8fbe-9b1d1f530119 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:32.371814 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d2060-d759-4e63-b2cb-b536c67c93a9 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:32.414986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10636de-ffac-4f96-b891-868394e4e675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:32.415534 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10636de-ffac-4f96-b891-868394e4e675 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:32.415701 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe6953-791f-4662-8fbe-9b1d1f530119 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:32.415814 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10636de-ffac-4f96-b891-868394e4e675 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:32.416069 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10636de-ffac-4f96-b891-868394e4e675 None admin] PATH_INFO: `/v3/projects/dbd8608370894c55b5729ce6902c5722` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:32.417289 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10636de-ffac-4f96-b891-868394e4e675 None admin] RBAC: Authorizing `identity:get_project(project_id=dbd8608370894c55b5729ce6902c5722)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:32.418863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10636de-ffac-4f96-b891-868394e4e675 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:32.420856 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 86/175] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:32 2022] GET /identity/v3/projects/dbd8608370894c55b5729ce6902c5722 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:32.422031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10636de-ffac-4f96-b891-868394e4e675 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:32.451876 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf560c-1d7d-4905-a061-1c7901221187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:32.452076 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:32.452542 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf560c-1d7d-4905-a061-1c7901221187 None admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:32.452818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf560c-1d7d-4905-a061-1c7901221187 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:32.453095 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf560c-1d7d-4905-a061-1c7901221187 None admin] PATH_INFO: `/v3/projects/dbd8608370894c55b5729ce6902c5722/users/a9a504a7a9164cd2b64ee8ca16cf8af4/roles/530235f994134c70a0beaef3ed1b650c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:32.455036 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf560c-1d7d-4905-a061-1c7901221187 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbd8608370894c55b5729ce6902c5722, user_id=a9a504a7a9164cd2b64ee8ca16cf8af4, role_id=530235f994134c70a0beaef3ed1b650c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:32.456468 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf560c-1d7d-4905-a061-1c7901221187 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:32.523620 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10636de-ffac-4f96-b891-868394e4e675 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:32.539414 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:32.545274 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 90/176] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 23 07:55:32 2022] PUT /identity/v3/projects/dbd8608370894c55b5729ce6902c5722/users/a9a504a7a9164cd2b64ee8ca16cf8af4/roles/530235f994134c70a0beaef3ed1b650c => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:55:32.555793 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf560c-1d7d-4905-a061-1c7901221187 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:32.557554 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6effa-725b-4805-9190-438b87ce59b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:32.558202 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6effa-725b-4805-9190-438b87ce59b9 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:32.558510 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6effa-725b-4805-9190-438b87ce59b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:32.558785 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6effa-725b-4805-9190-438b87ce59b9 None admin] PATH_INFO: `/v3/users/f209424acda544bf9bd23d4759bc040d` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:32.559955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6effa-725b-4805-9190-438b87ce59b9 None admin] RBAC: Authorizing `identity:get_user(user_id=f209424acda544bf9bd23d4759bc040d)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:32.561609 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6effa-725b-4805-9190-438b87ce59b9 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:32.563536 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 87/177] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:32 2022] GET /identity/v3/users/f209424acda544bf9bd23d4759bc040d => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:32.564571 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a97e98-c4fc-462f-830a-a7f64f9d18d2 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:32.564851 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a97e98-c4fc-462f-830a-a7f64f9d18d2 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:32.565123 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a97e98-c4fc-462f-830a-a7f64f9d18d2 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:32.566456 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 88/178] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:32.567329 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a405e5-d60a-40dc-b3c7-1d64a6d3192f None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:32.567604 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a405e5-d60a-40dc-b3c7-1d64a6d3192f None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:32.567872 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a405e5-d60a-40dc-b3c7-1d64a6d3192f None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:32.569208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 89/179] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:32.569718 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a405e5-d60a-40dc-b3c7-1d64a6d3192f None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:32.680334 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:32.689167 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a405e5-d60a-40dc-b3c7-1d64a6d3192f None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:32.691561 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf560c-1d7d-4905-a061-1c7901221187 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:32.731434 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4f1f9-7718-4a65-9c7f-4b9ee6798271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:32.733001 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4f1f9-7718-4a65-9c7f-4b9ee6798271 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:32.733420 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4f1f9-7718-4a65-9c7f-4b9ee6798271 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:32.733820 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4f1f9-7718-4a65-9c7f-4b9ee6798271 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:32.734986 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4f1f9-7718-4a65-9c7f-4b9ee6798271 None admin] RBAC: Adding query filter params (role.id=4e9a14889d764731b59323f764f1bb85, scope.project.id=dbd8608370894c55b5729ce6902c5722, user.id=f209424acda544bf9bd23d4759bc040d) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:32.735452 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4f1f9-7718-4a65-9c7f-4b9ee6798271 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:32.737678 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4f1f9-7718-4a65-9c7f-4b9ee6798271 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:32.738523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135dca6-77b0-431b-87a1-da10e5b1be9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:32.739124 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135dca6-77b0-431b-87a1-da10e5b1be9b None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:32.739403 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135dca6-77b0-431b-87a1-da10e5b1be9b None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:32.739671 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135dca6-77b0-431b-87a1-da10e5b1be9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:32.740391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135dca6-77b0-431b-87a1-da10e5b1be9b None admin] RBAC: Adding query filter params (role.id=e905040849d04aadbb8da8b0d216c92c, scope.project.id=dbd8608370894c55b5729ce6902c5722, user.id=168687f5011542bc8d7ca334411c2990) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:32.740691 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135dca6-77b0-431b-87a1-da10e5b1be9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:32.742105 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135dca6-77b0-431b-87a1-da10e5b1be9b None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:32.746584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 91/180] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:55:32 2022] GET /identity/v3/role_assignments?user.id=f209424acda544bf9bd23d4759bc040d&scope.project.id=dbd8608370894c55b5729ce6902c5722&role.id=4e9a14889d764731b59323f764f1bb85 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:32.751935 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 90/181] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:55:32 2022] GET /identity/v3/role_assignments?user.id=168687f5011542bc8d7ca334411c2990&scope.project.id=dbd8608370894c55b5729ce6902c5722&role.id=e905040849d04aadbb8da8b0d216c92c => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:32.751935 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135dca6-77b0-431b-87a1-da10e5b1be9b None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:32.752158 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4f1f9-7718-4a65-9c7f-4b9ee6798271 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:32.902665 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:32.959638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4f1f9-7718-4a65-9c7f-4b9ee6798271 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:32.962058 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135dca6-77b0-431b-87a1-da10e5b1be9b None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:33.003076 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fae7c7-bbb6-4f1b-b0c0-2b30a06b77aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:33.003983 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fae7c7-bbb6-4f1b-b0c0-2b30a06b77aa None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:33.004419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fae7c7-bbb6-4f1b-b0c0-2b30a06b77aa None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:33.004855 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fae7c7-bbb6-4f1b-b0c0-2b30a06b77aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:33.008331 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236808e3-1939-433c-bef7-73bb0a655819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:33.009026 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236808e3-1939-433c-bef7-73bb0a655819 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:33.009374 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236808e3-1939-433c-bef7-73bb0a655819 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:33.009715 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236808e3-1939-433c-bef7-73bb0a655819 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:33.017623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fae7c7-bbb6-4f1b-b0c0-2b30a06b77aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:33.023354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-49fae7c7-bbb6-4f1b-b0c0-2b30a06b77aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:55:33.023354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:33.023354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:33.023354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:33.023354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:33.023354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:33.023354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:33.023354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:33.023354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:33.023354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:33.023354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:33.023354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:33.023354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:33.023354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:33.023354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:33.023354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:33.024499 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:33.024499 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:33.024499 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:33.024499 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:33.024499 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:33.024499 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:33.024499 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:33.024499 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:33.024499 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:33.024499 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:33.024499 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:33.024499 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:33.024499 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:33.024499 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:33.024499 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:33.024499 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:33.025511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:33.025511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:33.025511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:33.025511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:33.025511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:33.025511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:33.025511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:33.025511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:33.025511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:33.025511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:33.025511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:55:33.025511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:55:33.029593 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 92/182] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:55:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:33.031152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddc745-eca3-4613-bff6-575b7efd0a98 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:33.031610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddc745-eca3-4613-bff6-575b7efd0a98 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:33.032161 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddc745-eca3-4613-bff6-575b7efd0a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:33.047391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:33.054568 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-81ddc745-eca3-4613-bff6-575b7efd0a98 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:33.055820 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-81ddc745-eca3-4613-bff6-575b7efd0a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:33.110553 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236808e3-1939-433c-bef7-73bb0a655819 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:33.112708 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236808e3-1939-433c-bef7-73bb0a655819 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:33.155037 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 93/183] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:33.155733 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b1862-f85b-4064-9020-fbca9189f658 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:33.155733 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b1862-f85b-4064-9020-fbca9189f658 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:33.156056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b1862-f85b-4064-9020-fbca9189f658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:33.175449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-ac1b1862-f85b-4064-9020-fbca9189f658 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:33.176667 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-ac1b1862-f85b-4064-9020-fbca9189f658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:33.233385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:33.248098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 91/184] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:55:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:55:33.254509 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236808e3-1939-433c-bef7-73bb0a655819 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:33.279719 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 94/185] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:33.280856 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b1862-f85b-4064-9020-fbca9189f658 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:33.366555 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:33.405843 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b1862-f85b-4064-9020-fbca9189f658 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:33.444949 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c0827-6313-4c13-ab27-81041714f32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:33.446210 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c0827-6313-4c13-ab27-81041714f32b None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:33.446807 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c0827-6313-4c13-ab27-81041714f32b None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:33.447295 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c0827-6313-4c13-ab27-81041714f32b None admin] PATH_INFO: `/v3/projects/8506ab1b0abf4200b752dffbf2b058e9` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:33.449471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236808e3-1939-433c-bef7-73bb0a655819 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:33.457696 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c0827-6313-4c13-ab27-81041714f32b None admin] RBAC: Authorizing `identity:get_project(project_id=8506ab1b0abf4200b752dffbf2b058e9)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:33.459644 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c0827-6313-4c13-ab27-81041714f32b None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:33.465905 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 95/186] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:33 2022] GET /identity/v3/projects/8506ab1b0abf4200b752dffbf2b058e9 => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:33.474484 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c0827-6313-4c13-ab27-81041714f32b None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:33.510115 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff61b6-b7f3-45d3-b0b5-c5b5ffe1b28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:33.510685 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff61b6-b7f3-45d3-b0b5-c5b5ffe1b28d None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:33.511000 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff61b6-b7f3-45d3-b0b5-c5b5ffe1b28d None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:33.511277 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff61b6-b7f3-45d3-b0b5-c5b5ffe1b28d None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:33.511938 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff61b6-b7f3-45d3-b0b5-c5b5ffe1b28d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:33.512308 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff61b6-b7f3-45d3-b0b5-c5b5ffe1b28d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:33.514491 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff61b6-b7f3-45d3-b0b5-c5b5ffe1b28d None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:33.523079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 92/187] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:33.523732 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff61b6-b7f3-45d3-b0b5-c5b5ffe1b28d None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:33.567950 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:33.657251 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c0827-6313-4c13-ab27-81041714f32b None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:33.707866 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6eed46-448a-4a78-9ac2-2ee899711d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:33.708522 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eed46-448a-4a78-9ac2-2ee899711d0d None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:33.709346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eed46-448a-4a78-9ac2-2ee899711d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:33.709622 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eed46-448a-4a78-9ac2-2ee899711d0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:33.710419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6eed46-448a-4a78-9ac2-2ee899711d0d None admin] RBAC: Adding query filter params (role.id=4ed852223bc54be09a9487ff788b7644, scope.project.id=8506ab1b0abf4200b752dffbf2b058e9, user.id=f209424acda544bf9bd23d4759bc040d) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:33.710731 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6eed46-448a-4a78-9ac2-2ee899711d0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:33.713188 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6eed46-448a-4a78-9ac2-2ee899711d0d None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:33.720174 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 96/188] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:55:33 2022] GET /identity/v3/role_assignments?user.id=f209424acda544bf9bd23d4759bc040d&scope.project.id=8506ab1b0abf4200b752dffbf2b058e9&role.id=4ed852223bc54be09a9487ff788b7644 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:33.727429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6eed46-448a-4a78-9ac2-2ee899711d0d None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:33.748639 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff61b6-b7f3-45d3-b0b5-c5b5ffe1b28d None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:33.777313 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:33.789601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6807aef-d5ea-4596-b077-08bba3da2447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:33.797902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6807aef-d5ea-4596-b077-08bba3da2447 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:33.797902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6807aef-d5ea-4596-b077-08bba3da2447 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:33.797902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6807aef-d5ea-4596-b077-08bba3da2447 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:33.797902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6807aef-d5ea-4596-b077-08bba3da2447 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:33.797902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6807aef-d5ea-4596-b077-08bba3da2447 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:33.797902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 93/189] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:55:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:33.801527 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6807aef-d5ea-4596-b077-08bba3da2447 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:33.937856 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6eed46-448a-4a78-9ac2-2ee899711d0d None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:33.957087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6807aef-d5ea-4596-b077-08bba3da2447 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:33.958785 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:33.987501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7cccc-afc1-4df5-83ea-ab90eff39a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:33.988890 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7cccc-afc1-4df5-83ea-ab90eff39a27 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:33.988890 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7cccc-afc1-4df5-83ea-ab90eff39a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:33.988890 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7cccc-afc1-4df5-83ea-ab90eff39a27 None admin] PATH_INFO: `/v3/users/c7b77563f929411d9e5508e076f5a1e9` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:34.005252 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7cccc-afc1-4df5-83ea-ab90eff39a27 None admin] RBAC: Authorizing `identity:get_user(user_id=c7b77563f929411d9e5508e076f5a1e9)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:34.006863 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7cccc-afc1-4df5-83ea-ab90eff39a27 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:34.007061 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c1428-200f-4754-aa4f-22f3eb6a48ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:34.007692 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c1428-200f-4754-aa4f-22f3eb6a48ce None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:34.007974 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c1428-200f-4754-aa4f-22f3eb6a48ce None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:34.008246 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c1428-200f-4754-aa4f-22f3eb6a48ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:34.008545 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 97/190] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:33 2022] GET /identity/v3/users/c7b77563f929411d9e5508e076f5a1e9 => generated 283 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:34.014857 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7cccc-afc1-4df5-83ea-ab90eff39a27 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:34.020063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c1428-200f-4754-aa4f-22f3eb6a48ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:34.025524 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-454c1428-200f-4754-aa4f-22f3eb6a48ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:55:34.025524 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:34.025524 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:34.025524 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:34.025524 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:34.025524 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:34.025524 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:34.025524 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:34.025524 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:34.025524 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:34.025524 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:34.025524 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:34.025524 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:34.025524 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:34.025524 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:34.025524 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:34.026585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:34.026585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:34.026585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:34.026585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:34.026585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:34.026585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:34.026585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:34.026585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:34.026585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:34.026585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:34.026585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:34.026585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:34.026585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:34.026585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:34.026585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:34.026585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:34.027416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:34.027416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:34.027416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:34.027416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:34.027416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:34.027416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:34.027416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:34.027416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:34.027416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:34.027416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:34.027416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:55:34.027416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:55:34.027416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 94/191] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 23 07:55:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:34.027416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c1428-200f-4754-aa4f-22f3eb6a48ce None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:34.083569 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:34.123197 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7cccc-afc1-4df5-83ea-ab90eff39a27 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:34.135005 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c1428-200f-4754-aa4f-22f3eb6a48ce None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:34.161995 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c969d-8946-4ac8-a0be-ec7a7fa389d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:34.162653 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c969d-8946-4ac8-a0be-ec7a7fa389d1 None admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:34.162943 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c969d-8946-4ac8-a0be-ec7a7fa389d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:34.163209 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c969d-8946-4ac8-a0be-ec7a7fa389d1 None admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:34.163842 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c969d-8946-4ac8-a0be-ec7a7fa389d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:34.165289 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c969d-8946-4ac8-a0be-ec7a7fa389d1 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:34.169612 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fa6f7-cc3b-475e-8f8f-1b8a77d8120e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:34.170226 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fa6f7-cc3b-475e-8f8f-1b8a77d8120e None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:34.170531 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fa6f7-cc3b-475e-8f8f-1b8a77d8120e None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:34.170804 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fa6f7-cc3b-475e-8f8f-1b8a77d8120e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:34.239421 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fa6f7-cc3b-475e-8f8f-1b8a77d8120e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:34.241103 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fa6f7-cc3b-475e-8f8f-1b8a77d8120e None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:34.290572 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 98/192] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 23 07:55:34 2022] POST /identity/v3/users => generated 297 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:55:34.290572 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c969d-8946-4ac8-a0be-ec7a7fa389d1 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:34.301457 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:34.319707 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:34.364505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 95/193] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:55:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:55:34.370448 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fa6f7-cc3b-475e-8f8f-1b8a77d8120e None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:34.422093 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c969d-8946-4ac8-a0be-ec7a7fa389d1 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:34.473267 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98e945-6f37-425d-8a22-390a69fbab6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:34.473896 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98e945-6f37-425d-8a22-390a69fbab6d None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:34.474180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98e945-6f37-425d-8a22-390a69fbab6d None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:34.474543 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98e945-6f37-425d-8a22-390a69fbab6d None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:34.475231 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98e945-6f37-425d-8a22-390a69fbab6d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:34.475534 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98e945-6f37-425d-8a22-390a69fbab6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:34.477008 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98e945-6f37-425d-8a22-390a69fbab6d None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:34.486027 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 99/194] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:55:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:34.491508 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98e945-6f37-425d-8a22-390a69fbab6d None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:34.497782 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fa6f7-cc3b-475e-8f8f-1b8a77d8120e None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:34.546354 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d8cf2-e7e4-45a2-b124-f8f0b47d0a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:34.546897 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d8cf2-e7e4-45a2-b124-f8f0b47d0a28 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:34.547178 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d8cf2-e7e4-45a2-b124-f8f0b47d0a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:34.547453 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d8cf2-e7e4-45a2-b124-f8f0b47d0a28 None admin] PATH_INFO: `/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:34.549810 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d8cf2-e7e4-45a2-b124-f8f0b47d0a28 None admin] RBAC: Authorizing `identity:get_project(project_id=b2061ddf744e4b65bc58158bbf9baf3c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:34.551321 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d8cf2-e7e4-45a2-b124-f8f0b47d0a28 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:34.553005 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 96/195] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:34 2022] GET /identity/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:34.559379 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d8cf2-e7e4-45a2-b124-f8f0b47d0a28 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:34.586517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:34.622225 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:34.634111 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98e945-6f37-425d-8a22-390a69fbab6d None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:34.675709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5811c3-ef2a-4775-a117-e92b4efd7e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:34.676367 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5811c3-ef2a-4775-a117-e92b4efd7e53 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:34.676651 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5811c3-ef2a-4775-a117-e92b4efd7e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:34.676922 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5811c3-ef2a-4775-a117-e92b4efd7e53 None admin] PATH_INFO: `/v3/users/c7b77563f929411d9e5508e076f5a1e9` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:34.678086 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5811c3-ef2a-4775-a117-e92b4efd7e53 None admin] RBAC: Authorizing `identity:get_user(user_id=c7b77563f929411d9e5508e076f5a1e9)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:34.679803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5811c3-ef2a-4775-a117-e92b4efd7e53 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:34.685948 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 100/196] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:34 2022] GET /identity/v3/users/c7b77563f929411d9e5508e076f5a1e9 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:34.685948 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611d49f-dfef-4db6-866e-66ba1fd800f9 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:34.685948 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611d49f-dfef-4db6-866e-66ba1fd800f9 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:34.685948 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611d49f-dfef-4db6-866e-66ba1fd800f9 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:34.685948 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 101/197] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:34.686909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611d49f-dfef-4db6-866e-66ba1fd800f9 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:34.700025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d8cf2-e7e4-45a2-b124-f8f0b47d0a28 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:34.739379 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84f03b-8978-4db1-b37b-fb53e6758fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:34.740363 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84f03b-8978-4db1-b37b-fb53e6758fac None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:34.740847 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84f03b-8978-4db1-b37b-fb53e6758fac None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:34.741336 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84f03b-8978-4db1-b37b-fb53e6758fac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:34.742252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84f03b-8978-4db1-b37b-fb53e6758fac None admin] RBAC: Adding query filter params (role.id=e905040849d04aadbb8da8b0d216c92c, scope.project.id=b2061ddf744e4b65bc58158bbf9baf3c, user.id=c7b77563f929411d9e5508e076f5a1e9) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:34.742781 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84f03b-8978-4db1-b37b-fb53e6758fac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:34.744423 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84f03b-8978-4db1-b37b-fb53e6758fac None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:34.750873 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 97/198] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:55:34 2022] GET /identity/v3/role_assignments?user.id=c7b77563f929411d9e5508e076f5a1e9&scope.project.id=b2061ddf744e4b65bc58158bbf9baf3c&role.id=e905040849d04aadbb8da8b0d216c92c => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:34.752356 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3012d97-2a16-4be1-81cd-2c3511740ef5 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:34.752831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3012d97-2a16-4be1-81cd-2c3511740ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:34.753297 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3012d97-2a16-4be1-81cd-2c3511740ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:34.783631 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-d3012d97-2a16-4be1-81cd-2c3511740ef5 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:34.785269 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-d3012d97-2a16-4be1-81cd-2c3511740ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:34.883319 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611d49f-dfef-4db6-866e-66ba1fd800f9 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:34.927831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 98/199] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:34.938971 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585cdb7-c102-46bb-b568-8e7e221a285f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:34.940018 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585cdb7-c102-46bb-b568-8e7e221a285f None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:34.940557 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585cdb7-c102-46bb-b568-8e7e221a285f None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:34.941033 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585cdb7-c102-46bb-b568-8e7e221a285f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:34.976439 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:35.029813 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585cdb7-c102-46bb-b568-8e7e221a285f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:35.031321 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585cdb7-c102-46bb-b568-8e7e221a285f None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:35.198411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 102/200] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:55:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:55:35.207468 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3012d97-2a16-4be1-81cd-2c3511740ef5 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:35.240319 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:35.247144 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585cdb7-c102-46bb-b568-8e7e221a285f None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:35.319755 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:35.391786 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585cdb7-c102-46bb-b568-8e7e221a285f None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:35.410508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3012d97-2a16-4be1-81cd-2c3511740ef5 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:35.452500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99da6c-9453-4232-a90e-d1d01256b749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:35.453453 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99da6c-9453-4232-a90e-d1d01256b749 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:35.453946 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99da6c-9453-4232-a90e-d1d01256b749 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:35.455058 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99da6c-9453-4232-a90e-d1d01256b749 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:35.469271 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99da6c-9453-4232-a90e-d1d01256b749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:35.470401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed9f74-cb25-45e2-908f-a711e5e41187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:35.471050 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed9f74-cb25-45e2-908f-a711e5e41187 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:35.471333 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed9f74-cb25-45e2-908f-a711e5e41187 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:35.471611 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed9f74-cb25-45e2-908f-a711e5e41187 None admin] PATH_INFO: `/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:35.472792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed9f74-cb25-45e2-908f-a711e5e41187 None admin] RBAC: Authorizing `identity:get_project(project_id=b2061ddf744e4b65bc58158bbf9baf3c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:35.474318 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed9f74-cb25-45e2-908f-a711e5e41187 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:35.474880 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-6f99da6c-9453-4232-a90e-d1d01256b749 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:55:35.474880 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:35.474880 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:35.474880 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:35.474880 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:35.474880 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:35.474880 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:35.474880 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:35.474880 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:35.474880 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:35.474880 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:35.474880 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:35.474880 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:35.474880 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:35.474880 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:35.474880 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:35.475812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:35.475812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:35.475812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:35.475812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:35.475812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:35.475812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:35.475812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:35.475812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:35.475812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:35.475812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:35.475812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:35.475812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:35.475812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:35.475812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:35.475812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:35.475812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:35.476660 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:35.476660 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:35.476660 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:35.476660 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:35.476660 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:35.476660 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:35.476660 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:35.476660 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:35.476660 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:35.476660 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:35.476660 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:55:35.476660 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:55:35.477312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 99/201] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:35 2022] GET /identity/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:35.477390 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 103/202] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:55:35.482829 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed9f74-cb25-45e2-908f-a711e5e41187 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:35.483492 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99da6c-9453-4232-a90e-d1d01256b749 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:35.609820 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:35.632382 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed9f74-cb25-45e2-908f-a711e5e41187 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:35.632584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99da6c-9453-4232-a90e-d1d01256b749 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:35.682690 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:35.696124 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f34e6a-ad1b-459b-ab47-363f8633cb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:35.696736 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f34e6a-ad1b-459b-ab47-363f8633cb33 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:35.697020 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f34e6a-ad1b-459b-ab47-363f8633cb33 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:35.697291 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f34e6a-ad1b-459b-ab47-363f8633cb33 None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:35.697952 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f34e6a-ad1b-459b-ab47-363f8633cb33 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:35.698250 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f34e6a-ad1b-459b-ab47-363f8633cb33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:35.699971 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f34e6a-ad1b-459b-ab47-363f8633cb33 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:35.704365 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f943ba-b876-4b44-bfbf-e0e0f624cda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:35.704913 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f943ba-b876-4b44-bfbf-e0e0f624cda2 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:35.705188 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f943ba-b876-4b44-bfbf-e0e0f624cda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:35.705497 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f943ba-b876-4b44-bfbf-e0e0f624cda2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:35.706213 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f943ba-b876-4b44-bfbf-e0e0f624cda2 None admin] RBAC: Adding query filter params (role.id=4e9a14889d764731b59323f764f1bb85, scope.project.id=b2061ddf744e4b65bc58158bbf9baf3c, user.id=c7b77563f929411d9e5508e076f5a1e9) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:35.706546 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f943ba-b876-4b44-bfbf-e0e0f624cda2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:35.707993 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f943ba-b876-4b44-bfbf-e0e0f624cda2 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:35.718818 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 100/203] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 23 07:55:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:35.720282 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 104/204] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:55:35 2022] GET /identity/v3/role_assignments?user.id=c7b77563f929411d9e5508e076f5a1e9&scope.project.id=b2061ddf744e4b65bc58158bbf9baf3c&role.id=4e9a14889d764731b59323f764f1bb85 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:55:35.724583 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f34e6a-ad1b-459b-ab47-363f8633cb33 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:35.927097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f34e6a-ad1b-459b-ab47-363f8633cb33 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:35.968190 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093898b-61c5-4dca-9b44-30cd94c63faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:35.968751 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093898b-61c5-4dca-9b44-30cd94c63faf None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:35.969029 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093898b-61c5-4dca-9b44-30cd94c63faf None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:35.969302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093898b-61c5-4dca-9b44-30cd94c63faf None admin] PATH_INFO: `/v3/users/a9a504a7a9164cd2b64ee8ca16cf8af4` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:35.970466 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093898b-61c5-4dca-9b44-30cd94c63faf None admin] RBAC: Authorizing `identity:get_user(user_id=a9a504a7a9164cd2b64ee8ca16cf8af4)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:35.971993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093898b-61c5-4dca-9b44-30cd94c63faf None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:35.973886 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 101/205] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:35 2022] GET /identity/v3/users/a9a504a7a9164cd2b64ee8ca16cf8af4 => generated 289 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:35.979396 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f943ba-b876-4b44-bfbf-e0e0f624cda2 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:36.104861 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f943ba-b876-4b44-bfbf-e0e0f624cda2 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:36.152497 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f02e0f-71a5-443c-be75-5ba094e11862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:36.153123 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f02e0f-71a5-443c-be75-5ba094e11862 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:36.153393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f02e0f-71a5-443c-be75-5ba094e11862 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:36.153698 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f02e0f-71a5-443c-be75-5ba094e11862 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:36.223988 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:36.242029 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f02e0f-71a5-443c-be75-5ba094e11862 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:36.243555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f02e0f-71a5-443c-be75-5ba094e11862 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:36.375701 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 105/206] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:55:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:55:36.381407 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093898b-61c5-4dca-9b44-30cd94c63faf None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:36.410229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:36.531118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093898b-61c5-4dca-9b44-30cd94c63faf None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:36.580473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46add0-6ed5-44e8-bf09-5b5719473e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:36.581117 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46add0-6ed5-44e8-bf09-5b5719473e70 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:36.581396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46add0-6ed5-44e8-bf09-5b5719473e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:36.581670 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46add0-6ed5-44e8-bf09-5b5719473e70 None admin] PATH_INFO: `/v3/projects/dbd8608370894c55b5729ce6902c5722` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:36.582869 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46add0-6ed5-44e8-bf09-5b5719473e70 None admin] RBAC: Authorizing `identity:get_project(project_id=dbd8608370894c55b5729ce6902c5722)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:36.584432 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46add0-6ed5-44e8-bf09-5b5719473e70 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:36.586390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 102/207] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:36 2022] GET /identity/v3/projects/dbd8608370894c55b5729ce6902c5722 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:36.592730 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f02e0f-71a5-443c-be75-5ba094e11862 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:36.634866 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77d545-f8fd-4d3c-8597-9b0cea2bec33 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:36.635182 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77d545-f8fd-4d3c-8597-9b0cea2bec33 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:36.635426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77d545-f8fd-4d3c-8597-9b0cea2bec33 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:36.636766 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 103/208] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:36.642843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7055290-3add-44ae-ac7d-5fe684c4835c None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:36.643132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7055290-3add-44ae-ac7d-5fe684c4835c None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:36.643408 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7055290-3add-44ae-ac7d-5fe684c4835c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:36.681082 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-c7055290-3add-44ae-ac7d-5fe684c4835c None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:36.682306 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c7055290-3add-44ae-ac7d-5fe684c4835c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:36.734657 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:36.771369 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f02e0f-71a5-443c-be75-5ba094e11862 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:36.831320 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 104/209] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:55:36.843379 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666096fe-eee8-4f9c-9026-042ce035e5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:36.843995 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666096fe-eee8-4f9c-9026-042ce035e5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:36.844280 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666096fe-eee8-4f9c-9026-042ce035e5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:36.844558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666096fe-eee8-4f9c-9026-042ce035e5e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:36.845287 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666096fe-eee8-4f9c-9026-042ce035e5e1 None admin] RBAC: Adding query filter params (role.id=530235f994134c70a0beaef3ed1b650c, scope.project.id=dbd8608370894c55b5729ce6902c5722, user.id=a9a504a7a9164cd2b64ee8ca16cf8af4) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:36.845603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666096fe-eee8-4f9c-9026-042ce035e5e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:36.847073 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666096fe-eee8-4f9c-9026-042ce035e5e1 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:36.853347 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 106/210] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:55:36 2022] GET /identity/v3/role_assignments?user.id=a9a504a7a9164cd2b64ee8ca16cf8af4&scope.project.id=dbd8608370894c55b5729ce6902c5722&role.id=530235f994134c70a0beaef3ed1b650c => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:37.089127 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d480a-9891-4457-ab2f-a3fa2ac0d329 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:37.089478 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d480a-9891-4457-ab2f-a3fa2ac0d329 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:37.089652 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d480a-9891-4457-ab2f-a3fa2ac0d329 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:37.091327 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 105/211] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:37.096577 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16092cc4-a0e6-4e07-8e4d-14eb4b18850f None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:37.097026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16092cc4-a0e6-4e07-8e4d-14eb4b18850f None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:37.097220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16092cc4-a0e6-4e07-8e4d-14eb4b18850f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:37.116818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-16092cc4-a0e6-4e07-8e4d-14eb4b18850f None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:37.118039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-16092cc4-a0e6-4e07-8e4d-14eb4b18850f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:37.128051 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d480a-9891-4457-ab2f-a3fa2ac0d329 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:37.143536 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:37.215323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 107/212] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:37.217088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea4c2a-8b72-4078-bffb-1ad1a3a3159d None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:37.218386 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea4c2a-8b72-4078-bffb-1ad1a3a3159d None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:37.218683 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea4c2a-8b72-4078-bffb-1ad1a3a3159d None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:37.221449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 108/213] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:37.231787 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b4d4e-9c2b-443d-9e98-caa53a8843e0 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:37.232336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b4d4e-9c2b-443d-9e98-caa53a8843e0 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:37.232940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b4d4e-9c2b-443d-9e98-caa53a8843e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:37.253038 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-576b4d4e-9c2b-443d-9e98-caa53a8843e0 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:37.254507 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-576b4d4e-9c2b-443d-9e98-caa53a8843e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:37.265623 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d480a-9891-4457-ab2f-a3fa2ac0d329 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:37.315983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff034826-f958-421e-8384-71d912c3cf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:37.316939 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff034826-f958-421e-8384-71d912c3cf8a None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:37.317319 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff034826-f958-421e-8384-71d912c3cf8a None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:37.317711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff034826-f958-421e-8384-71d912c3cf8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:37.331693 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff034826-f958-421e-8384-71d912c3cf8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:37.338850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-ff034826-f958-421e-8384-71d912c3cf8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:55:37.338850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:37.338850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:37.338850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:37.338850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:37.338850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:37.338850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:37.338850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:37.338850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:37.338850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:37.338850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:37.338850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:37.338850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:37.338850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:37.338850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:37.338850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:37.339963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:37.339963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:37.339963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:37.339963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:37.339963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:37.339963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:37.339963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:37.339963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:37.339963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:37.339963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:37.339963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:37.339963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:37.339963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:37.339963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:37.339963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:37.339963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:37.340978 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:37.340978 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:37.340978 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:37.340978 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:37.340978 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:37.340978 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:37.340978 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:37.340978 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:37.340978 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:37.340978 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:37.340978 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:55:37.340978 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:55:37.346325 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 106/214] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:37.349231 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff034826-f958-421e-8384-71d912c3cf8a None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:37.354355 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 109/215] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:37.420970 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:37.455151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff034826-f958-421e-8384-71d912c3cf8a None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:37.488171 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b4d4e-9c2b-443d-9e98-caa53a8843e0 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:37.495058 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0793f2-3b84-4cb1-b2df-4fedcca78058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:37.495761 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0793f2-3b84-4cb1-b2df-4fedcca78058 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:37.496043 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0793f2-3b84-4cb1-b2df-4fedcca78058 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:37.496316 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0793f2-3b84-4cb1-b2df-4fedcca78058 None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:37.496916 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:37.498000 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0793f2-3b84-4cb1-b2df-4fedcca78058 None admin] RBAC: Adding query filter params (name=member) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:37.498328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0793f2-3b84-4cb1-b2df-4fedcca78058 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:37.499742 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0793f2-3b84-4cb1-b2df-4fedcca78058 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:37.508835 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 107/216] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 23 07:55:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:55:37.515847 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0793f2-3b84-4cb1-b2df-4fedcca78058 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:37.663546 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b4d4e-9c2b-443d-9e98-caa53a8843e0 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:37.703667 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbb0a7-e294-4410-b547-c3e21740c082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:37.704307 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbb0a7-e294-4410-b547-c3e21740c082 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:37.704590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbb0a7-e294-4410-b547-c3e21740c082 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:37.704867 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbb0a7-e294-4410-b547-c3e21740c082 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:37.717735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbb0a7-e294-4410-b547-c3e21740c082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:37.722789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-47dbb0a7-e294-4410-b547-c3e21740c082 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:55:37.722789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:37.722789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:37.722789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:37.722789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:37.722789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:37.722789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:37.722789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:37.722789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:37.722789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:37.722789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:37.722789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:37.722789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:37.722789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:37.722789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:37.722789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:37.723800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:37.723800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:37.723800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:37.723800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:37.723800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:37.723800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:37.723800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:37.723800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:37.723800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:37.723800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:37.723800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:37.723800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:37.723800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:37.723800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:37.723800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:37.723800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:37.724594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:37.724594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:37.724594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:37.724594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:37.724594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:37.724594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:37.724594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:37.724594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:37.724594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:37.724594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:37.724594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:55:37.724594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:55:37.724594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 110/217] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:55:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:37.725245 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbb0a7-e294-4410-b547-c3e21740c082 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:37.735987 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0793f2-3b84-4cb1-b2df-4fedcca78058 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:37.765883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:37.771639 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2fa61-85a8-43c8-a612-d5cb3d6cbe81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:37.772271 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2fa61-85a8-43c8-a612-d5cb3d6cbe81 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:37.772553 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2fa61-85a8-43c8-a612-d5cb3d6cbe81 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:37.772830 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2fa61-85a8-43c8-a612-d5cb3d6cbe81 None admin] PATH_INFO: `/v3/users/249f824c84e2452792e43faea2befe5b` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:37.786808 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2fa61-85a8-43c8-a612-d5cb3d6cbe81 None admin] RBAC: Authorizing `identity:get_user(user_id=249f824c84e2452792e43faea2befe5b)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:37.788564 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2fa61-85a8-43c8-a612-d5cb3d6cbe81 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:37.794722 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 108/218] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:37 2022] GET /identity/v3/users/249f824c84e2452792e43faea2befe5b => generated 297 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:37.794722 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2fa61-85a8-43c8-a612-d5cb3d6cbe81 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:37.802478 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:37.838517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbb0a7-e294-4410-b547-c3e21740c082 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:37.871452 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14f91f-5f95-4ef3-97c0-0be6ccfd520b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:37.872076 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14f91f-5f95-4ef3-97c0-0be6ccfd520b None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:37.872467 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14f91f-5f95-4ef3-97c0-0be6ccfd520b None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:37.872749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14f91f-5f95-4ef3-97c0-0be6ccfd520b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:37.873860 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14f91f-5f95-4ef3-97c0-0be6ccfd520b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:37.875356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14f91f-5f95-4ef3-97c0-0be6ccfd520b None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:37.876948 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 111/219] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:55:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:37.877730 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14f91f-5f95-4ef3-97c0-0be6ccfd520b None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:37.901851 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2fa61-85a8-43c8-a612-d5cb3d6cbe81 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:37.937593 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd46da-ff30-4004-a500-3d458b69efb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:37.938210 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd46da-ff30-4004-a500-3d458b69efb0 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:37.938534 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd46da-ff30-4004-a500-3d458b69efb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:37.938783 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd46da-ff30-4004-a500-3d458b69efb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:37.939437 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd46da-ff30-4004-a500-3d458b69efb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:37.939739 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd46da-ff30-4004-a500-3d458b69efb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:37.941178 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd46da-ff30-4004-a500-3d458b69efb0 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:37.954937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 109/220] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:37.955795 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd46da-ff30-4004-a500-3d458b69efb0 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:37.981450 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14f91f-5f95-4ef3-97c0-0be6ccfd520b None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:38.008381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:38.016891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f203120-211a-43e9-a42c-77e652e039a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:38.030470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f203120-211a-43e9-a42c-77e652e039a0 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:38.030470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f203120-211a-43e9-a42c-77e652e039a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:38.030470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f203120-211a-43e9-a42c-77e652e039a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:38.030470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:38.059206 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd46da-ff30-4004-a500-3d458b69efb0 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:38.088751 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f203120-211a-43e9-a42c-77e652e039a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:38.090728 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f203120-211a-43e9-a42c-77e652e039a0 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:38.093247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2eff1a-e05f-4007-976c-b1b9ffe0327a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:38.093852 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2eff1a-e05f-4007-976c-b1b9ffe0327a None admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:38.094157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2eff1a-e05f-4007-976c-b1b9ffe0327a None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:38.094463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2eff1a-e05f-4007-976c-b1b9ffe0327a None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:38.095098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2eff1a-e05f-4007-976c-b1b9ffe0327a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:38.096547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2eff1a-e05f-4007-976c-b1b9ffe0327a None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:38.184223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 112/221] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:55:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:55:38.185624 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f203120-211a-43e9-a42c-77e652e039a0 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:38.214318 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 110/222] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 23 07:55:37 2022] POST /identity/v3/users => generated 297 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:55:38.214318 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c8bf1-ddeb-41f1-ad1c-5ae7e539ffdd None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:38.214318 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c8bf1-ddeb-41f1-ad1c-5ae7e539ffdd None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:38.214318 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c8bf1-ddeb-41f1-ad1c-5ae7e539ffdd None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:38.214318 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 111/223] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:38.214318 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c8bf1-ddeb-41f1-ad1c-5ae7e539ffdd None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:38.231019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:38.307606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f203120-211a-43e9-a42c-77e652e039a0 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:38.340163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c8bf1-ddeb-41f1-ad1c-5ae7e539ffdd None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:38.347990 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:38.349670 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bde123-8aa6-487b-b0c9-4c66195ef639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:38.350335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bde123-8aa6-487b-b0c9-4c66195ef639 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:38.350611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bde123-8aa6-487b-b0c9-4c66195ef639 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:38.350880 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bde123-8aa6-487b-b0c9-4c66195ef639 None admin] PATH_INFO: `/v3/users/c7b77563f929411d9e5508e076f5a1e9` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:38.352016 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bde123-8aa6-487b-b0c9-4c66195ef639 None admin] RBAC: Authorizing `identity:get_user(user_id=c7b77563f929411d9e5508e076f5a1e9)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:38.353454 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bde123-8aa6-487b-b0c9-4c66195ef639 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:38.355323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 113/224] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:38 2022] GET /identity/v3/users/c7b77563f929411d9e5508e076f5a1e9 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:38.361246 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1eca14-42f6-4fc7-8557-bb0b75ab5fd8 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:38.361246 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1eca14-42f6-4fc7-8557-bb0b75ab5fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:38.361246 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1eca14-42f6-4fc7-8557-bb0b75ab5fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:38.375487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-7d1eca14-42f6-4fc7-8557-bb0b75ab5fd8 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:38.376791 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-7d1eca14-42f6-4fc7-8557-bb0b75ab5fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:38.382993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149f436-d741-4f8f-97ae-841075a85392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:38.383630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149f436-d741-4f8f-97ae-841075a85392 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:38.383910 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149f436-d741-4f8f-97ae-841075a85392 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:38.384181 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149f436-d741-4f8f-97ae-841075a85392 None admin] PATH_INFO: `/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:38.385319 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149f436-d741-4f8f-97ae-841075a85392 None admin] RBAC: Authorizing `identity:get_project(project_id=b2061ddf744e4b65bc58158bbf9baf3c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:38.386855 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149f436-d741-4f8f-97ae-841075a85392 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:38.390169 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 112/225] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:38 2022] GET /identity/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:38.390169 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149f436-d741-4f8f-97ae-841075a85392 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:38.458943 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 114/226] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:38.458943 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1eca14-42f6-4fc7-8557-bb0b75ab5fd8 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:38.490204 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:38.513736 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149f436-d741-4f8f-97ae-841075a85392 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:38.558999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd427e-0de8-4c58-a253-4fe72d0ad130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:38.560078 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd427e-0de8-4c58-a253-4fe72d0ad130 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:38.560560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd427e-0de8-4c58-a253-4fe72d0ad130 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:38.561057 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd427e-0de8-4c58-a253-4fe72d0ad130 None admin] PATH_INFO: `/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:38.563226 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd427e-0de8-4c58-a253-4fe72d0ad130 None admin] RBAC: Authorizing `identity:get_project(project_id=b2061ddf744e4b65bc58158bbf9baf3c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:38.565226 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd427e-0de8-4c58-a253-4fe72d0ad130 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:38.567753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 113/227] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:38 2022] GET /identity/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:38.574773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd427e-0de8-4c58-a253-4fe72d0ad130 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:38.575165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1eca14-42f6-4fc7-8557-bb0b75ab5fd8 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:38.617912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc661f-6100-44cc-b632-171bfb7fa86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:38.618562 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc661f-6100-44cc-b632-171bfb7fa86f None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:38.618847 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc661f-6100-44cc-b632-171bfb7fa86f None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:38.619119 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc661f-6100-44cc-b632-171bfb7fa86f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:38.620033 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc661f-6100-44cc-b632-171bfb7fa86f None admin] RBAC: Adding query filter params (role.id=4ed852223bc54be09a9487ff788b7644, scope.project.id=b2061ddf744e4b65bc58158bbf9baf3c, user.id=249f824c84e2452792e43faea2befe5b) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:38.620135 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc661f-6100-44cc-b632-171bfb7fa86f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:38.621580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc661f-6100-44cc-b632-171bfb7fa86f None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:38.628138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 115/228] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:55:38 2022] GET /identity/v3/role_assignments?user.id=249f824c84e2452792e43faea2befe5b&scope.project.id=b2061ddf744e4b65bc58158bbf9baf3c&role.id=4ed852223bc54be09a9487ff788b7644 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:38.628699 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:38.699555 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd427e-0de8-4c58-a253-4fe72d0ad130 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:38.738818 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608ea24-8ced-4c3e-b63d-264a1cc4d7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:38.739423 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608ea24-8ced-4c3e-b63d-264a1cc4d7ff None admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:38.739708 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608ea24-8ced-4c3e-b63d-264a1cc4d7ff None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:38.739984 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608ea24-8ced-4c3e-b63d-264a1cc4d7ff None admin] PATH_INFO: `/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c/users/c7b77563f929411d9e5508e076f5a1e9/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:38.742114 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608ea24-8ced-4c3e-b63d-264a1cc4d7ff None admin] RBAC: Authorizing `identity:create_grant(project_id=b2061ddf744e4b65bc58158bbf9baf3c, user_id=c7b77563f929411d9e5508e076f5a1e9, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:38.743648 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608ea24-8ced-4c3e-b63d-264a1cc4d7ff None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:38.791166 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc661f-6100-44cc-b632-171bfb7fa86f None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:38.835122 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 114/229] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 23 07:55:38 2022] PUT /identity/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c/users/c7b77563f929411d9e5508e076f5a1e9/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 07:55:38.901712 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:38.907829 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc661f-6100-44cc-b632-171bfb7fa86f None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:38.951299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd909d-3185-4996-b8d7-5eb18043d3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:38.952088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd909d-3185-4996-b8d7-5eb18043d3f6 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:38.952369 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd909d-3185-4996-b8d7-5eb18043d3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:38.952699 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd909d-3185-4996-b8d7-5eb18043d3f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:38.964242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd909d-3185-4996-b8d7-5eb18043d3f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:38.969198 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-4dbd909d-3185-4996-b8d7-5eb18043d3f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:55:38.969198 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:38.969198 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:38.969198 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:38.969198 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:38.969198 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:38.969198 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:38.969198 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:38.969198 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:38.969198 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:38.969198 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:38.969198 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:38.969198 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:38.969198 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:38.969198 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:38.969198 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:38.970059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:38.970059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:38.970059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:38.970059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:38.970059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:38.970059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:38.970059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:38.970059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:38.970059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:38.970059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:38.970059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:38.970059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:38.970059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:38.970059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:38.970059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:38.970059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:38.971299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:38.971299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:38.971299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:38.971299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:38.971299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:38.971299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:38.971299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:38.971299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:38.971299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:38.971299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:38.971299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:55:38.971299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:55:38.971299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 116/230] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 23 07:55:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:55:38.976768 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608ea24-8ced-4c3e-b63d-264a1cc4d7ff None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:39.087812 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608ea24-8ced-4c3e-b63d-264a1cc4d7ff None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:39.089870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:39.125521 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947040fb-a088-4fa0-877f-94e706e44372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:39.126130 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947040fb-a088-4fa0-877f-94e706e44372 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:39.126439 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947040fb-a088-4fa0-877f-94e706e44372 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:39.126708 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947040fb-a088-4fa0-877f-94e706e44372 None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:39.127410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947040fb-a088-4fa0-877f-94e706e44372 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:39.127714 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947040fb-a088-4fa0-877f-94e706e44372 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:39.129508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947040fb-a088-4fa0-877f-94e706e44372 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:39.138958 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 115/231] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:55:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:39.144505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd909d-3185-4996-b8d7-5eb18043d3f6 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:39.253367 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd909d-3185-4996-b8d7-5eb18043d3f6 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:39.288194 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f54e5-8f87-43ed-b4e7-ecb2532f8cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:39.288869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f54e5-8f87-43ed-b4e7-ecb2532f8cbc None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:39.289147 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f54e5-8f87-43ed-b4e7-ecb2532f8cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:39.289465 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f54e5-8f87-43ed-b4e7-ecb2532f8cbc None admin] PATH_INFO: `/v3/users/c7b77563f929411d9e5508e076f5a1e9` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:39.290641 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f54e5-8f87-43ed-b4e7-ecb2532f8cbc None admin] RBAC: Authorizing `identity:get_user(user_id=c7b77563f929411d9e5508e076f5a1e9)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:39.292107 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f54e5-8f87-43ed-b4e7-ecb2532f8cbc None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:39.295113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 117/232] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:39 2022] GET /identity/v3/users/c7b77563f929411d9e5508e076f5a1e9 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:39.300834 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947040fb-a088-4fa0-877f-94e706e44372 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:39.405050 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947040fb-a088-4fa0-877f-94e706e44372 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:39.439055 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc179be3-806d-48a6-9e2b-49a7aaa0c593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:39.439683 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc179be3-806d-48a6-9e2b-49a7aaa0c593 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:39.439957 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc179be3-806d-48a6-9e2b-49a7aaa0c593 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:39.440231 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc179be3-806d-48a6-9e2b-49a7aaa0c593 None admin] PATH_INFO: `/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:39.441337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc179be3-806d-48a6-9e2b-49a7aaa0c593 None admin] RBAC: Authorizing `identity:get_project(project_id=b2061ddf744e4b65bc58158bbf9baf3c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:39.442894 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc179be3-806d-48a6-9e2b-49a7aaa0c593 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:39.444536 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 116/233] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:39 2022] GET /identity/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:39.450668 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f54e5-8f87-43ed-b4e7-ecb2532f8cbc None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:39.477229 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:39.630230 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f54e5-8f87-43ed-b4e7-ecb2532f8cbc None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:39.670008 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599f78e-7f15-4547-825f-027866e32b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:39.670628 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599f78e-7f15-4547-825f-027866e32b0a None admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:39.671011 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599f78e-7f15-4547-825f-027866e32b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:39.671288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599f78e-7f15-4547-825f-027866e32b0a None admin] PATH_INFO: `/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c/users/c7b77563f929411d9e5508e076f5a1e9/roles/4e9a14889d764731b59323f764f1bb85` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:39.676101 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599f78e-7f15-4547-825f-027866e32b0a None admin] RBAC: Authorizing `identity:create_grant(project_id=b2061ddf744e4b65bc58158bbf9baf3c, user_id=c7b77563f929411d9e5508e076f5a1e9, role_id=4e9a14889d764731b59323f764f1bb85)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:39.677574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599f78e-7f15-4547-825f-027866e32b0a None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:39.764930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 118/234] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 23 07:55:39 2022] PUT /identity/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c/users/c7b77563f929411d9e5508e076f5a1e9/roles/4e9a14889d764731b59323f764f1bb85 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:55:40.705945 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f7a27-7234-49f4-a309-6eed9de4afd6 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:40.706500 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f7a27-7234-49f4-a309-6eed9de4afd6 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:40.706500 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f7a27-7234-49f4-a309-6eed9de4afd6 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:40.707837 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 117/235] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:40.713078 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1c122-1073-4bae-81ec-b4129025f06a None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:40.713865 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1c122-1073-4bae-81ec-b4129025f06a None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:40.714392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1c122-1073-4bae-81ec-b4129025f06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:40.716580 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83f806-ce38-43e1-86ab-89911d08ebbf None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:40.716856 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83f806-ce38-43e1-86ab-89911d08ebbf None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:40.717122 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83f806-ce38-43e1-86ab-89911d08ebbf None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:40.719650 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 118/236] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:40.723690 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7138d1-5734-4682-bb95-8976d3645a1e None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:40.724190 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7138d1-5734-4682-bb95-8976d3645a1e None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:40.724683 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7138d1-5734-4682-bb95-8976d3645a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:40.742852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-98f1c122-1073-4bae-81ec-b4129025f06a None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:40.743365 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-5f7138d1-5734-4682-bb95-8976d3645a1e None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:40.744127 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-98f1c122-1073-4bae-81ec-b4129025f06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:40.744980 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-5f7138d1-5734-4682-bb95-8976d3645a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:40.778704 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:40.853670 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 119/237] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:40.865524 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 119/238] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:40.978842 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a55905-d8ab-4e6f-bde1-146ceb3ed370 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:40.979188 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a55905-d8ab-4e6f-bde1-146ceb3ed370 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:40.979400 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a55905-d8ab-4e6f-bde1-146ceb3ed370 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:40.981017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 120/239] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:40.986059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2923f21-25f4-4d20-b2f0-376921340d7e None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:40.986375 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2923f21-25f4-4d20-b2f0-376921340d7e None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:40.986650 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2923f21-25f4-4d20-b2f0-376921340d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:41.015465 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-c2923f21-25f4-4d20-b2f0-376921340d7e None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:41.016653 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-c2923f21-25f4-4d20-b2f0-376921340d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:41.030665 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:41.109871 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 120/240] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:41.196429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a55905-d8ab-4e6f-bde1-146ceb3ed370 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:41.310681 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2923f21-25f4-4d20-b2f0-376921340d7e None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:41.320255 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a55905-d8ab-4e6f-bde1-146ceb3ed370 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:41.387099 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f41f70-0e01-4bce-a1b8-7776eb430b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:41.387758 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f41f70-0e01-4bce-a1b8-7776eb430b33 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:41.389542 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f41f70-0e01-4bce-a1b8-7776eb430b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:41.389835 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f41f70-0e01-4bce-a1b8-7776eb430b33 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:41.411710 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f41f70-0e01-4bce-a1b8-7776eb430b33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:41.416740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-81f41f70-0e01-4bce-a1b8-7776eb430b33 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:55:41.416740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:41.416740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:41.416740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:41.416740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:41.416740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:41.416740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:41.416740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:41.416740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:41.416740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:41.416740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:41.416740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:41.416740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:41.416740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:41.416740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:41.416740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:41.417625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:41.417625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:41.417625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:41.417625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:41.417625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:41.417625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:41.417625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:41.417625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:41.417625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:41.417625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:41.417625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:41.417625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:41.417625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:41.417625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:41.417625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:41.417625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:41.418620 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:41.418620 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:41.418620 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:41.418620 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:41.418620 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:41.418620 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:41.418620 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:41.418620 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:41.418620 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:41.418620 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:41.418620 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:55:41.418620 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:55:41.418620 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 121/241] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:41.426135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f41f70-0e01-4bce-a1b8-7776eb430b33 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:41.466897 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2923f21-25f4-4d20-b2f0-376921340d7e None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:41.474628 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:41.520166 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcce04-a569-4f7c-8fb5-a2b99601b5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:41.520841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcce04-a569-4f7c-8fb5-a2b99601b5f2 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:41.521133 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcce04-a569-4f7c-8fb5-a2b99601b5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:41.521405 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcce04-a569-4f7c-8fb5-a2b99601b5f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:41.522622 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fcce04-a569-4f7c-8fb5-a2b99601b5f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:41.524079 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fcce04-a569-4f7c-8fb5-a2b99601b5f2 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:41.525676 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 121/242] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:55:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:41.526451 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcce04-a569-4f7c-8fb5-a2b99601b5f2 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:41.545660 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:41.568226 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f41f70-0e01-4bce-a1b8-7776eb430b33 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:41.606024 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a44bf2-8bd2-4e89-a17d-eb365eb8917c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:41.606805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a44bf2-8bd2-4e89-a17d-eb365eb8917c None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:41.607206 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a44bf2-8bd2-4e89-a17d-eb365eb8917c None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:41.607483 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a44bf2-8bd2-4e89-a17d-eb365eb8917c None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:41.608128 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a44bf2-8bd2-4e89-a17d-eb365eb8917c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:41.608427 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a44bf2-8bd2-4e89-a17d-eb365eb8917c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:41.609798 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a44bf2-8bd2-4e89-a17d-eb365eb8917c None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:41.618380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 122/243] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 23 07:55:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:55:41.619364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdedad-e8e7-49d4-a809-572cdf0e9f16 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:41.619646 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdedad-e8e7-49d4-a809-572cdf0e9f16 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:41.619914 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdedad-e8e7-49d4-a809-572cdf0e9f16 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:41.621213 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 123/244] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:41.623560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdedad-e8e7-49d4-a809-572cdf0e9f16 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:41.642054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcce04-a569-4f7c-8fb5-a2b99601b5f2 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:41.683848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a4a83-3cbe-49a1-924b-07ebe8dfc471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:41.684483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a4a83-3cbe-49a1-924b-07ebe8dfc471 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:41.684798 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a4a83-3cbe-49a1-924b-07ebe8dfc471 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:41.685627 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a4a83-3cbe-49a1-924b-07ebe8dfc471 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:41.696002 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a4a83-3cbe-49a1-924b-07ebe8dfc471 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:41.701805 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-2f1a4a83-3cbe-49a1-924b-07ebe8dfc471 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:55:41.701805 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:41.701805 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:41.701805 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:41.701805 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:41.701805 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:41.701805 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:41.701805 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:41.701805 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:41.701805 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:41.701805 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:41.701805 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:41.701805 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:41.701805 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:41.701805 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:41.701805 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:41.702716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:41.702716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:41.702716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:41.702716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:41.702716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:41.702716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:41.702716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:41.702716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:41.702716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:41.702716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:41.702716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:41.702716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:41.702716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:41.702716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:41.702716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:41.702716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:41.703490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:41.703490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:41.703490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:41.703490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:41.703490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:41.703490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:41.703490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:41.703490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:41.703490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:41.703490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:41.703490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:55:41.703490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:55:41.703490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 122/245] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:41.704224 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a4a83-3cbe-49a1-924b-07ebe8dfc471 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:41.729190 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:41.746274 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdedad-e8e7-49d4-a809-572cdf0e9f16 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:41.781816 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:41.785785 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f2774-6c9f-40f4-8c44-aead1d805610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:41.786442 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f2774-6c9f-40f4-8c44-aead1d805610 None admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:41.786725 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f2774-6c9f-40f4-8c44-aead1d805610 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:41.787005 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f2774-6c9f-40f4-8c44-aead1d805610 None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:41.787649 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f2774-6c9f-40f4-8c44-aead1d805610 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:41.789139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f2774-6c9f-40f4-8c44-aead1d805610 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:41.812136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a4a83-3cbe-49a1-924b-07ebe8dfc471 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:41.846039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f457b-e533-49dc-a235-2e8162640255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:41.846633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f457b-e533-49dc-a235-2e8162640255 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:41.846914 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f457b-e533-49dc-a235-2e8162640255 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:41.847185 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f457b-e533-49dc-a235-2e8162640255 None admin] PATH_INFO: `/v3/users/7fc627e39b184aa4a634507961759484` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:41.860219 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f457b-e533-49dc-a235-2e8162640255 None admin] RBAC: Authorizing `identity:get_user(user_id=7fc627e39b184aa4a634507961759484)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:41.861699 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f457b-e533-49dc-a235-2e8162640255 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:41.863517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 123/246] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:41 2022] GET /identity/v3/users/7fc627e39b184aa4a634507961759484 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:41.864509 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c862506-5aa1-4c53-9a19-0737762b2584 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:41.864794 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c862506-5aa1-4c53-9a19-0737762b2584 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:41.868304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c862506-5aa1-4c53-9a19-0737762b2584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:41.873466 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 124/247] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 23 07:55:41 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:55:41.874449 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f2774-6c9f-40f4-8c44-aead1d805610 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:41.890922 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-4c862506-5aa1-4c53-9a19-0737762b2584 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:41.892242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-4c862506-5aa1-4c53-9a19-0737762b2584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:41.968832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 124/248] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:41.969716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c862506-5aa1-4c53-9a19-0737762b2584 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:42.036047 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f2774-6c9f-40f4-8c44-aead1d805610 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:42.042210 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:42.105584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad5497-af7b-40fd-8930-a8f44f78b793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:42.107440 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad5497-af7b-40fd-8930-a8f44f78b793 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:42.108023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad5497-af7b-40fd-8930-a8f44f78b793 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:42.108502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad5497-af7b-40fd-8930-a8f44f78b793 None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:42.109131 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c862506-5aa1-4c53-9a19-0737762b2584 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:42.109650 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad5497-af7b-40fd-8930-a8f44f78b793 None admin] RBAC: Adding query filter params (name=member) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:42.110159 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad5497-af7b-40fd-8930-a8f44f78b793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:42.113010 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad5497-af7b-40fd-8930-a8f44f78b793 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:42.124010 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 125/249] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 23 07:55:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:42.129983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad5497-af7b-40fd-8930-a8f44f78b793 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:42.134280 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:42.155946 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981f581-b3be-4bad-9c75-685662946767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:42.156560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981f581-b3be-4bad-9c75-685662946767 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:42.156846 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981f581-b3be-4bad-9c75-685662946767 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:42.157119 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981f581-b3be-4bad-9c75-685662946767 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:42.249593 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981f581-b3be-4bad-9c75-685662946767 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:42.252062 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981f581-b3be-4bad-9c75-685662946767 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:42.261261 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad5497-af7b-40fd-8930-a8f44f78b793 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:42.304594 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97947cef-005d-48d1-9a0b-ef2109744a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:42.305248 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97947cef-005d-48d1-9a0b-ef2109744a1d None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:42.305532 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97947cef-005d-48d1-9a0b-ef2109744a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:42.305806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97947cef-005d-48d1-9a0b-ef2109744a1d None admin] PATH_INFO: `/v3/users/249f824c84e2452792e43faea2befe5b` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:42.306982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97947cef-005d-48d1-9a0b-ef2109744a1d None admin] RBAC: Authorizing `identity:get_user(user_id=249f824c84e2452792e43faea2befe5b)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:42.308438 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97947cef-005d-48d1-9a0b-ef2109744a1d None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:42.310103 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 126/250] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:42 2022] GET /identity/v3/users/249f824c84e2452792e43faea2befe5b => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:55:42.311508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc18fb-84d6-43df-ade4-76c542bb1ba1 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:42.311793 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc18fb-84d6-43df-ade4-76c542bb1ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:42.312074 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc18fb-84d6-43df-ade4-76c542bb1ba1 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:42.313304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 127/251] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:42.314799 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc18fb-84d6-43df-ade4-76c542bb1ba1 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:42.326409 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:42.376790 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 125/252] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:55:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:55:42.377099 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981f581-b3be-4bad-9c75-685662946767 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:42.405588 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:42.440244 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc18fb-84d6-43df-ade4-76c542bb1ba1 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:42.480998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7edf5b-3a70-4f51-a717-977df17feced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:42.482484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7edf5b-3a70-4f51-a717-977df17feced None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:42.482688 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7edf5b-3a70-4f51-a717-977df17feced None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:42.482969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7edf5b-3a70-4f51-a717-977df17feced None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:42.494312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7edf5b-3a70-4f51-a717-977df17feced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:42.494479 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981f581-b3be-4bad-9c75-685662946767 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:42.499854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-0d7edf5b-3a70-4f51-a717-977df17feced None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:55:42.499854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:42.499854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:42.499854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:42.499854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:42.499854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:42.499854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:42.499854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:42.499854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:42.499854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:42.499854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:42.499854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:42.499854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:42.499854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:42.499854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:42.499854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:42.500937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:42.500937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:42.500937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:42.500937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:42.500937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:42.500937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:42.500937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:42.500937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:42.500937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:42.500937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:42.500937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:42.500937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:42.500937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:42.500937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:42.500937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:42.500937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:42.501795 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:42.501795 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:42.501795 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:42.501795 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:42.501795 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:42.501795 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:42.501795 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:42.501795 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:42.501795 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:42.501795 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:42.501795 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:55:42.501795 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:55:42.501795 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 128/253] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:55:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:42.502528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3405bc-c12b-4b6c-b5d3-9dfefdf03d01 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:42.502603 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3405bc-c12b-4b6c-b5d3-9dfefdf03d01 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:42.502864 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3405bc-c12b-4b6c-b5d3-9dfefdf03d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:42.521639 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-8e3405bc-c12b-4b6c-b5d3-9dfefdf03d01 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:42.522854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-8e3405bc-c12b-4b6c-b5d3-9dfefdf03d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:42.532838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd600e-5bc4-462f-b582-ee53c9ece399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:42.533483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd600e-5bc4-462f-b582-ee53c9ece399 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:42.533769 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd600e-5bc4-462f-b582-ee53c9ece399 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:42.534050 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd600e-5bc4-462f-b582-ee53c9ece399 None admin] PATH_INFO: `/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:42.535237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd600e-5bc4-462f-b582-ee53c9ece399 None admin] RBAC: Authorizing `identity:get_project(project_id=b2061ddf744e4b65bc58158bbf9baf3c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:42.536723 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd600e-5bc4-462f-b582-ee53c9ece399 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:42.538541 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 126/254] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:42 2022] GET /identity/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:42.539185 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd600e-5bc4-462f-b582-ee53c9ece399 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:42.570590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:42.596360 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 129/255] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:42.597265 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3405bc-c12b-4b6c-b5d3-9dfefdf03d01 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:42.662711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:42.686954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd600e-5bc4-462f-b582-ee53c9ece399 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:42.702884 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3405bc-c12b-4b6c-b5d3-9dfefdf03d01 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:42.741931 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247ea33-e40d-4a4d-94d4-f9418be771ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:42.742606 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247ea33-e40d-4a4d-94d4-f9418be771ea None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:42.742981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247ea33-e40d-4a4d-94d4-f9418be771ea None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:42.743259 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247ea33-e40d-4a4d-94d4-f9418be771ea None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:42.744025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247ea33-e40d-4a4d-94d4-f9418be771ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:42.744327 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247ea33-e40d-4a4d-94d4-f9418be771ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:42.745920 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247ea33-e40d-4a4d-94d4-f9418be771ea None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:42.755214 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 130/256] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:42.756058 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247ea33-e40d-4a4d-94d4-f9418be771ea None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:42.761681 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128738f-58aa-428f-ab50-951a98c4bd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:42.762334 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128738f-58aa-428f-ab50-951a98c4bd4d None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:42.762613 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128738f-58aa-428f-ab50-951a98c4bd4d None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:42.763428 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128738f-58aa-428f-ab50-951a98c4bd4d None admin] PATH_INFO: `/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:42.771081 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128738f-58aa-428f-ab50-951a98c4bd4d None admin] RBAC: Authorizing `identity:get_project(project_id=b2061ddf744e4b65bc58158bbf9baf3c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:42.772854 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128738f-58aa-428f-ab50-951a98c4bd4d None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:42.774892 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 127/257] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:42 2022] GET /identity/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:42.775909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128738f-58aa-428f-ab50-951a98c4bd4d None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:42.870487 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247ea33-e40d-4a4d-94d4-f9418be771ea None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:42.898947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:42.910260 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36398347-d2c1-4ed1-a37b-dd5ac547853a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:42.910260 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36398347-d2c1-4ed1-a37b-dd5ac547853a None admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:42.910260 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36398347-d2c1-4ed1-a37b-dd5ac547853a None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:42.910260 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36398347-d2c1-4ed1-a37b-dd5ac547853a None admin] PATH_INFO: `/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c/users/249f824c84e2452792e43faea2befe5b/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:42.910644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36398347-d2c1-4ed1-a37b-dd5ac547853a None admin] RBAC: Authorizing `identity:create_grant(project_id=b2061ddf744e4b65bc58158bbf9baf3c, user_id=249f824c84e2452792e43faea2befe5b, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:42.911148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36398347-d2c1-4ed1-a37b-dd5ac547853a None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:42.975888 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:42.982794 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128738f-58aa-428f-ab50-951a98c4bd4d None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:42.992338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 131/258] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 23 07:55:42 2022] PUT /identity/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c/users/249f824c84e2452792e43faea2befe5b/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:55:42.993695 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36398347-d2c1-4ed1-a37b-dd5ac547853a None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:43.039020 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87122ef6-f138-446a-9419-2f938901cfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:43.039726 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87122ef6-f138-446a-9419-2f938901cfc8 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:43.040015 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87122ef6-f138-446a-9419-2f938901cfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:43.040294 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87122ef6-f138-446a-9419-2f938901cfc8 None admin] PATH_INFO: `/v3/users/c7b77563f929411d9e5508e076f5a1e9` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:43.041742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87122ef6-f138-446a-9419-2f938901cfc8 None admin] RBAC: Authorizing `identity:get_user(user_id=c7b77563f929411d9e5508e076f5a1e9)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:43.044693 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87122ef6-f138-446a-9419-2f938901cfc8 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:43.048439 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 128/259] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:42 2022] GET /identity/v3/users/c7b77563f929411d9e5508e076f5a1e9 => generated 283 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:43.050095 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87122ef6-f138-446a-9419-2f938901cfc8 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:43.178643 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36398347-d2c1-4ed1-a37b-dd5ac547853a None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:43.218756 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30012cec-6ffd-4d9a-9703-4e3442d81058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:43.219437 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30012cec-6ffd-4d9a-9703-4e3442d81058 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:43.219705 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87122ef6-f138-446a-9419-2f938901cfc8 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:43.219811 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30012cec-6ffd-4d9a-9703-4e3442d81058 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:43.219983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30012cec-6ffd-4d9a-9703-4e3442d81058 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:43.220762 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30012cec-6ffd-4d9a-9703-4e3442d81058 None admin] RBAC: Adding query filter params (role.id=530235f994134c70a0beaef3ed1b650c, scope.project.id=b2061ddf744e4b65bc58158bbf9baf3c, user.id=7fc627e39b184aa4a634507961759484) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:43.221077 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30012cec-6ffd-4d9a-9703-4e3442d81058 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:43.222567 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30012cec-6ffd-4d9a-9703-4e3442d81058 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:43.228437 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 132/260] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:55:42 2022] GET /identity/v3/role_assignments?user.id=7fc627e39b184aa4a634507961759484&scope.project.id=b2061ddf744e4b65bc58158bbf9baf3c&role.id=530235f994134c70a0beaef3ed1b650c => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:43.229630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30012cec-6ffd-4d9a-9703-4e3442d81058 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:43.262670 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e64d7-bd10-43e7-9cce-580b8a872fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:43.264252 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e64d7-bd10-43e7-9cce-580b8a872fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:43.264930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e64d7-bd10-43e7-9cce-580b8a872fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:43.265464 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e64d7-bd10-43e7-9cce-580b8a872fd3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:43.282023 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e64d7-bd10-43e7-9cce-580b8a872fd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:43.287504 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-9d4e64d7-bd10-43e7-9cce-580b8a872fd3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:55:43.287504 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:43.287504 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:43.287504 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:43.287504 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:43.287504 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:43.287504 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:43.287504 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:43.287504 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:43.287504 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:43.287504 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:43.287504 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:43.287504 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:43.287504 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:43.287504 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:43.287504 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:43.288458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:43.288458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:43.288458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:43.288458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:43.288458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:43.288458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:43.288458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:43.288458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:43.288458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:43.288458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:43.288458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:43.288458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:43.288458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:43.288458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:43.288458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:43.288458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:43.289235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:43.289235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:43.289235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:43.289235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:43.289235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:43.289235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:43.289235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:43.289235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:43.289235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:43.289235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:43.289235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:55:43.289235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:55:43.291997 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 129/261] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 23 07:55:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:43.299412 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:43.301305 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e64d7-bd10-43e7-9cce-580b8a872fd3 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:43.335156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:43.429385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e64d7-bd10-43e7-9cce-580b8a872fd3 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:43.446497 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30012cec-6ffd-4d9a-9703-4e3442d81058 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:43.472310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91ae0d-90c0-49c1-bd7f-906d331de287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:43.473377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91ae0d-90c0-49c1-bd7f-906d331de287 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:43.473855 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91ae0d-90c0-49c1-bd7f-906d331de287 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:43.474381 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91ae0d-90c0-49c1-bd7f-906d331de287 None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:43.475250 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91ae0d-90c0-49c1-bd7f-906d331de287 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:43.475782 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91ae0d-90c0-49c1-bd7f-906d331de287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:43.477486 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91ae0d-90c0-49c1-bd7f-906d331de287 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:43.488263 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 130/262] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:55:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:55:43.494416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91ae0d-90c0-49c1-bd7f-906d331de287 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:43.503654 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612d77d-e8f1-4d4b-9e99-a4b77b2502a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:43.504286 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612d77d-e8f1-4d4b-9e99-a4b77b2502a2 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:43.504571 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612d77d-e8f1-4d4b-9e99-a4b77b2502a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:43.504851 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612d77d-e8f1-4d4b-9e99-a4b77b2502a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:43.618063 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:43.644451 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612d77d-e8f1-4d4b-9e99-a4b77b2502a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:43.647767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91ae0d-90c0-49c1-bd7f-906d331de287 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:43.648849 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612d77d-e8f1-4d4b-9e99-a4b77b2502a2 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:43.720477 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:43.738209 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5ea00-2401-40f6-960c-693d9bcc2cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:43.738888 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5ea00-2401-40f6-960c-693d9bcc2cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:43.739171 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5ea00-2401-40f6-960c-693d9bcc2cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:43.739447 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5ea00-2401-40f6-960c-693d9bcc2cc4 None admin] PATH_INFO: `/v3/users/c7b77563f929411d9e5508e076f5a1e9` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:43.740599 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5ea00-2401-40f6-960c-693d9bcc2cc4 None admin] RBAC: Authorizing `identity:get_user(user_id=c7b77563f929411d9e5508e076f5a1e9)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:43.742079 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5ea00-2401-40f6-960c-693d9bcc2cc4 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:43.744053 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 131/263] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:43 2022] GET /identity/v3/users/c7b77563f929411d9e5508e076f5a1e9 => generated 283 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:55:43.754211 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5ea00-2401-40f6-960c-693d9bcc2cc4 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:43.797274 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 133/264] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:55:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:55:43.803343 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612d77d-e8f1-4d4b-9e99-a4b77b2502a2 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:43.927966 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612d77d-e8f1-4d4b-9e99-a4b77b2502a2 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:43.958908 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5ea00-2401-40f6-960c-693d9bcc2cc4 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:43.988054 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195ba98-e178-4d4a-aa24-53ba4a740666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:43.988613 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195ba98-e178-4d4a-aa24-53ba4a740666 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:43.988896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195ba98-e178-4d4a-aa24-53ba4a740666 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:43.989167 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195ba98-e178-4d4a-aa24-53ba4a740666 None admin] PATH_INFO: `/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:43.994972 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195ba98-e178-4d4a-aa24-53ba4a740666 None admin] RBAC: Authorizing `identity:get_project(project_id=b2061ddf744e4b65bc58158bbf9baf3c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:43.996471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195ba98-e178-4d4a-aa24-53ba4a740666 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:43.997572 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a66ec-817e-445c-8662-bc6bfdcb5e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:43.998254 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a66ec-817e-445c-8662-bc6bfdcb5e10 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:43.998563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a66ec-817e-445c-8662-bc6bfdcb5e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:43.998759 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 134/265] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:43 2022] GET /identity/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:43.999119 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a66ec-817e-445c-8662-bc6bfdcb5e10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:44.004819 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195ba98-e178-4d4a-aa24-53ba4a740666 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:44.025764 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:44.034221 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:44.086220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a66ec-817e-445c-8662-bc6bfdcb5e10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:44.088005 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a66ec-817e-445c-8662-bc6bfdcb5e10 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:44.149170 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195ba98-e178-4d4a-aa24-53ba4a740666 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:44.195002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd934eb-bc9d-4225-92bf-144541d29bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:44.195622 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd934eb-bc9d-4225-92bf-144541d29bfe None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:44.195899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd934eb-bc9d-4225-92bf-144541d29bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:44.196168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd934eb-bc9d-4225-92bf-144541d29bfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:44.196895 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd934eb-bc9d-4225-92bf-144541d29bfe None admin] RBAC: Adding query filter params (role.id=e905040849d04aadbb8da8b0d216c92c, scope.project.id=b2061ddf744e4b65bc58158bbf9baf3c, user.id=c7b77563f929411d9e5508e076f5a1e9) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:44.197200 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd934eb-bc9d-4225-92bf-144541d29bfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:44.198674 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd934eb-bc9d-4225-92bf-144541d29bfe None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:44.201606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 132/266] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:55:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:55:44.205550 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 135/267] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:55:44 2022] GET /identity/v3/role_assignments?user.id=c7b77563f929411d9e5508e076f5a1e9&scope.project.id=b2061ddf744e4b65bc58158bbf9baf3c&role.id=e905040849d04aadbb8da8b0d216c92c => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:55:44.207633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a66ec-817e-445c-8662-bc6bfdcb5e10 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:44.269371 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:44.318626 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a66ec-817e-445c-8662-bc6bfdcb5e10 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:44.355766 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e653335-fa86-47db-9fd9-7d1481d7549c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:44.357332 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e653335-fa86-47db-9fd9-7d1481d7549c None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:44.357915 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e653335-fa86-47db-9fd9-7d1481d7549c None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:44.358414 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e653335-fa86-47db-9fd9-7d1481d7549c None admin] PATH_INFO: `/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:44.359913 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e653335-fa86-47db-9fd9-7d1481d7549c None admin] RBAC: Authorizing `identity:get_project(project_id=b2061ddf744e4b65bc58158bbf9baf3c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:44.361718 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e653335-fa86-47db-9fd9-7d1481d7549c None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:44.364105 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 133/268] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:44 2022] GET /identity/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:44.370248 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd934eb-bc9d-4225-92bf-144541d29bfe None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:44.470756 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:44.500144 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd934eb-bc9d-4225-92bf-144541d29bfe None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:44.552554 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18e168-875b-4261-86f3-1d66023d3ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:44.553487 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18e168-875b-4261-86f3-1d66023d3ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:44.553979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18e168-875b-4261-86f3-1d66023d3ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:44.554468 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18e168-875b-4261-86f3-1d66023d3ff7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:44.555411 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18e168-875b-4261-86f3-1d66023d3ff7 None admin] RBAC: Adding query filter params (role.id=4e9a14889d764731b59323f764f1bb85, scope.project.id=b2061ddf744e4b65bc58158bbf9baf3c, user.id=c7b77563f929411d9e5508e076f5a1e9) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:44.555911 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18e168-875b-4261-86f3-1d66023d3ff7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:44.557694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18e168-875b-4261-86f3-1d66023d3ff7 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:44.564871 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 136/269] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:55:44 2022] GET /identity/v3/role_assignments?user.id=c7b77563f929411d9e5508e076f5a1e9&scope.project.id=b2061ddf744e4b65bc58158bbf9baf3c&role.id=4e9a14889d764731b59323f764f1bb85 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:44.609652 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc4127-df08-400d-94b2-007040bfc230 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:44.610265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc4127-df08-400d-94b2-007040bfc230 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:44.610828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc4127-df08-400d-94b2-007040bfc230 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:44.612353 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 134/270] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:44.617937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffb223-aa61-4c5e-8874-9d21d063f8f9 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:44.618533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffb223-aa61-4c5e-8874-9d21d063f8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:44.619001 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffb223-aa61-4c5e-8874-9d21d063f8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:44.639818 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-09ffb223-aa61-4c5e-8874-9d21d063f8f9 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:44.641464 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-09ffb223-aa61-4c5e-8874-9d21d063f8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:44.720779 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 137/271] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:45.009741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc4127-df08-400d-94b2-007040bfc230 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:45.138991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc4127-df08-400d-94b2-007040bfc230 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:45.165250 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:45.177591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe07c36-8c16-4bad-94ee-c91b3e9b602a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:45.179867 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269776b9-fc53-49da-ab00-77599f0b8d10 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:45.180294 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe07c36-8c16-4bad-94ee-c91b3e9b602a None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:45.180375 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269776b9-fc53-49da-ab00-77599f0b8d10 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:45.180477 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe07c36-8c16-4bad-94ee-c91b3e9b602a None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:45.180597 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269776b9-fc53-49da-ab00-77599f0b8d10 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:45.180690 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe07c36-8c16-4bad-94ee-c91b3e9b602a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:45.180762 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 138/272] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:45.186953 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb368d-cbb8-491b-81eb-46f657444203 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:45.187245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb368d-cbb8-491b-81eb-46f657444203 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:45.187523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb368d-cbb8-491b-81eb-46f657444203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:45.194763 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe07c36-8c16-4bad-94ee-c91b3e9b602a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:45.201261 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-dbe07c36-8c16-4bad-94ee-c91b3e9b602a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:55:45.201261 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:45.201261 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:45.201261 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:45.201261 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:45.201261 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:45.201261 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:45.201261 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:45.201261 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:45.201261 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:45.201261 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:45.201261 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:45.201261 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:45.201261 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:45.201261 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:45.201261 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:45.202138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:45.202138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:45.202138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:45.202138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:45.202138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:45.202138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:45.202138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:45.202138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:45.202138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:45.202138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:45.202138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:45.202138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:45.202138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:45.202138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:45.202138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:45.202138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:45.206542 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:45.206542 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:45.206542 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:45.206542 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:45.206542 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:45.206542 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:45.206542 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:45.206542 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:45.206542 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:45.206542 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:45.206542 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:55:45.206542 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:55:45.206542 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 135/273] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:45.208571 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe07c36-8c16-4bad-94ee-c91b3e9b602a None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:45.215965 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-3eeb368d-cbb8-491b-81eb-46f657444203 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:45.217570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-3eeb368d-cbb8-491b-81eb-46f657444203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:45.297969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 139/274] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:55:45.342655 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe07c36-8c16-4bad-94ee-c91b3e9b602a None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:45.378816 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa00ee-63d3-4912-a051-3b90bf74702f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:45.379428 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa00ee-63d3-4912-a051-3b90bf74702f None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:45.379711 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa00ee-63d3-4912-a051-3b90bf74702f None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:45.379985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa00ee-63d3-4912-a051-3b90bf74702f None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:45.380643 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa00ee-63d3-4912-a051-3b90bf74702f None admin] RBAC: Adding query filter params (name=member) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:45.380940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa00ee-63d3-4912-a051-3b90bf74702f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:45.382348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa00ee-63d3-4912-a051-3b90bf74702f None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:45.395537 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 136/275] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 23 07:55:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:55:45.399392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb368d-cbb8-491b-81eb-46f657444203 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:45.401941 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:45.503690 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb368d-cbb8-491b-81eb-46f657444203 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:45.539086 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e74f1-bdce-4ae8-934c-b059a8ebd254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:45.539729 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e74f1-bdce-4ae8-934c-b059a8ebd254 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:45.540067 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e74f1-bdce-4ae8-934c-b059a8ebd254 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:45.540287 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e74f1-bdce-4ae8-934c-b059a8ebd254 None admin] PATH_INFO: `/v3/users/758ccdc06c5d406899ec8ab2fa43c7a1` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:45.554363 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e74f1-bdce-4ae8-934c-b059a8ebd254 None admin] RBAC: Authorizing `identity:get_user(user_id=758ccdc06c5d406899ec8ab2fa43c7a1)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:45.555801 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e74f1-bdce-4ae8-934c-b059a8ebd254 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:45.562394 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 140/276] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:45 2022] GET /identity/v3/users/758ccdc06c5d406899ec8ab2fa43c7a1 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:45.564717 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa00ee-63d3-4912-a051-3b90bf74702f None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:45.568675 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2971f4e-8ea0-4a93-b4ea-1f301a204385 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:45.568956 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2971f4e-8ea0-4a93-b4ea-1f301a204385 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:45.569229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2971f4e-8ea0-4a93-b4ea-1f301a204385 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:45.571062 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 141/277] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:45.576884 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126eda2-7156-4765-82c8-5882661ee7f3 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:45.577172 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126eda2-7156-4765-82c8-5882661ee7f3 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:45.577436 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126eda2-7156-4765-82c8-5882661ee7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:45.595986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-8126eda2-7156-4765-82c8-5882661ee7f3 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:45.596973 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-8126eda2-7156-4765-82c8-5882661ee7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:45.618940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:45.664119 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:45.678338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 142/278] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:55:45.678338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126eda2-7156-4765-82c8-5882661ee7f3 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:45.682700 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa00ee-63d3-4912-a051-3b90bf74702f None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:45.725366 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16309570-9535-4ac0-b7c1-aa3529b46316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:45.726076 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16309570-9535-4ac0-b7c1-aa3529b46316 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:45.726458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16309570-9535-4ac0-b7c1-aa3529b46316 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:45.726808 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16309570-9535-4ac0-b7c1-aa3529b46316 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:45.727609 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16309570-9535-4ac0-b7c1-aa3529b46316 None admin] RBAC: Adding query filter params (role.id=4ed852223bc54be09a9487ff788b7644, user.id=758ccdc06c5d406899ec8ab2fa43c7a1, scope.system=all) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:45.727991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16309570-9535-4ac0-b7c1-aa3529b46316 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:45.729509 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16309570-9535-4ac0-b7c1-aa3529b46316 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:45.738432 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 137/279] 10.222.0.57 () {56 vars in 1308 bytes} [Tue Aug 23 07:55:45 2022] GET /identity/v3/role_assignments?user.id=758ccdc06c5d406899ec8ab2fa43c7a1&scope.system=all&role.id=4ed852223bc54be09a9487ff788b7644 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:45.806067 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126eda2-7156-4765-82c8-5882661ee7f3 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:45.846119 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df27566-1760-4a2c-91af-7575f85d1a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:45.847119 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df27566-1760-4a2c-91af-7575f85d1a36 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:45.847549 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df27566-1760-4a2c-91af-7575f85d1a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:45.848014 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df27566-1760-4a2c-91af-7575f85d1a36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:45.849463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df27566-1760-4a2c-91af-7575f85d1a36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:45.851217 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df27566-1760-4a2c-91af-7575f85d1a36 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:45.853310 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 143/280] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:55:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:45.860474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16309570-9535-4ac0-b7c1-aa3529b46316 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:45.950016 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df27566-1760-4a2c-91af-7575f85d1a36 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:45.973260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16309570-9535-4ac0-b7c1-aa3529b46316 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:45.983813 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:46.008253 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc6e08-15e8-42dc-9143-d03200c06784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:46.009092 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc6e08-15e8-42dc-9143-d03200c06784 None admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:46.009517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc6e08-15e8-42dc-9143-d03200c06784 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:46.009935 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc6e08-15e8-42dc-9143-d03200c06784 None admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:46.011225 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc6e08-15e8-42dc-9143-d03200c06784 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:46.013446 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc6e08-15e8-42dc-9143-d03200c06784 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:46.017820 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:46.060115 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df27566-1760-4a2c-91af-7575f85d1a36 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:46.094492 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cb284-23db-450b-88bb-ff82762d9997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:46.095126 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cb284-23db-450b-88bb-ff82762d9997 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:46.095409 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cb284-23db-450b-88bb-ff82762d9997 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:46.095684 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cb284-23db-450b-88bb-ff82762d9997 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:46.105782 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68cb284-23db-450b-88bb-ff82762d9997 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:46.111381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-f68cb284-23db-450b-88bb-ff82762d9997 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:55:46.111381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:46.111381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:46.111381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:46.111381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:46.111381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:46.111381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:46.111381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:46.111381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:46.111381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:46.111381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:46.111381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:46.111381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:46.111381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:46.111381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:46.111381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:46.112295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:46.112295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:46.112295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:46.112295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:46.112295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:46.112295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:46.112295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:46.112295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:46.112295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:46.112295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:46.112295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:46.112295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:46.112295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:46.112295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:46.112295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:46.112295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:46.113079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:46.113079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:46.113079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:46.113079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:46.113079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:46.113079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:46.113079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:46.113079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:46.113079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:46.113079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:46.113079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:55:46.113079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:55:46.113079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 144/281] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:55:46.113767 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b4e28-0722-47e5-8650-eb5e48b793a3 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:46.114172 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b4e28-0722-47e5-8650-eb5e48b793a3 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:46.114172 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b4e28-0722-47e5-8650-eb5e48b793a3 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:46.115490 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 145/282] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:46.119159 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b4e28-0722-47e5-8650-eb5e48b793a3 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:46.163137 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 138/283] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 23 07:55:45 2022] POST /identity/v3/users => generated 293 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:55:46.172344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f862fb-aabf-4409-b3fe-0ba428cbd9ee None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:46.172552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f862fb-aabf-4409-b3fe-0ba428cbd9ee None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:46.172835 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f862fb-aabf-4409-b3fe-0ba428cbd9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:46.199560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-08f862fb-aabf-4409-b3fe-0ba428cbd9ee None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:46.201842 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-08f862fb-aabf-4409-b3fe-0ba428cbd9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:46.238973 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b4e28-0722-47e5-8650-eb5e48b793a3 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:46.262810 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:46.286920 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61baa866-167d-467d-9227-9fff3ef4a6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:46.287744 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baa866-167d-467d-9227-9fff3ef4a6eb None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:46.288276 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baa866-167d-467d-9227-9fff3ef4a6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:46.288783 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baa866-167d-467d-9227-9fff3ef4a6eb None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:46.290818 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61baa866-167d-467d-9227-9fff3ef4a6eb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:46.291149 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61baa866-167d-467d-9227-9fff3ef4a6eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:46.293402 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61baa866-167d-467d-9227-9fff3ef4a6eb None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:46.300155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 139/284] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:46.312233 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 146/285] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 23 07:55:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:46.317838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f862fb-aabf-4409-b3fe-0ba428cbd9ee None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:46.425689 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:46.432383 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f862fb-aabf-4409-b3fe-0ba428cbd9ee None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:46.469423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c9d7e-748b-4cfe-83ab-2f57752e37cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:46.470070 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c9d7e-748b-4cfe-83ab-2f57752e37cd None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:46.470383 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c9d7e-748b-4cfe-83ab-2f57752e37cd None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:46.470665 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c9d7e-748b-4cfe-83ab-2f57752e37cd None admin] PATH_INFO: `/v3/users/7fc627e39b184aa4a634507961759484` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:46.471810 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c9d7e-748b-4cfe-83ab-2f57752e37cd None admin] RBAC: Authorizing `identity:get_user(user_id=7fc627e39b184aa4a634507961759484)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:46.473347 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c9d7e-748b-4cfe-83ab-2f57752e37cd None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:46.475466 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 140/286] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:46 2022] GET /identity/v3/users/7fc627e39b184aa4a634507961759484 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:55:46.482440 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61baa866-167d-467d-9227-9fff3ef4a6eb None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:46.597736 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c9d7e-748b-4cfe-83ab-2f57752e37cd None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:46.600956 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61baa866-167d-467d-9227-9fff3ef4a6eb None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:46.643524 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d546ee-7b74-4972-b08e-f86adddfb416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:46.644535 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d546ee-7b74-4972-b08e-f86adddfb416 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:46.645365 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d546ee-7b74-4972-b08e-f86adddfb416 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:46.646812 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d546ee-7b74-4972-b08e-f86adddfb416 None admin] PATH_INFO: `/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:46.648277 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d546ee-7b74-4972-b08e-f86adddfb416 None admin] RBAC: Authorizing `identity:get_project(project_id=b2061ddf744e4b65bc58158bbf9baf3c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:46.649962 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d546ee-7b74-4972-b08e-f86adddfb416 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:46.652957 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 147/287] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:46 2022] GET /identity/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:55:46.659073 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d546ee-7b74-4972-b08e-f86adddfb416 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:46.720314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c9d7e-748b-4cfe-83ab-2f57752e37cd None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:46.726096 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:46.774759 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede51e5-dd79-41aa-896b-8f9e0fdef08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:46.775398 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede51e5-dd79-41aa-896b-8f9e0fdef08a None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:46.775678 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede51e5-dd79-41aa-896b-8f9e0fdef08a None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:46.775949 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede51e5-dd79-41aa-896b-8f9e0fdef08a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:46.796230 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede51e5-dd79-41aa-896b-8f9e0fdef08a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:46.802402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-2ede51e5-dd79-41aa-896b-8f9e0fdef08a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:55:46.802402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:46.802402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:46.802402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:46.802402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:46.802402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:46.802402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:46.802402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:46.802402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:46.802402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:46.802402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:46.802402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:46.802402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:46.802402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:46.802402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:46.802402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:46.803269 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:46.803269 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:46.803269 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:46.803269 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:46.803269 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:46.803269 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:46.803269 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:46.803269 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:46.803269 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:46.803269 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:46.803269 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:46.803269 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:46.803269 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:46.803269 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:46.803269 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:46.803269 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:46.804058 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:46.804058 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:46.804058 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:46.804058 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:46.804058 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:46.804058 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:46.804058 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:46.804058 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:46.804058 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:46.804058 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:46.804058 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:55:46.804058 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:55:46.807180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 141/288] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:55:46.811165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede51e5-dd79-41aa-896b-8f9e0fdef08a None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:46.816696 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d546ee-7b74-4972-b08e-f86adddfb416 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:46.858625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:46.879645 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f87429-9d9d-4e59-a41a-9c9ccad53e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:46.880323 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f87429-9d9d-4e59-a41a-9c9ccad53e9c None admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:46.880601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f87429-9d9d-4e59-a41a-9c9ccad53e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:46.883895 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f87429-9d9d-4e59-a41a-9c9ccad53e9c None admin] PATH_INFO: `/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c/users/7fc627e39b184aa4a634507961759484/roles/530235f994134c70a0beaef3ed1b650c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:46.887675 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f87429-9d9d-4e59-a41a-9c9ccad53e9c None admin] RBAC: Authorizing `identity:create_grant(project_id=b2061ddf744e4b65bc58158bbf9baf3c, user_id=7fc627e39b184aa4a634507961759484, role_id=530235f994134c70a0beaef3ed1b650c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:46.889228 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f87429-9d9d-4e59-a41a-9c9ccad53e9c None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:46.950263 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede51e5-dd79-41aa-896b-8f9e0fdef08a None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:46.990579 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 148/289] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 23 07:55:46 2022] PUT /identity/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c/users/7fc627e39b184aa4a634507961759484/roles/530235f994134c70a0beaef3ed1b650c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 07:55:46.994264 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6fc1c7-0b8a-4a2e-9349-cd5ccd9b783d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:46.995173 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fc1c7-0b8a-4a2e-9349-cd5ccd9b783d None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:46.995598 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fc1c7-0b8a-4a2e-9349-cd5ccd9b783d None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:46.996029 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fc1c7-0b8a-4a2e-9349-cd5ccd9b783d None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:46.997536 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6fc1c7-0b8a-4a2e-9349-cd5ccd9b783d None admin] RBAC: Adding query filter params (name=member) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:46.998024 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6fc1c7-0b8a-4a2e-9349-cd5ccd9b783d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:46.999787 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6fc1c7-0b8a-4a2e-9349-cd5ccd9b783d None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:47.009576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 142/290] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 23 07:55:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:55:47.019495 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f87429-9d9d-4e59-a41a-9c9ccad53e9c None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:47.146757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f87429-9d9d-4e59-a41a-9c9ccad53e9c None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:47.158310 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:47.185498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed6cde-6c5d-4ef6-b40c-560693561d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:47.186182 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed6cde-6c5d-4ef6-b40c-560693561d3c None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:47.186548 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed6cde-6c5d-4ef6-b40c-560693561d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:47.186822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed6cde-6c5d-4ef6-b40c-560693561d3c None admin] PATH_INFO: `/v3/users/249f824c84e2452792e43faea2befe5b` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:47.187968 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed6cde-6c5d-4ef6-b40c-560693561d3c None admin] RBAC: Authorizing `identity:get_user(user_id=249f824c84e2452792e43faea2befe5b)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:47.189436 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed6cde-6c5d-4ef6-b40c-560693561d3c None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:47.191228 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 149/291] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:47 2022] GET /identity/v3/users/249f824c84e2452792e43faea2befe5b => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:47.197059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6fc1c7-0b8a-4a2e-9349-cd5ccd9b783d None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:47.304172 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:47.321894 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6fc1c7-0b8a-4a2e-9349-cd5ccd9b783d None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:47.364068 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e9cc6-4c74-4d28-8be2-0691744f59e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:47.364690 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e9cc6-4c74-4d28-8be2-0691744f59e7 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:47.364970 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e9cc6-4c74-4d28-8be2-0691744f59e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:47.365237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e9cc6-4c74-4d28-8be2-0691744f59e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:47.446925 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e9cc6-4c74-4d28-8be2-0691744f59e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:47.448321 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e9cc6-4c74-4d28-8be2-0691744f59e7 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:47.548491 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:47.569515 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 143/292] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:55:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:55:47.575990 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed6cde-6c5d-4ef6-b40c-560693561d3c None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:47.701320 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed6cde-6c5d-4ef6-b40c-560693561d3c None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:47.752861 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6cf65e-41e2-47e0-952e-fbf36c1f6abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:47.753555 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cf65e-41e2-47e0-952e-fbf36c1f6abd None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:47.753834 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cf65e-41e2-47e0-952e-fbf36c1f6abd None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:47.754106 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cf65e-41e2-47e0-952e-fbf36c1f6abd None admin] PATH_INFO: `/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:47.755264 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6cf65e-41e2-47e0-952e-fbf36c1f6abd None admin] RBAC: Authorizing `identity:get_project(project_id=b2061ddf744e4b65bc58158bbf9baf3c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:47.756705 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6cf65e-41e2-47e0-952e-fbf36c1f6abd None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:47.758343 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 150/293] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:47 2022] GET /identity/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:47.764315 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e9cc6-4c74-4d28-8be2-0691744f59e7 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:47.840021 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e61be-63a0-4901-9868-2af7a32318e3 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:47.840351 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e61be-63a0-4901-9868-2af7a32318e3 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:47.840579 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e61be-63a0-4901-9868-2af7a32318e3 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:47.846200 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 151/294] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:55:47.847694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bcc90-d919-4ed3-bf34-1fa71b103422 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:47.847979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bcc90-d919-4ed3-bf34-1fa71b103422 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:47.848361 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bcc90-d919-4ed3-bf34-1fa71b103422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:47.878134 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-af7bcc90-d919-4ed3-bf34-1fa71b103422 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:47.879408 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-af7bcc90-d919-4ed3-bf34-1fa71b103422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:47.889445 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e9cc6-4c74-4d28-8be2-0691744f59e7 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:47.954513 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53505e31-ab05-4943-9961-77507a96730d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:47.955085 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53505e31-ab05-4943-9961-77507a96730d None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:47.955372 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53505e31-ab05-4943-9961-77507a96730d None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:47.955657 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53505e31-ab05-4943-9961-77507a96730d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:47.956396 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53505e31-ab05-4943-9961-77507a96730d None admin] RBAC: Adding query filter params (role.id=4ed852223bc54be09a9487ff788b7644, scope.project.id=b2061ddf744e4b65bc58158bbf9baf3c, user.id=249f824c84e2452792e43faea2befe5b) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:47.956715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53505e31-ab05-4943-9961-77507a96730d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:47.958169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53505e31-ab05-4943-9961-77507a96730d None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:47.964598 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 144/295] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:55:47 2022] GET /identity/v3/role_assignments?user.id=249f824c84e2452792e43faea2befe5b&scope.project.id=b2061ddf744e4b65bc58158bbf9baf3c&role.id=4ed852223bc54be09a9487ff788b7644 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:47.970663 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:48.008746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 152/296] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:55:48.371614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53505e31-ab05-4943-9961-77507a96730d None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:48.426232 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:48.483142 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53505e31-ab05-4943-9961-77507a96730d None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:48.523852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02b98b-63c4-46c9-97ba-cfb73ffa6103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:48.524492 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02b98b-63c4-46c9-97ba-cfb73ffa6103 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:48.524772 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02b98b-63c4-46c9-97ba-cfb73ffa6103 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:48.525046 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02b98b-63c4-46c9-97ba-cfb73ffa6103 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:48.539654 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02b98b-63c4-46c9-97ba-cfb73ffa6103 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:48.545186 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-dd02b98b-63c4-46c9-97ba-cfb73ffa6103 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:55:48.545186 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:48.545186 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:48.545186 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:48.545186 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:48.545186 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:48.545186 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:48.545186 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:48.545186 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:48.545186 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:48.545186 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:48.545186 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:48.545186 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:48.545186 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:48.545186 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:48.545186 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:48.546087 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:48.546087 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:48.546087 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:48.546087 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:48.546087 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:48.546087 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:48.546087 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:48.546087 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:48.546087 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:48.546087 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:48.546087 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:48.546087 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:48.546087 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:48.546087 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:48.546087 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:48.546087 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:48.546918 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:48.546918 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:48.546918 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:48.546918 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:48.546918 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:48.546918 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:48.546918 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:48.546918 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:48.546918 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:48.546918 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:48.546918 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:55:48.546918 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:55:48.554080 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 145/297] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:48.555181 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bcc90-d919-4ed3-bf34-1fa71b103422 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:48.603524 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9af474-513f-43fc-9880-3e27d68c9dbe None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:48.604052 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9af474-513f-43fc-9880-3e27d68c9dbe None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:48.604415 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9af474-513f-43fc-9880-3e27d68c9dbe None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:48.605965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 146/298] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:55:48.612322 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dc7c0-3ef0-49a4-b52e-d05ef903aaee None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:48.612610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dc7c0-3ef0-49a4-b52e-d05ef903aaee None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:48.612893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dc7c0-3ef0-49a4-b52e-d05ef903aaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:48.635635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-c58dc7c0-3ef0-49a4-b52e-d05ef903aaee None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:48.638633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-c58dc7c0-3ef0-49a4-b52e-d05ef903aaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:48.681256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bcc90-d919-4ed3-bf34-1fa71b103422 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:48.722157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800ac45-e8ba-4964-89d7-0e4c4fee1dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:48.723208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800ac45-e8ba-4964-89d7-0e4c4fee1dbe None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:48.723712 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800ac45-e8ba-4964-89d7-0e4c4fee1dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:48.724185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800ac45-e8ba-4964-89d7-0e4c4fee1dbe None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:48.725231 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800ac45-e8ba-4964-89d7-0e4c4fee1dbe None admin] RBAC: Adding query filter params (name=member) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:48.725836 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800ac45-e8ba-4964-89d7-0e4c4fee1dbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:48.727451 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800ac45-e8ba-4964-89d7-0e4c4fee1dbe None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:48.734577 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 147/299] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:55:48.737932 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 153/300] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 23 07:55:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:48.743912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dc7c0-3ef0-49a4-b52e-d05ef903aaee None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:48.786100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:48.850256 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dc7c0-3ef0-49a4-b52e-d05ef903aaee None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:48.885853 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b57c40-24f4-4b75-b467-59d273b4ecf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:48.886870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b57c40-24f4-4b75-b467-59d273b4ecf8 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:48.887355 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b57c40-24f4-4b75-b467-59d273b4ecf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:48.888360 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b57c40-24f4-4b75-b467-59d273b4ecf8 None admin] PATH_INFO: `/v3/users/758ccdc06c5d406899ec8ab2fa43c7a1` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:48.889684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b57c40-24f4-4b75-b467-59d273b4ecf8 None admin] RBAC: Authorizing `identity:get_user(user_id=758ccdc06c5d406899ec8ab2fa43c7a1)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:48.891461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b57c40-24f4-4b75-b467-59d273b4ecf8 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:48.897994 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 148/301] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:48 2022] GET /identity/v3/users/758ccdc06c5d406899ec8ab2fa43c7a1 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:55:48.899551 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800ac45-e8ba-4964-89d7-0e4c4fee1dbe None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:48.938241 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:48.992591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7a7c3-432e-4429-9a53-02cb561b714c None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:48.992916 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7a7c3-432e-4429-9a53-02cb561b714c None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:48.993124 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7a7c3-432e-4429-9a53-02cb561b714c None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:48.994728 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 149/302] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:55:49.000050 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a62fee-d5cc-43ae-b8b0-85bf872a3e3d None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:49.000338 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a62fee-d5cc-43ae-b8b0-85bf872a3e3d None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:49.000614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a62fee-d5cc-43ae-b8b0-85bf872a3e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:49.011472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800ac45-e8ba-4964-89d7-0e4c4fee1dbe None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:49.021798 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-a3a62fee-d5cc-43ae-b8b0-85bf872a3e3d None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:49.023052 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a3a62fee-d5cc-43ae-b8b0-85bf872a3e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:49.054469 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e9ce2-d8a2-447e-9e01-706de46066ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:49.055121 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e9ce2-d8a2-447e-9e01-706de46066ed None admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:49.055406 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e9ce2-d8a2-447e-9e01-706de46066ed None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:49.055687 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e9ce2-d8a2-447e-9e01-706de46066ed None admin] PATH_INFO: `/v3/system/users/758ccdc06c5d406899ec8ab2fa43c7a1/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:49.057092 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e9ce2-d8a2-447e-9e01-706de46066ed None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=758ccdc06c5d406899ec8ab2fa43c7a1, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:49.058510 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e9ce2-d8a2-447e-9e01-706de46066ed None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:49.093058 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 150/303] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:55:49.095071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a62fee-d5cc-43ae-b8b0-85bf872a3e3d None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:49.130008 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:49.161788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 154/304] 10.222.0.57 () {58 vars in 1334 bytes} [Tue Aug 23 07:55:48 2022] PUT /identity/v3/system/users/758ccdc06c5d406899ec8ab2fa43c7a1/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:55:49.208338 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a62fee-d5cc-43ae-b8b0-85bf872a3e3d None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:49.251407 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c6da3-afc5-4677-84f3-92e490f5848c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:49.252475 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c6da3-afc5-4677-84f3-92e490f5848c None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:49.252953 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c6da3-afc5-4677-84f3-92e490f5848c None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:49.253471 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c6da3-afc5-4677-84f3-92e490f5848c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:49.266587 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c6da3-afc5-4677-84f3-92e490f5848c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:49.271900 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-db7c6da3-afc5-4677-84f3-92e490f5848c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:55:49.271900 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:49.271900 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:49.271900 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:49.271900 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:49.271900 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:49.271900 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:49.271900 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:49.271900 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:49.271900 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:49.271900 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:49.271900 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:49.271900 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:49.271900 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:49.271900 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:49.271900 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:49.272926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:49.272926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:49.272926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:49.272926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:49.272926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:49.272926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:49.272926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:49.272926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:49.272926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:49.272926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:49.272926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:49.272926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:49.272926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:49.272926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:49.272926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:49.272926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:49.273742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:49.273742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:49.273742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:49.273742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:49.273742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:49.273742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:49.273742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:49.273742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:49.273742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:49.273742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:49.273742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:55:49.273742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:55:49.276326 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 151/305] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:49.286452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e9ce2-d8a2-447e-9e01-706de46066ed None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:49.377712 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c6da3-afc5-4677-84f3-92e490f5848c None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:49.402125 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:49.407474 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e9ce2-d8a2-447e-9e01-706de46066ed None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:49.449644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db746197-5a5f-43df-ae62-c4b411084b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:49.450887 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db746197-5a5f-43df-ae62-c4b411084b8e None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:49.451390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db746197-5a5f-43df-ae62-c4b411084b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:49.452503 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db746197-5a5f-43df-ae62-c4b411084b8e None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:49.453637 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db746197-5a5f-43df-ae62-c4b411084b8e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:49.454207 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db746197-5a5f-43df-ae62-c4b411084b8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:49.457012 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db746197-5a5f-43df-ae62-c4b411084b8e None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:49.471048 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 155/306] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 23 07:55:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:49.478563 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db746197-5a5f-43df-ae62-c4b411084b8e None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:49.485459 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:49.491564 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c6da3-afc5-4677-84f3-92e490f5848c None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:49.527183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c25f12-2a51-4993-b5c1-0f25c7ff94c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:49.527816 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c25f12-2a51-4993-b5c1-0f25c7ff94c6 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:49.528838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c25f12-2a51-4993-b5c1-0f25c7ff94c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:49.529117 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c25f12-2a51-4993-b5c1-0f25c7ff94c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:49.530242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c25f12-2a51-4993-b5c1-0f25c7ff94c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:49.531723 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c25f12-2a51-4993-b5c1-0f25c7ff94c6 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:49.538340 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 152/307] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:55:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:55:49.540091 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c25f12-2a51-4993-b5c1-0f25c7ff94c6 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:49.624347 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db746197-5a5f-43df-ae62-c4b411084b8e None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:49.644073 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c25f12-2a51-4993-b5c1-0f25c7ff94c6 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:49.670635 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48119826-b0fd-4094-a236-19fab7b6f0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:49.671585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48119826-b0fd-4094-a236-19fab7b6f0b2 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:49.671867 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48119826-b0fd-4094-a236-19fab7b6f0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:49.672140 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48119826-b0fd-4094-a236-19fab7b6f0b2 None admin] PATH_INFO: `/v3/users/1120f6ab08ed4cf8aeedb3f490f77710` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:49.687008 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48119826-b0fd-4094-a236-19fab7b6f0b2 None admin] RBAC: Authorizing `identity:get_user(user_id=1120f6ab08ed4cf8aeedb3f490f77710)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:49.688210 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87a53a-30c0-4b21-8f46-94a1b74d2a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:49.688467 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48119826-b0fd-4094-a236-19fab7b6f0b2 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:49.689261 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87a53a-30c0-4b21-8f46-94a1b74d2a8c None admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:49.689732 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87a53a-30c0-4b21-8f46-94a1b74d2a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:49.690208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87a53a-30c0-4b21-8f46-94a1b74d2a8c None admin] PATH_INFO: `/v3/groups` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:49.690439 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 156/308] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:49 2022] GET /identity/v3/users/1120f6ab08ed4cf8aeedb3f490f77710 => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:49.691235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87a53a-30c0-4b21-8f46-94a1b74d2a8c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:49.691647 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244b074-839e-499e-9d87-8625e43a01c5 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:49.691932 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244b074-839e-499e-9d87-8625e43a01c5 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:49.692205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244b074-839e-499e-9d87-8625e43a01c5 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:49.693478 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87a53a-30c0-4b21-8f46-94a1b74d2a8c None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:49.693643 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 157/309] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:49.696840 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244b074-839e-499e-9d87-8625e43a01c5 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:49.718605 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:49.775858 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 153/310] 10.222.0.57 () {60 vars in 1134 bytes} [Tue Aug 23 07:55:49 2022] POST /identity/v3/groups => generated 229 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:55:49.777358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6ab1d-b279-498b-9abf-52d5a406b4a5 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:49.777642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6ab1d-b279-498b-9abf-52d5a406b4a5 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:49.777913 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6ab1d-b279-498b-9abf-52d5a406b4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:49.803309 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244b074-839e-499e-9d87-8625e43a01c5 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:49.808705 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-7bd6ab1d-b279-498b-9abf-52d5a406b4a5 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:49.811083 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-7bd6ab1d-b279-498b-9abf-52d5a406b4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:49.837095 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:49.844539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce672d4f-7349-4fe7-a7cb-e73937037d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:49.845434 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce672d4f-7349-4fe7-a7cb-e73937037d34 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:49.845917 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce672d4f-7349-4fe7-a7cb-e73937037d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:49.846426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce672d4f-7349-4fe7-a7cb-e73937037d34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:49.847554 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce672d4f-7349-4fe7-a7cb-e73937037d34 None admin] RBAC: Adding query filter params (role.id=530235f994134c70a0beaef3ed1b650c, user.id=1120f6ab08ed4cf8aeedb3f490f77710, scope.system=all) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:49.847871 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce672d4f-7349-4fe7-a7cb-e73937037d34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:49.849364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce672d4f-7349-4fe7-a7cb-e73937037d34 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:49.855030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 158/311] 10.222.0.57 () {56 vars in 1308 bytes} [Tue Aug 23 07:55:49 2022] GET /identity/v3/role_assignments?user.id=1120f6ab08ed4cf8aeedb3f490f77710&scope.system=all&role.id=530235f994134c70a0beaef3ed1b650c => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:55:49.904694 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 154/312] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:50.178793 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce672d4f-7349-4fe7-a7cb-e73937037d34 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:50.267937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:50.284983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce672d4f-7349-4fe7-a7cb-e73937037d34 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:50.321837 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d06800-e21d-4e83-8cfe-5ca2ec8556e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:50.322861 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d06800-e21d-4e83-8cfe-5ca2ec8556e2 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:50.323563 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d06800-e21d-4e83-8cfe-5ca2ec8556e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:50.324308 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d06800-e21d-4e83-8cfe-5ca2ec8556e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:50.340859 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d06800-e21d-4e83-8cfe-5ca2ec8556e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:50.345694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-34d06800-e21d-4e83-8cfe-5ca2ec8556e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:55:50.345694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:50.345694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:50.345694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:50.345694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:50.345694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:50.345694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:50.345694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:50.345694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:50.345694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:50.345694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:50.345694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:50.345694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:50.345694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:50.345694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:50.345694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:50.346587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:50.346587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:50.346587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:50.346587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:50.346587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:50.346587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:50.346587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:50.346587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:50.346587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:50.346587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:50.346587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:50.346587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:50.346587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:50.346587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:50.346587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:50.346587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:50.347352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:50.347352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:50.347352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:50.347352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:50.347352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:50.347352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:50.347352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:50.347352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:50.347352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:50.347352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:50.347352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:55:50.347352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:55:50.347352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 159/313] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:50.352616 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6ab1d-b279-498b-9abf-52d5a406b4a5 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:50.460418 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6ab1d-b279-498b-9abf-52d5a406b4a5 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:50.497731 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34bce1-69cf-46d9-9da0-22d153bd4075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:50.498364 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34bce1-69cf-46d9-9da0-22d153bd4075 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:50.498649 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34bce1-69cf-46d9-9da0-22d153bd4075 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:50.498922 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34bce1-69cf-46d9-9da0-22d153bd4075 None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:50.499579 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34bce1-69cf-46d9-9da0-22d153bd4075 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:50.499879 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34bce1-69cf-46d9-9da0-22d153bd4075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:50.501259 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34bce1-69cf-46d9-9da0-22d153bd4075 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:50.509457 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 155/314] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 23 07:55:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:50.515690 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d06800-e21d-4e83-8cfe-5ca2ec8556e2 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:50.624255 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d06800-e21d-4e83-8cfe-5ca2ec8556e2 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:50.664335 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b03d32-e7ae-489a-9e5d-232511bc2092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:50.665289 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b03d32-e7ae-489a-9e5d-232511bc2092 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:50.665787 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b03d32-e7ae-489a-9e5d-232511bc2092 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:50.666251 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b03d32-e7ae-489a-9e5d-232511bc2092 None admin] PATH_INFO: `/v3/users/7fc627e39b184aa4a634507961759484` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:50.667621 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b03d32-e7ae-489a-9e5d-232511bc2092 None admin] RBAC: Authorizing `identity:get_user(user_id=7fc627e39b184aa4a634507961759484)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:50.669503 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b03d32-e7ae-489a-9e5d-232511bc2092 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:50.671655 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 160/315] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:50 2022] GET /identity/v3/users/7fc627e39b184aa4a634507961759484 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:50.677143 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34bce1-69cf-46d9-9da0-22d153bd4075 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:50.697167 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:50.793078 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34bce1-69cf-46d9-9da0-22d153bd4075 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:50.828293 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ee0f1-269f-42a4-bbbd-f0887aa11daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:50.828905 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ee0f1-269f-42a4-bbbd-f0887aa11daf None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:50.829187 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ee0f1-269f-42a4-bbbd-f0887aa11daf None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:50.829462 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ee0f1-269f-42a4-bbbd-f0887aa11daf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:50.899881 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ee0f1-269f-42a4-bbbd-f0887aa11daf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:50.901355 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ee0f1-269f-42a4-bbbd-f0887aa11daf None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:50.927037 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:51.011314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 156/316] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:55:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:55:51.018474 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b03d32-e7ae-489a-9e5d-232511bc2092 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:51.040829 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:51.140290 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b03d32-e7ae-489a-9e5d-232511bc2092 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:51.174337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685f47d-20c4-4582-b44b-23bd22f0992a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:51.174971 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685f47d-20c4-4582-b44b-23bd22f0992a None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:51.175251 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685f47d-20c4-4582-b44b-23bd22f0992a None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:51.175528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685f47d-20c4-4582-b44b-23bd22f0992a None admin] PATH_INFO: `/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:51.176652 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685f47d-20c4-4582-b44b-23bd22f0992a None admin] RBAC: Authorizing `identity:get_project(project_id=b2061ddf744e4b65bc58158bbf9baf3c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:51.178103 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685f47d-20c4-4582-b44b-23bd22f0992a None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:51.180122 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 161/317] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:51 2022] GET /identity/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:51.187377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ee0f1-269f-42a4-bbbd-f0887aa11daf None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:51.214608 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45ffa9-e0fe-425b-b6d9-9447d88ae0af None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:51.214901 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45ffa9-e0fe-425b-b6d9-9447d88ae0af None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:51.215162 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45ffa9-e0fe-425b-b6d9-9447d88ae0af None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:51.217150 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 162/318] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:51.222068 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44826a72-0456-4b4d-adf1-6acc39d0151f None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:51.222377 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44826a72-0456-4b4d-adf1-6acc39d0151f None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:51.222655 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44826a72-0456-4b4d-adf1-6acc39d0151f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:51.241831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-44826a72-0456-4b4d-adf1-6acc39d0151f None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:51.243055 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-44826a72-0456-4b4d-adf1-6acc39d0151f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:51.295499 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ee0f1-269f-42a4-bbbd-f0887aa11daf None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:51.313388 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:51.319360 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 163/319] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:55:51.333857 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b9f96-e614-4153-aee6-0276f31e849e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:51.334829 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b9f96-e614-4153-aee6-0276f31e849e None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:51.335338 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b9f96-e614-4153-aee6-0276f31e849e None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:51.335836 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b9f96-e614-4153-aee6-0276f31e849e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:51.336812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b9f96-e614-4153-aee6-0276f31e849e None admin] RBAC: Adding query filter params (role.id=530235f994134c70a0beaef3ed1b650c, scope.project.id=b2061ddf744e4b65bc58158bbf9baf3c, user.id=7fc627e39b184aa4a634507961759484) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:51.337327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b9f96-e614-4153-aee6-0276f31e849e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:51.339072 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b9f96-e614-4153-aee6-0276f31e849e None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:51.351138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 157/320] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:55:51 2022] GET /identity/v3/role_assignments?user.id=7fc627e39b184aa4a634507961759484&scope.project.id=b2061ddf744e4b65bc58158bbf9baf3c&role.id=530235f994134c70a0beaef3ed1b650c => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:51.603585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44826a72-0456-4b4d-adf1-6acc39d0151f None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:51.615749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:51.710644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44826a72-0456-4b4d-adf1-6acc39d0151f None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:51.751888 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb742db-a823-43dc-baed-0a29a1c67d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:51.752523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb742db-a823-43dc-baed-0a29a1c67d75 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:51.752818 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb742db-a823-43dc-baed-0a29a1c67d75 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:51.753080 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb742db-a823-43dc-baed-0a29a1c67d75 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:51.763723 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb742db-a823-43dc-baed-0a29a1c67d75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:51.768522 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-7bb742db-a823-43dc-baed-0a29a1c67d75 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:55:51.768522 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:51.768522 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:51.768522 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:51.768522 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:51.768522 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:51.768522 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:51.768522 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:51.768522 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:51.768522 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:51.768522 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:51.768522 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:51.768522 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:51.768522 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:51.768522 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:51.768522 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:51.769397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:51.769397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:51.769397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:51.769397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:51.769397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:51.769397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:51.769397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:51.769397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:51.769397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:51.769397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:51.769397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:51.769397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:51.769397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:51.769397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:51.769397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:51.769397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:51.770174 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:51.770174 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:51.770174 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:51.770174 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:51.770174 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:51.770174 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:51.770174 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:51.770174 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:51.770174 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:51.770174 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:51.770174 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:55:51.770174 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:55:51.770174 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 164/321] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:51.776053 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b9f96-e614-4153-aee6-0276f31e849e None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:51.860706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef43c74-b6fc-4f97-845c-8e208fedcfdd None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:51.860903 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef43c74-b6fc-4f97-845c-8e208fedcfdd None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:51.861165 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef43c74-b6fc-4f97-845c-8e208fedcfdd None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:51.862691 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 165/322] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:55:51.867524 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bcb42-833b-4d1b-a626-427abb3ec55e None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:51.867808 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bcb42-833b-4d1b-a626-427abb3ec55e None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:51.868081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bcb42-833b-4d1b-a626-427abb3ec55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:51.881799 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b9f96-e614-4153-aee6-0276f31e849e None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:51.886641 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-072bcb42-833b-4d1b-a626-427abb3ec55e None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:51.888058 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-072bcb42-833b-4d1b-a626-427abb3ec55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:51.914354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e7c34-5104-4771-a49a-8cd041487a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:51.914960 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e7c34-5104-4771-a49a-8cd041487a6c None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:51.915240 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e7c34-5104-4771-a49a-8cd041487a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:51.915516 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e7c34-5104-4771-a49a-8cd041487a6c None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:51.916171 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e7c34-5104-4771-a49a-8cd041487a6c None admin] RBAC: Adding query filter params (name=member) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:51.916472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e7c34-5104-4771-a49a-8cd041487a6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:51.917844 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e7c34-5104-4771-a49a-8cd041487a6c None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:51.926231 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 158/323] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 23 07:55:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:55:51.927479 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df894c9-a14c-43ee-8934-e8c2803cb5aa None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:51.927990 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df894c9-a14c-43ee-8934-e8c2803cb5aa None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:51.928094 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df894c9-a14c-43ee-8934-e8c2803cb5aa None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:51.929357 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 159/324] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:51.931497 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df894c9-a14c-43ee-8934-e8c2803cb5aa None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:51.951203 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:51.955589 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 166/325] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:55:51.959707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddedce7-7bc1-414f-8325-3d31a73ea645 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:51.960326 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddedce7-7bc1-414f-8325-3d31a73ea645 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:51.964946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddedce7-7bc1-414f-8325-3d31a73ea645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:51.977090 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:51.978315 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-cddedce7-7bc1-414f-8325-3d31a73ea645 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:51.979444 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-cddedce7-7bc1-414f-8325-3d31a73ea645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:52.036783 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df894c9-a14c-43ee-8934-e8c2803cb5aa None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:52.047922 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 167/326] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:52.083395 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6535b-6870-4301-bfa3-a2c6eb2b7b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:52.084034 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6535b-6870-4301-bfa3-a2c6eb2b7b45 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:52.084316 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6535b-6870-4301-bfa3-a2c6eb2b7b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:52.084587 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6535b-6870-4301-bfa3-a2c6eb2b7b45 None admin] PATH_INFO: `/v3/users/758ccdc06c5d406899ec8ab2fa43c7a1` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:52.085695 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6535b-6870-4301-bfa3-a2c6eb2b7b45 None admin] RBAC: Authorizing `identity:get_user(user_id=758ccdc06c5d406899ec8ab2fa43c7a1)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:52.087183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6535b-6870-4301-bfa3-a2c6eb2b7b45 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:52.094072 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 160/327] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:51 2022] GET /identity/v3/users/758ccdc06c5d406899ec8ab2fa43c7a1 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:55:52.095253 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddedce7-7bc1-414f-8325-3d31a73ea645 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:52.196727 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddedce7-7bc1-414f-8325-3d31a73ea645 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:52.224083 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6535b-6870-4301-bfa3-a2c6eb2b7b45 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:52.225748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:52.232749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f6a3c-14e1-4b1d-a326-df3d254ec9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:52.233368 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f6a3c-14e1-4b1d-a326-df3d254ec9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:52.233679 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f6a3c-14e1-4b1d-a326-df3d254ec9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:52.233919 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f6a3c-14e1-4b1d-a326-df3d254ec9b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:52.239293 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f6a3c-14e1-4b1d-a326-df3d254ec9b6 None admin] RBAC: Adding query filter params (role.id=4ed852223bc54be09a9487ff788b7644, user.id=758ccdc06c5d406899ec8ab2fa43c7a1, scope.system=all) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:52.239293 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f6a3c-14e1-4b1d-a326-df3d254ec9b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:52.239293 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f6a3c-14e1-4b1d-a326-df3d254ec9b6 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:52.254133 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 168/328] 10.222.0.57 () {56 vars in 1308 bytes} [Tue Aug 23 07:55:52 2022] GET /identity/v3/role_assignments?user.id=758ccdc06c5d406899ec8ab2fa43c7a1&scope.system=all&role.id=4ed852223bc54be09a9487ff788b7644 => generated 510 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:52.341210 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6535b-6870-4301-bfa3-a2c6eb2b7b45 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:52.345295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f6a3c-14e1-4b1d-a326-df3d254ec9b6 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:52.352513 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:52.380200 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733f981-2819-4b6e-8167-3ea2905385ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:52.380847 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733f981-2819-4b6e-8167-3ea2905385ac None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:52.381130 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733f981-2819-4b6e-8167-3ea2905385ac None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:52.381398 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733f981-2819-4b6e-8167-3ea2905385ac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:52.392672 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733f981-2819-4b6e-8167-3ea2905385ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:52.397449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-2733f981-2819-4b6e-8167-3ea2905385ac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:55:52.397449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:52.397449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:52.397449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:52.397449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:52.397449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:52.397449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:52.397449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:52.397449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:52.397449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:52.397449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:52.397449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:52.397449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:52.397449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:52.397449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:52.397449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:52.400336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:52.400336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:52.400336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:52.400336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:52.400336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:52.400336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:52.400336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:52.400336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:52.400336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:52.400336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:52.400336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:52.400336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:52.400336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:52.400336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:52.400336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:52.400336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:52.401136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:52.401136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:52.401136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:52.401136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:52.401136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:52.401136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:52.401136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:52.401136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:52.401136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:52.401136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:52.401136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:55:52.401136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:55:52.401136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 161/329] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:55:52.406487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733f981-2819-4b6e-8167-3ea2905385ac None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:52.477642 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f6a3c-14e1-4b1d-a326-df3d254ec9b6 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:52.511803 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65727ecd-9fcd-4cb2-8445-0ed9f6883423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:52.513152 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65727ecd-9fcd-4cb2-8445-0ed9f6883423 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:52.513440 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65727ecd-9fcd-4cb2-8445-0ed9f6883423 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:52.513719 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65727ecd-9fcd-4cb2-8445-0ed9f6883423 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:52.514845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65727ecd-9fcd-4cb2-8445-0ed9f6883423 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:52.516286 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65727ecd-9fcd-4cb2-8445-0ed9f6883423 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:52.517848 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 169/330] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:55:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:55:52.519335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733f981-2819-4b6e-8167-3ea2905385ac None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:52.523526 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65727ecd-9fcd-4cb2-8445-0ed9f6883423 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:52.553060 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59473fec-5ea0-4bba-8f03-6eedfd1914ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:52.553671 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59473fec-5ea0-4bba-8f03-6eedfd1914ae None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:52.553952 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59473fec-5ea0-4bba-8f03-6eedfd1914ae None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:52.554235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59473fec-5ea0-4bba-8f03-6eedfd1914ae None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:52.554925 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59473fec-5ea0-4bba-8f03-6eedfd1914ae None admin] RBAC: Adding query filter params (name=reader) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:52.555223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59473fec-5ea0-4bba-8f03-6eedfd1914ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:52.556605 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59473fec-5ea0-4bba-8f03-6eedfd1914ae None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:52.564526 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 162/331] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 23 07:55:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:55:52.570064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59473fec-5ea0-4bba-8f03-6eedfd1914ae None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:52.579940 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:52.600732 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:52.624542 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65727ecd-9fcd-4cb2-8445-0ed9f6883423 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:52.659679 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2649a0-aab8-4834-bc66-eeaca358e704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:52.660286 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2649a0-aab8-4834-bc66-eeaca358e704 None admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:52.660567 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2649a0-aab8-4834-bc66-eeaca358e704 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:52.660839 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2649a0-aab8-4834-bc66-eeaca358e704 None admin] PATH_INFO: `/v3/groups` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:52.661456 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2649a0-aab8-4834-bc66-eeaca358e704 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:52.662999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2649a0-aab8-4834-bc66-eeaca358e704 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:52.670311 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59473fec-5ea0-4bba-8f03-6eedfd1914ae None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:52.703963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916768c9-1715-4860-b947-a62e747c61ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:52.704584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916768c9-1715-4860-b947-a62e747c61ed None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:52.704866 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916768c9-1715-4860-b947-a62e747c61ed None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:52.705142 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916768c9-1715-4860-b947-a62e747c61ed None admin] PATH_INFO: `/v3/users/1120f6ab08ed4cf8aeedb3f490f77710` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:52.706253 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916768c9-1715-4860-b947-a62e747c61ed None admin] RBAC: Authorizing `identity:get_user(user_id=1120f6ab08ed4cf8aeedb3f490f77710)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:52.707741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916768c9-1715-4860-b947-a62e747c61ed None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:52.709311 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 163/332] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:52 2022] GET /identity/v3/users/1120f6ab08ed4cf8aeedb3f490f77710 => generated 293 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:52.714918 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916768c9-1715-4860-b947-a62e747c61ed None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:52.755501 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 170/333] 10.222.0.57 () {60 vars in 1134 bytes} [Tue Aug 23 07:55:52 2022] POST /identity/v3/groups => generated 226 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 07:55:52.816578 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:52.819706 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916768c9-1715-4860-b947-a62e747c61ed None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:52.856273 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c4bc4-37c0-4c5a-8884-d3e54ca5e421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:52.856947 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c4bc4-37c0-4c5a-8884-d3e54ca5e421 None admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:52.857219 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c4bc4-37c0-4c5a-8884-d3e54ca5e421 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:52.857489 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c4bc4-37c0-4c5a-8884-d3e54ca5e421 None admin] PATH_INFO: `/v3/system/users/1120f6ab08ed4cf8aeedb3f490f77710/roles/530235f994134c70a0beaef3ed1b650c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:52.858970 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c4bc4-37c0-4c5a-8884-d3e54ca5e421 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1120f6ab08ed4cf8aeedb3f490f77710, role_id=530235f994134c70a0beaef3ed1b650c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:52.860375 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c4bc4-37c0-4c5a-8884-d3e54ca5e421 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:52.952438 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 164/334] 10.222.0.57 () {58 vars in 1334 bytes} [Tue Aug 23 07:55:52 2022] PUT /identity/v3/system/users/1120f6ab08ed4cf8aeedb3f490f77710/roles/530235f994134c70a0beaef3ed1b650c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 07:55:55.003298 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857d728-3a4d-4e28-90c1-3f0c4dab3762 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:55.004339 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857d728-3a4d-4e28-90c1-3f0c4dab3762 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:55.004824 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857d728-3a4d-4e28-90c1-3f0c4dab3762 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:55.006679 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 171/335] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:55.019919 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2438ca-9a51-4766-b3c0-875ec7073bcf None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:55.020836 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2438ca-9a51-4766-b3c0-875ec7073bcf None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:55.021333 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2438ca-9a51-4766-b3c0-875ec7073bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:55.047285 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-9d2438ca-9a51-4766-b3c0-875ec7073bcf None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:55.048824 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-9d2438ca-9a51-4766-b3c0-875ec7073bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:55.130713 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 165/336] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:55.294368 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ceb5a-b9c1-47db-932b-8523dbeb4de1 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:55.295000 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ceb5a-b9c1-47db-932b-8523dbeb4de1 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:55.295473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ceb5a-b9c1-47db-932b-8523dbeb4de1 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:55.297257 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 172/337] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:55.303225 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ad9e6-68d4-4e5a-89b3-ea987be4cb95 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:55.303770 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ad9e6-68d4-4e5a-89b3-ea987be4cb95 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:55.304244 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ad9e6-68d4-4e5a-89b3-ea987be4cb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:55.331291 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-b25ad9e6-68d4-4e5a-89b3-ea987be4cb95 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:55.332843 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-b25ad9e6-68d4-4e5a-89b3-ea987be4cb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:55.371071 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c871d-8d47-4da2-b553-330123fe1df9 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:55.371396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c871d-8d47-4da2-b553-330123fe1df9 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:55.372410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c871d-8d47-4da2-b553-330123fe1df9 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:55.373717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 173/338] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:55.378727 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb4379-93fc-4db6-aa60-11cc3bb36702 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:55.379011 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb4379-93fc-4db6-aa60-11cc3bb36702 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:55.379307 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb4379-93fc-4db6-aa60-11cc3bb36702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:55.411652 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-c3fb4379-93fc-4db6-aa60-11cc3bb36702 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:55.413115 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c3fb4379-93fc-4db6-aa60-11cc3bb36702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:55.448231 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 166/339] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:55:55.527312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 174/340] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:55.698023 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ad9e6-68d4-4e5a-89b3-ea987be4cb95 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:55.729009 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:55.816935 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb4379-93fc-4db6-aa60-11cc3bb36702 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:55.817120 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ad9e6-68d4-4e5a-89b3-ea987be4cb95 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:55.866485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37b803-3dfa-4325-a47f-f7822739c71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:55.867131 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37b803-3dfa-4325-a47f-f7822739c71e None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:55.867416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37b803-3dfa-4325-a47f-f7822739c71e None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:55.867701 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37b803-3dfa-4325-a47f-f7822739c71e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:55.884472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37b803-3dfa-4325-a47f-f7822739c71e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:55.889999 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-0d37b803-3dfa-4325-a47f-f7822739c71e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:55:55.889999 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:55.889999 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:55.889999 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:55.889999 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:55.889999 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:55.889999 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:55.889999 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:55.889999 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:55.889999 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:55.889999 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:55.889999 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:55.889999 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:55.889999 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:55.889999 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:55.889999 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:55.892791 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:55.892791 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:55.892791 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:55.892791 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:55.892791 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:55.892791 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:55.892791 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:55.892791 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:55.892791 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:55.892791 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:55.892791 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:55.892791 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:55.892791 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:55.892791 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:55.892791 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:55.892791 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:55.893921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:55.893921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:55.893921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:55.893921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:55.893921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:55.893921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:55.893921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:55.893921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:55.893921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:55.893921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:55.893921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:55:55.893921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:55:55.897098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 167/341] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:55.898011 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37b803-3dfa-4325-a47f-f7822739c71e None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:55.926513 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:56.001129 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb4379-93fc-4db6-aa60-11cc3bb36702 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:56.041517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31e723-b1bf-45b8-9fce-5241ea1f1ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:56.042273 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31e723-b1bf-45b8-9fce-5241ea1f1ddc None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:56.042496 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31e723-b1bf-45b8-9fce-5241ea1f1ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:56.042743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31e723-b1bf-45b8-9fce-5241ea1f1ddc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:56.053483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:56.064386 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31e723-b1bf-45b8-9fce-5241ea1f1ddc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:56.069502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-5d31e723-b1bf-45b8-9fce-5241ea1f1ddc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:55:56.069502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:56.069502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:56.069502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:56.069502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:56.069502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:56.069502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:56.069502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:56.069502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:56.069502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:56.069502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:56.069502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:56.069502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:56.069502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:56.069502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:56.069502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:56.070701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:56.070701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:56.070701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:56.070701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:56.070701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:56.070701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:56.070701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:56.070701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:56.070701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:56.070701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:56.070701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:56.070701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:56.070701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:56.070701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:56.070701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:56.070701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:56.075648 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:56.075648 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:56.075648 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:56.075648 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:56.075648 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:56.075648 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:56.075648 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:56.075648 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:56.075648 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:56.075648 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:56.075648 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:55:56.075648 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:55:56.075648 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 175/342] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:56.075648 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0bc4e-2781-4954-9979-bf63c33c5deb None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:56.076380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0bc4e-2781-4954-9979-bf63c33c5deb None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:56.076380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0bc4e-2781-4954-9979-bf63c33c5deb None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:56.076380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 176/343] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:56.076380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0bc4e-2781-4954-9979-bf63c33c5deb None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:56.092481 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37b803-3dfa-4325-a47f-f7822739c71e None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:56.129551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa42c4-3146-4a8e-94d6-a771273d8685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:56.130167 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa42c4-3146-4a8e-94d6-a771273d8685 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:56.130478 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa42c4-3146-4a8e-94d6-a771273d8685 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:56.130759 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa42c4-3146-4a8e-94d6-a771273d8685 None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:56.132271 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa42c4-3146-4a8e-94d6-a771273d8685 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:56.132581 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa42c4-3146-4a8e-94d6-a771273d8685 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:56.133980 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa42c4-3146-4a8e-94d6-a771273d8685 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:56.145910 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 168/344] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 23 07:55:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:56.147196 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27473858-e687-42fe-961d-23b62c4fa677 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:56.147482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27473858-e687-42fe-961d-23b62c4fa677 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:56.147750 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27473858-e687-42fe-961d-23b62c4fa677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:56.172515 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-27473858-e687-42fe-961d-23b62c4fa677 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:56.174028 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-27473858-e687-42fe-961d-23b62c4fa677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:56.219210 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0bc4e-2781-4954-9979-bf63c33c5deb None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:56.227327 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:56.245355 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 169/345] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:56.246638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27473858-e687-42fe-961d-23b62c4fa677 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:56.259329 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751138c-139b-4a78-af56-89c29b4ac339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:56.260073 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751138c-139b-4a78-af56-89c29b4ac339 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:56.260445 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751138c-139b-4a78-af56-89c29b4ac339 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:56.260816 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751138c-139b-4a78-af56-89c29b4ac339 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:56.272917 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751138c-139b-4a78-af56-89c29b4ac339 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:56.278716 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-5751138c-139b-4a78-af56-89c29b4ac339 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:55:56.278716 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:56.278716 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:56.278716 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:56.278716 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:56.278716 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:56.278716 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:56.278716 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:56.278716 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:56.278716 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:56.278716 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:56.278716 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:56.278716 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:56.278716 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:56.278716 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:56.278716 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:56.279707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:56.279707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:56.279707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:56.279707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:56.279707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:56.279707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:56.279707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:56.279707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:56.279707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:56.279707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:56.279707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:56.279707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:56.279707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:56.279707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:56.279707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:56.279707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:56.280653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:56.280653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:56.280653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:56.280653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:56.280653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:56.280653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:56.280653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:56.280653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:56.280653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:56.280653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:56.280653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:55:56.280653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:55:56.280653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 177/346] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 23 07:55:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:56.281499 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751138c-139b-4a78-af56-89c29b4ac339 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:56.348124 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:56.377976 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27473858-e687-42fe-961d-23b62c4fa677 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:56.396640 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751138c-139b-4a78-af56-89c29b4ac339 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:56.434000 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0a768-e700-4963-a4f3-661865cb10ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:56.435035 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0a768-e700-4963-a4f3-661865cb10ad None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:56.435493 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0a768-e700-4963-a4f3-661865cb10ad None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:56.435688 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce7417-b149-46bc-9e79-dfa49b3f9338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:56.436074 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0a768-e700-4963-a4f3-661865cb10ad None admin] PATH_INFO: `/v3/users/1120f6ab08ed4cf8aeedb3f490f77710` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:56.436482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce7417-b149-46bc-9e79-dfa49b3f9338 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:56.436858 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce7417-b149-46bc-9e79-dfa49b3f9338 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:56.437230 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce7417-b149-46bc-9e79-dfa49b3f9338 None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:56.437764 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0a768-e700-4963-a4f3-661865cb10ad None admin] RBAC: Authorizing `identity:get_user(user_id=1120f6ab08ed4cf8aeedb3f490f77710)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:56.438098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce7417-b149-46bc-9e79-dfa49b3f9338 None admin] RBAC: Adding query filter params (name=member) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:56.438522 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce7417-b149-46bc-9e79-dfa49b3f9338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:56.439679 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0a768-e700-4963-a4f3-661865cb10ad None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:56.440082 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce7417-b149-46bc-9e79-dfa49b3f9338 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:56.441830 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 178/347] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:55:56 2022] GET /identity/v3/users/1120f6ab08ed4cf8aeedb3f490f77710 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:56.442763 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0a768-e700-4963-a4f3-661865cb10ad None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:56.454570 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 170/348] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 23 07:55:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:56.459249 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce7417-b149-46bc-9e79-dfa49b3f9338 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:56.483203 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:56.559064 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0a768-e700-4963-a4f3-661865cb10ad None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:56.568240 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce7417-b149-46bc-9e79-dfa49b3f9338 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:56.598591 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b86e08-bc8b-4990-9312-35444f763d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:56.599534 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b86e08-bc8b-4990-9312-35444f763d96 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:56.600038 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b86e08-bc8b-4990-9312-35444f763d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:56.600484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b86e08-bc8b-4990-9312-35444f763d96 None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:56.601398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b86e08-bc8b-4990-9312-35444f763d96 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:56.601848 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b86e08-bc8b-4990-9312-35444f763d96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:56.603734 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b86e08-bc8b-4990-9312-35444f763d96 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:56.605199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf48bd-3903-4fcd-b9d8-684537680b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:56.606042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf48bd-3903-4fcd-b9d8-684537680b2b None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:56.606461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf48bd-3903-4fcd-b9d8-684537680b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:56.606837 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf48bd-3903-4fcd-b9d8-684537680b2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:56.607671 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf48bd-3903-4fcd-b9d8-684537680b2b None admin] RBAC: Adding query filter params (role.id=530235f994134c70a0beaef3ed1b650c, user.id=1120f6ab08ed4cf8aeedb3f490f77710, scope.system=all) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:56.608124 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf48bd-3903-4fcd-b9d8-684537680b2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:56.609662 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf48bd-3903-4fcd-b9d8-684537680b2b None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:56.615124 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 179/349] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:55:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:56.616311 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b86e08-bc8b-4990-9312-35444f763d96 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:56.616799 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:56.626271 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 171/350] 10.222.0.57 () {56 vars in 1308 bytes} [Tue Aug 23 07:55:56 2022] GET /identity/v3/role_assignments?user.id=1120f6ab08ed4cf8aeedb3f490f77710&scope.system=all&role.id=530235f994134c70a0beaef3ed1b650c => generated 510 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:56.627210 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf48bd-3903-4fcd-b9d8-684537680b2b None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:56.733833 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:56.741157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b86e08-bc8b-4990-9312-35444f763d96 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:56.759353 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf48bd-3903-4fcd-b9d8-684537680b2b None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:56.779848 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ffea1-024b-41e2-981a-89f1c6d0d095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:56.780997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ffea1-024b-41e2-981a-89f1c6d0d095 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:56.781487 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ffea1-024b-41e2-981a-89f1c6d0d095 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:56.781984 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ffea1-024b-41e2-981a-89f1c6d0d095 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:56.816657 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddb4f2-7289-48c6-9063-b13ff4db9c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:56.817201 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddb4f2-7289-48c6-9063-b13ff4db9c29 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:56.817485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddb4f2-7289-48c6-9063-b13ff4db9c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:56.817826 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddb4f2-7289-48c6-9063-b13ff4db9c29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:56.862907 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ffea1-024b-41e2-981a-89f1c6d0d095 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:56.864749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ffea1-024b-41e2-981a-89f1c6d0d095 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:56.909135 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:56.918904 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ddb4f2-7289-48c6-9063-b13ff4db9c29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:56.920851 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ddb4f2-7289-48c6-9063-b13ff4db9c29 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:56.978684 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:56.985430 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 180/351] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:55:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:55:56.994858 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ffea1-024b-41e2-981a-89f1c6d0d095 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:57.054385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 172/352] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:55:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:55:57.055283 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddb4f2-7289-48c6-9063-b13ff4db9c29 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:57.161301 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ffea1-024b-41e2-981a-89f1c6d0d095 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:57.173691 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:57.180157 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddb4f2-7289-48c6-9063-b13ff4db9c29 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:57.198984 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a1927-c75f-4992-95ac-76e70cef4425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:57.199833 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a1927-c75f-4992-95ac-76e70cef4425 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:57.199944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a1927-c75f-4992-95ac-76e70cef4425 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:57.200219 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a1927-c75f-4992-95ac-76e70cef4425 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:57.213570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a1927-c75f-4992-95ac-76e70cef4425 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:57.217445 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9554cf6-4f7a-406e-9244-1cc310c3ba0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:57.219091 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9554cf6-4f7a-406e-9244-1cc310c3ba0e None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:57.219091 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9554cf6-4f7a-406e-9244-1cc310c3ba0e None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:57.219091 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9554cf6-4f7a-406e-9244-1cc310c3ba0e None admin] PATH_INFO: `/v3/projects/dbd8608370894c55b5729ce6902c5722` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:57.219345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-197a1927-c75f-4992-95ac-76e70cef4425 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:55:57.219345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:57.219345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:57.219345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:57.219345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:57.219345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:57.219345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:57.219345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:57.219345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:57.219345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:57.219345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:57.219345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:57.219345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:57.219345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:57.219345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:57.219345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:57.220539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:57.220539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:57.220539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:57.220539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:57.220539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:57.220539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:57.220539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:57.220539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:57.220539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:57.220539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:57.220539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:57.220539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:57.220539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:57.220539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:57.220539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:57.220539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:57.221603 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:57.221603 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:57.221603 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:57.221603 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:57.221603 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:57.221603 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:57.221603 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:57.221603 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:57.221603 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:57.221603 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:57.221603 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:55:57.221603 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:55:57.221603 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 181/353] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:57.221603 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097444bd-dc43-452c-8009-2f401c2fe50d None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:57.222330 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097444bd-dc43-452c-8009-2f401c2fe50d None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:57.222402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9554cf6-4f7a-406e-9244-1cc310c3ba0e None admin] RBAC: Authorizing `identity:get_project(project_id=dbd8608370894c55b5729ce6902c5722)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:57.222469 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097444bd-dc43-452c-8009-2f401c2fe50d None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:57.223196 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9554cf6-4f7a-406e-9244-1cc310c3ba0e None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:57.223295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 182/354] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:57.224240 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031a536-bcc8-482d-941e-4ec57b28836e None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:57.224529 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031a536-bcc8-482d-941e-4ec57b28836e None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:57.225059 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031a536-bcc8-482d-941e-4ec57b28836e None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:57.225172 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 173/355] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:57 2022] GET /identity/v3/projects/dbd8608370894c55b5729ce6902c5722 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:57.226384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9554cf6-4f7a-406e-9244-1cc310c3ba0e None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:57.227011 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 183/356] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:55:57.231757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031a536-bcc8-482d-941e-4ec57b28836e None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:57.302810 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:57.339392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9554cf6-4f7a-406e-9244-1cc310c3ba0e None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:57.356603 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031a536-bcc8-482d-941e-4ec57b28836e None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:57.380289 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d93fdb-bf7c-4c7e-b903-c6cd36c3535b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:57.381041 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d93fdb-bf7c-4c7e-b903-c6cd36c3535b None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:57.381368 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d93fdb-bf7c-4c7e-b903-c6cd36c3535b None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:57.381646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d93fdb-bf7c-4c7e-b903-c6cd36c3535b None admin] PATH_INFO: `/v3/projects/dbd8608370894c55b5729ce6902c5722` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:57.384623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d93fdb-bf7c-4c7e-b903-c6cd36c3535b None admin] RBAC: Authorizing `identity:get_project(project_id=dbd8608370894c55b5729ce6902c5722)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:57.386068 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d93fdb-bf7c-4c7e-b903-c6cd36c3535b None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:57.390588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 174/357] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:57 2022] GET /identity/v3/projects/dbd8608370894c55b5729ce6902c5722 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:57.390588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea02257-c4c3-432a-ba52-ba2b86eef3f3 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:57.390588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea02257-c4c3-432a-ba52-ba2b86eef3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:57.390588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea02257-c4c3-432a-ba52-ba2b86eef3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:57.398753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad374e8-a220-46c7-95c8-b544534eebb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:57.399369 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad374e8-a220-46c7-95c8-b544534eebb1 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:57.399649 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad374e8-a220-46c7-95c8-b544534eebb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:57.399925 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad374e8-a220-46c7-95c8-b544534eebb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:57.400595 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad374e8-a220-46c7-95c8-b544534eebb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:57.400898 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad374e8-a220-46c7-95c8-b544534eebb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:57.402323 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad374e8-a220-46c7-95c8-b544534eebb1 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:57.408113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-0ea02257-c4c3-432a-ba52-ba2b86eef3f3 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:57.409592 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-0ea02257-c4c3-432a-ba52-ba2b86eef3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:57.413505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 184/358] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 23 07:55:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:57.414145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468eb4f-a864-45b0-ae43-826211e09db6 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:57.414470 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468eb4f-a864-45b0-ae43-826211e09db6 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:57.414749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468eb4f-a864-45b0-ae43-826211e09db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:57.433560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-8468eb4f-a864-45b0-ae43-826211e09db6 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:55:57.435690 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-8468eb4f-a864-45b0-ae43-826211e09db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:55:57.444190 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:57.497655 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 175/359] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:57.502378 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea02257-c4c3-432a-ba52-ba2b86eef3f3 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:57.522310 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 185/360] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:55:57.522310 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468eb4f-a864-45b0-ae43-826211e09db6 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:57.580365 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:57.622934 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea02257-c4c3-432a-ba52-ba2b86eef3f3 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:57.636672 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468eb4f-a864-45b0-ae43-826211e09db6 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:57.676069 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bafcb9-8eab-4492-ab40-2934c6f73dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:57.677315 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bafcb9-8eab-4492-ab40-2934c6f73dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:57.677793 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bafcb9-8eab-4492-ab40-2934c6f73dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:57.678263 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bafcb9-8eab-4492-ab40-2934c6f73dd5 None admin] PATH_INFO: `/v3/groups/7820e2aa76d9466c9932f89425e54e06` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:57.684448 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85260563-2c66-48af-b29d-7659befd0051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:57.685184 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85260563-2c66-48af-b29d-7659befd0051 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:57.685481 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85260563-2c66-48af-b29d-7659befd0051 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:57.685853 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85260563-2c66-48af-b29d-7659befd0051 None admin] PATH_INFO: `/v3/groups/7820e2aa76d9466c9932f89425e54e06` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:57.687305 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bafcb9-8eab-4492-ab40-2934c6f73dd5 None admin] RBAC: Authorizing `identity:get_group(group_id=7820e2aa76d9466c9932f89425e54e06)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:57.687415 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85260563-2c66-48af-b29d-7659befd0051 None admin] RBAC: Authorizing `identity:get_group(group_id=7820e2aa76d9466c9932f89425e54e06)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:57.688999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85260563-2c66-48af-b29d-7659befd0051 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:57.689545 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bafcb9-8eab-4492-ab40-2934c6f73dd5 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:57.691610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 176/362] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 23 07:55:57 2022] GET /identity/v3/groups/7820e2aa76d9466c9932f89425e54e06 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:57.692658 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bafcb9-8eab-4492-ab40-2934c6f73dd5 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:57.694470 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 186/362] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 23 07:55:57 2022] GET /identity/v3/groups/7820e2aa76d9466c9932f89425e54e06 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:57.697424 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85260563-2c66-48af-b29d-7659befd0051 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:57.729396 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:57.823691 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bafcb9-8eab-4492-ab40-2934c6f73dd5 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:57.832087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85260563-2c66-48af-b29d-7659befd0051 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:57.851428 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:57.866184 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ef3a1-0210-4165-ab24-440867b8c31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:57.866872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ef3a1-0210-4165-ab24-440867b8c31b None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:57.867150 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ef3a1-0210-4165-ab24-440867b8c31b None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:57.867423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ef3a1-0210-4165-ab24-440867b8c31b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:57.879218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0b2c4-af13-4472-814d-13ee5067d864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:57.879218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0b2c4-af13-4472-814d-13ee5067d864 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:57.879485 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0b2c4-af13-4472-814d-13ee5067d864 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:57.879558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0b2c4-af13-4472-814d-13ee5067d864 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:57.880304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0b2c4-af13-4472-814d-13ee5067d864 None admin] RBAC: Adding query filter params (group.id=7820e2aa76d9466c9932f89425e54e06, role.id=4e9a14889d764731b59323f764f1bb85, scope.project.id=dbd8608370894c55b5729ce6902c5722) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:57.881528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0b2c4-af13-4472-814d-13ee5067d864 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:57.882992 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0b2c4-af13-4472-814d-13ee5067d864 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:57.891796 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 187/363] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 23 07:55:57 2022] GET /identity/v3/role_assignments?group.id=7820e2aa76d9466c9932f89425e54e06&scope.project.id=dbd8608370894c55b5729ce6902c5722&role.id=4e9a14889d764731b59323f764f1bb85 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:57.892836 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0b2c4-af13-4472-814d-13ee5067d864 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:57.956005 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ef3a1-0210-4165-ab24-440867b8c31b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:57.957519 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ef3a1-0210-4165-ab24-440867b8c31b None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:57.993745 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:58.032791 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0b2c4-af13-4472-814d-13ee5067d864 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:58.078177 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6eed3-32d3-439c-ab6e-3871fd000004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:58.079153 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6eed3-32d3-439c-ab6e-3871fd000004 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:58.079631 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6eed3-32d3-439c-ab6e-3871fd000004 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:58.080128 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6eed3-32d3-439c-ab6e-3871fd000004 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:58.080932 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6eed3-32d3-439c-ab6e-3871fd000004 None admin] RBAC: Adding query filter params (group.id=7820e2aa76d9466c9932f89425e54e06, role.id=4ed852223bc54be09a9487ff788b7644, scope.project.id=dbd8608370894c55b5729ce6902c5722) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:58.081243 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6eed3-32d3-439c-ab6e-3871fd000004 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:58.082999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6eed3-32d3-439c-ab6e-3871fd000004 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:58.092109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 188/364] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 23 07:55:57 2022] GET /identity/v3/role_assignments?group.id=7820e2aa76d9466c9932f89425e54e06&scope.project.id=dbd8608370894c55b5729ce6902c5722&role.id=4ed852223bc54be09a9487ff788b7644 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:58.092732 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6eed3-32d3-439c-ab6e-3871fd000004 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:58.096768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 177/365] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:55:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:55:58.097556 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ef3a1-0210-4165-ab24-440867b8c31b None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:58.158727 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:58.244036 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6eed3-32d3-439c-ab6e-3871fd000004 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:58.245623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ef3a1-0210-4165-ab24-440867b8c31b None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:58.281240 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:58.289865 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bf599-1a01-43e8-be8c-aa12cd5bee5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:58.290576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bf599-1a01-43e8-be8c-aa12cd5bee5b None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:58.290839 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bf599-1a01-43e8-be8c-aa12cd5bee5b None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:58.291115 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bf599-1a01-43e8-be8c-aa12cd5bee5b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:58.294644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc091c93-5eef-4b7c-89dc-15b6d8245148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:58.295375 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc091c93-5eef-4b7c-89dc-15b6d8245148 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:58.295724 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc091c93-5eef-4b7c-89dc-15b6d8245148 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:58.296069 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc091c93-5eef-4b7c-89dc-15b6d8245148 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:58.304387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bf599-1a01-43e8-be8c-aa12cd5bee5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:58.310442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-200bf599-1a01-43e8-be8c-aa12cd5bee5b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:55:58.310442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:58.310442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:58.310442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:58.310442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:58.310442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:58.310442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:58.310442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:58.310442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:58.310442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:58.310442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:58.310442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:58.310442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:58.310442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:58.310442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:58.310442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:58.311527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:58.311527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:58.311527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:58.311527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:58.311527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:58.311527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:58.311527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:58.311527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:58.311527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:58.311527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:58.311527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:58.311527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:58.311527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:58.311527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:58.311527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:58.311527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:58.312550 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:58.312550 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:58.312550 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:58.312550 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:58.312550 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:58.312550 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:58.312550 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:58.312550 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:58.312550 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:58.312550 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:58.312550 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:55:58.312550 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:55:58.313866 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 178/366] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 23 07:55:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:58.316864 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc091c93-5eef-4b7c-89dc-15b6d8245148 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:55:58.318779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bf599-1a01-43e8-be8c-aa12cd5bee5b None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:58.322644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-cc091c93-5eef-4b7c-89dc-15b6d8245148 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:55:58.322644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:55:58.322644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:55:58.322644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:55:58.322644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:55:58.322644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:55:58.322644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:55:58.322644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:55:58.322644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:55:58.322644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:55:58.322644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:55:58.322644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:55:58.322644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:55:58.322644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:55:58.322644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:55:58.322644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:55:58.324023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:55:58.324023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:55:58.324023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:55:58.324023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:55:58.324023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:55:58.324023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:55:58.324023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:55:58.324023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:55:58.324023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:55:58.324023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:55:58.324023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:55:58.324023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:55:58.324023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:55:58.324023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:55:58.324023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:55:58.324023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:55:58.325088 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:55:58.325088 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:55:58.325088 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:55:58.325088 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:55:58.325088 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:55:58.325088 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:55:58.325088 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:55:58.325088 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:55:58.325088 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:55:58.325088 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:55:58.325088 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:55:58.325088 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:55:58.330441 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 189/367] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:55:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:55:58.330441 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc091c93-5eef-4b7c-89dc-15b6d8245148 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:58.455603 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc091c93-5eef-4b7c-89dc-15b6d8245148 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:58.457548 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bf599-1a01-43e8-be8c-aa12cd5bee5b None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:58.458989 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:58.501288 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507d9d0-85a1-4294-89aa-5cbbdda10395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:58.501905 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507d9d0-85a1-4294-89aa-5cbbdda10395 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:58.502192 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507d9d0-85a1-4294-89aa-5cbbdda10395 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:58.502508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507d9d0-85a1-4294-89aa-5cbbdda10395 None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:58.503177 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507d9d0-85a1-4294-89aa-5cbbdda10395 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:58.503485 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507d9d0-85a1-4294-89aa-5cbbdda10395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:58.504893 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507d9d0-85a1-4294-89aa-5cbbdda10395 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:58.506844 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b92159-80b0-42eb-b71c-03ccec6a4686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:58.508172 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b92159-80b0-42eb-b71c-03ccec6a4686 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:58.508628 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b92159-80b0-42eb-b71c-03ccec6a4686 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:58.509074 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b92159-80b0-42eb-b71c-03ccec6a4686 None admin] PATH_INFO: `/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:58.510419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b92159-80b0-42eb-b71c-03ccec6a4686 None admin] RBAC: Authorizing `identity:get_project(project_id=b2061ddf744e4b65bc58158bbf9baf3c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:58.513429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b92159-80b0-42eb-b71c-03ccec6a4686 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:58.515035 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 190/368] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:55:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:58.515982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 179/369] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:58 2022] GET /identity/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:58.521020 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507d9d0-85a1-4294-89aa-5cbbdda10395 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:58.522086 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b92159-80b0-42eb-b71c-03ccec6a4686 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:58.597386 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:58.640275 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507d9d0-85a1-4294-89aa-5cbbdda10395 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:58.673295 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b92159-80b0-42eb-b71c-03ccec6a4686 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:58.686459 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c14b21-01f5-4f83-aeaf-087089015c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:58.687633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c14b21-01f5-4f83-aeaf-087089015c5b None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:58.688125 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c14b21-01f5-4f83-aeaf-087089015c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:58.688580 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c14b21-01f5-4f83-aeaf-087089015c5b None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:58.689388 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c14b21-01f5-4f83-aeaf-087089015c5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:58.689712 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c14b21-01f5-4f83-aeaf-087089015c5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:58.691120 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c14b21-01f5-4f83-aeaf-087089015c5b None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:58.702326 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 191/370] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:55:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:58.702326 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c14b21-01f5-4f83-aeaf-087089015c5b None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:58.717849 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b96718-cc2b-4bca-9e29-4085012ed34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:58.718668 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b96718-cc2b-4bca-9e29-4085012ed34b None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:58.719043 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b96718-cc2b-4bca-9e29-4085012ed34b None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:58.719426 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b96718-cc2b-4bca-9e29-4085012ed34b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:58.734369 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:58.803755 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b96718-cc2b-4bca-9e29-4085012ed34b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:58.806447 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b96718-cc2b-4bca-9e29-4085012ed34b None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:58.815363 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c14b21-01f5-4f83-aeaf-087089015c5b None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:58.858582 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f986cb4-faf0-4aac-bedf-6c787c549673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:58.859217 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f986cb4-faf0-4aac-bedf-6c787c549673 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:58.859501 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f986cb4-faf0-4aac-bedf-6c787c549673 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:58.859760 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f986cb4-faf0-4aac-bedf-6c787c549673 None admin] PATH_INFO: `/v3/groups/7820e2aa76d9466c9932f89425e54e06` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:58.860883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f986cb4-faf0-4aac-bedf-6c787c549673 None admin] RBAC: Authorizing `identity:get_group(group_id=7820e2aa76d9466c9932f89425e54e06)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:58.862343 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f986cb4-faf0-4aac-bedf-6c787c549673 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:58.863908 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 192/371] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 23 07:55:58 2022] GET /identity/v3/groups/7820e2aa76d9466c9932f89425e54e06 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:58.864662 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f986cb4-faf0-4aac-bedf-6c787c549673 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:58.885583 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:58.952235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 180/372] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:55:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:55:58.953687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b96718-cc2b-4bca-9e29-4085012ed34b None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:58.981715 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:58.988565 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f986cb4-faf0-4aac-bedf-6c787c549673 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:59.032517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c675cc-1e2c-46d6-96cd-00b57e4292e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:59.033595 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c675cc-1e2c-46d6-96cd-00b57e4292e6 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:59.034123 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c675cc-1e2c-46d6-96cd-00b57e4292e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:59.034610 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c675cc-1e2c-46d6-96cd-00b57e4292e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:59.082098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b96718-cc2b-4bca-9e29-4085012ed34b None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:59.112725 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c675cc-1e2c-46d6-96cd-00b57e4292e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:59.114677 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c675cc-1e2c-46d6-96cd-00b57e4292e6 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:59.130594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea4cb7-9bdc-4083-987b-20eced1c844d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:59.131905 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea4cb7-9bdc-4083-987b-20eced1c844d None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:59.132377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea4cb7-9bdc-4083-987b-20eced1c844d None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:59.132853 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea4cb7-9bdc-4083-987b-20eced1c844d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:59.133764 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea4cb7-9bdc-4083-987b-20eced1c844d None admin] RBAC: Adding query filter params (group.id=7820e2aa76d9466c9932f89425e54e06, role.id=4ed852223bc54be09a9487ff788b7644, scope.project.id=b2061ddf744e4b65bc58158bbf9baf3c) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:59.134365 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea4cb7-9bdc-4083-987b-20eced1c844d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:59.136128 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea4cb7-9bdc-4083-987b-20eced1c844d None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:59.142845 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 181/373] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 23 07:55:58 2022] GET /identity/v3/role_assignments?group.id=7820e2aa76d9466c9932f89425e54e06&scope.project.id=b2061ddf744e4b65bc58158bbf9baf3c&role.id=4ed852223bc54be09a9487ff788b7644 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:59.143937 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea4cb7-9bdc-4083-987b-20eced1c844d None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:59.184612 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:59.323235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea4cb7-9bdc-4083-987b-20eced1c844d None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:59.331527 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:59.348377 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 193/374] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:55:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:55:59.354332 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c675cc-1e2c-46d6-96cd-00b57e4292e6 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:59.373315 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6392ab1-5e63-4fae-8567-d429ef2b05c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:59.373982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6392ab1-5e63-4fae-8567-d429ef2b05c0 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:59.374261 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6392ab1-5e63-4fae-8567-d429ef2b05c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:59.374559 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6392ab1-5e63-4fae-8567-d429ef2b05c0 None admin] PATH_INFO: `/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:59.375869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6392ab1-5e63-4fae-8567-d429ef2b05c0 None admin] RBAC: Authorizing `identity:get_project(project_id=b2061ddf744e4b65bc58158bbf9baf3c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:59.377230 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6392ab1-5e63-4fae-8567-d429ef2b05c0 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:59.382963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 182/375] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:59 2022] GET /identity/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:59.388394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6392ab1-5e63-4fae-8567-d429ef2b05c0 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:59.491956 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c675cc-1e2c-46d6-96cd-00b57e4292e6 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:59.503414 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:59.522379 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6392ab1-5e63-4fae-8567-d429ef2b05c0 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:59.545457 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51b069-3d6c-4c20-b453-b2771a1439fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:59.546467 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51b069-3d6c-4c20-b453-b2771a1439fd None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:59.546970 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51b069-3d6c-4c20-b453-b2771a1439fd None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:59.547453 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51b069-3d6c-4c20-b453-b2771a1439fd None admin] PATH_INFO: `/v3/projects/89fa3cf81b7a47a1bca14aee1213ee84` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:59.548787 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51b069-3d6c-4c20-b453-b2771a1439fd None admin] RBAC: Authorizing `identity:get_project(project_id=89fa3cf81b7a47a1bca14aee1213ee84)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:59.550472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51b069-3d6c-4c20-b453-b2771a1439fd None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:59.552302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 194/376] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:55:59 2022] GET /identity/v3/projects/89fa3cf81b7a47a1bca14aee1213ee84 => generated 344 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:55:59.557757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51b069-3d6c-4c20-b453-b2771a1439fd None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:59.567892 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1242afb-09ff-4dc6-a490-a24778f24877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:59.569771 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1242afb-09ff-4dc6-a490-a24778f24877 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:59.572625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1242afb-09ff-4dc6-a490-a24778f24877 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:59.573104 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1242afb-09ff-4dc6-a490-a24778f24877 None admin] PATH_INFO: `/v3/groups/7820e2aa76d9466c9932f89425e54e06` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:59.577129 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1242afb-09ff-4dc6-a490-a24778f24877 None admin] RBAC: Authorizing `identity:get_group(group_id=7820e2aa76d9466c9932f89425e54e06)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:59.578879 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1242afb-09ff-4dc6-a490-a24778f24877 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:59.581199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 183/377] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 23 07:55:59 2022] GET /identity/v3/groups/7820e2aa76d9466c9932f89425e54e06 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:55:59.586861 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1242afb-09ff-4dc6-a490-a24778f24877 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:59.686667 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:55:59.755467 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51b069-3d6c-4c20-b453-b2771a1439fd None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:59.775521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1242afb-09ff-4dc6-a490-a24778f24877 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:55:59.821977 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744c05b-463f-43f7-a87e-a3d6de375b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:59.822707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744c05b-463f-43f7-a87e-a3d6de375b0e None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:59.822997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744c05b-463f-43f7-a87e-a3d6de375b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:59.823273 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744c05b-463f-43f7-a87e-a3d6de375b0e None admin] PATH_INFO: `/v3/groups/a99b148aa2bd4bbfb6e1842cfceffcb4` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:59.833083 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744c05b-463f-43f7-a87e-a3d6de375b0e None admin] RBAC: Authorizing `identity:get_group(group_id=a99b148aa2bd4bbfb6e1842cfceffcb4)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:59.835894 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744c05b-463f-43f7-a87e-a3d6de375b0e None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:59.839582 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dea5e-8d3f-4957-949c-0ca3a4995b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:55:59.840715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dea5e-8d3f-4957-949c-0ca3a4995b0c None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:55:59.841052 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dea5e-8d3f-4957-949c-0ca3a4995b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:55:59.841269 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dea5e-8d3f-4957-949c-0ca3a4995b0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:55:59.842100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320dea5e-8d3f-4957-949c-0ca3a4995b0c None admin] RBAC: Adding query filter params (group.id=7820e2aa76d9466c9932f89425e54e06, role.id=4e9a14889d764731b59323f764f1bb85, scope.project.id=b2061ddf744e4b65bc58158bbf9baf3c) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:55:59.842436 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320dea5e-8d3f-4957-949c-0ca3a4995b0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:55:59.843887 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320dea5e-8d3f-4957-949c-0ca3a4995b0c None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:55:59.845690 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 195/378] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 23 07:55:59 2022] GET /identity/v3/groups/a99b148aa2bd4bbfb6e1842cfceffcb4 => generated 229 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:59.847449 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744c05b-463f-43f7-a87e-a3d6de375b0e None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:55:59.860005 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 184/379] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 23 07:55:59 2022] GET /identity/v3/role_assignments?group.id=7820e2aa76d9466c9932f89425e54e06&scope.project.id=b2061ddf744e4b65bc58158bbf9baf3c&role.id=4e9a14889d764731b59323f764f1bb85 => generated 260 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:55:59.980816 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744c05b-463f-43f7-a87e-a3d6de375b0e None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:00.017686 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:00.030422 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf730f4-8867-4c5d-8772-7158080ba900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:00.031059 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf730f4-8867-4c5d-8772-7158080ba900 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:00.031348 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf730f4-8867-4c5d-8772-7158080ba900 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:00.031614 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf730f4-8867-4c5d-8772-7158080ba900 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:00.032370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf730f4-8867-4c5d-8772-7158080ba900 None admin] RBAC: Adding query filter params (group.id=a99b148aa2bd4bbfb6e1842cfceffcb4, role.id=e905040849d04aadbb8da8b0d216c92c, scope.project.id=89fa3cf81b7a47a1bca14aee1213ee84) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:00.032681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf730f4-8867-4c5d-8772-7158080ba900 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:00.034150 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf730f4-8867-4c5d-8772-7158080ba900 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:00.043090 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 196/380] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 23 07:55:59 2022] GET /identity/v3/role_assignments?group.id=a99b148aa2bd4bbfb6e1842cfceffcb4&scope.project.id=89fa3cf81b7a47a1bca14aee1213ee84&role.id=e905040849d04aadbb8da8b0d216c92c => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:00.163409 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847fb1c-f115-4964-ba8a-5ded7b15f9b8 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:00.163889 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847fb1c-f115-4964-ba8a-5ded7b15f9b8 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:00.163889 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847fb1c-f115-4964-ba8a-5ded7b15f9b8 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:00.165230 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 185/381] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:00.171746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae1eee-d844-4b4d-83c7-47517d2106a3 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:00.172035 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae1eee-d844-4b4d-83c7-47517d2106a3 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:00.172307 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae1eee-d844-4b4d-83c7-47517d2106a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:00.198668 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-60ae1eee-d844-4b4d-83c7-47517d2106a3 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:00.200986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-60ae1eee-d844-4b4d-83c7-47517d2106a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:00.293804 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 197/382] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:00.415638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59a9ae-6868-447a-8800-c70a0ac7b887 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:00.416240 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59a9ae-6868-447a-8800-c70a0ac7b887 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:00.416750 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59a9ae-6868-447a-8800-c70a0ac7b887 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:00.419279 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 186/383] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:00.424455 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cce19-fc8f-4a2c-bb8f-b82494b90152 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:00.425284 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cce19-fc8f-4a2c-bb8f-b82494b90152 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:00.425832 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cce19-fc8f-4a2c-bb8f-b82494b90152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:00.446023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-e96cce19-fc8f-4a2c-bb8f-b82494b90152 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:00.447567 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-e96cce19-fc8f-4a2c-bb8f-b82494b90152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:00.528873 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 198/384] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:00.671299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59a9ae-6868-447a-8800-c70a0ac7b887 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:00.691919 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:00.787372 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59a9ae-6868-447a-8800-c70a0ac7b887 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:00.829357 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627134e-e481-4eaf-887a-b365aecf323c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:00.830366 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627134e-e481-4eaf-887a-b365aecf323c None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:00.830905 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627134e-e481-4eaf-887a-b365aecf323c None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:00.831378 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627134e-e481-4eaf-887a-b365aecf323c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:00.843927 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627134e-e481-4eaf-887a-b365aecf323c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:00.849121 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-d627134e-e481-4eaf-887a-b365aecf323c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:56:00.849121 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:00.849121 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:00.849121 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:00.849121 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:00.849121 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:00.849121 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:00.849121 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:00.849121 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:00.849121 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:00.849121 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:00.849121 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:00.849121 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:00.849121 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:00.849121 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:00.849121 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:00.849968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:00.849968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:00.849968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:00.849968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:00.849968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:00.849968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:00.849968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:00.849968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:00.849968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:00.849968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:00.849968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:00.849968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:00.849968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:00.849968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:00.849968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:00.849968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:00.851768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:00.851768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:00.851768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:00.851768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:00.851768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:00.851768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:00.851768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:00.851768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:00.851768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:00.851768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:00.851768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:56:00.851768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:00.855154 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 187/385] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 23 07:56:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:00.860772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cce19-fc8f-4a2c-bb8f-b82494b90152 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:00.915866 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:00.975656 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cce19-fc8f-4a2c-bb8f-b82494b90152 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:01.025862 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043255b9-54e7-464e-93ed-d205f2b9d0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:01.026531 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043255b9-54e7-464e-93ed-d205f2b9d0ec None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:01.026831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043255b9-54e7-464e-93ed-d205f2b9d0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:01.027156 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043255b9-54e7-464e-93ed-d205f2b9d0ec None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:01.027950 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043255b9-54e7-464e-93ed-d205f2b9d0ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:01.028450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043255b9-54e7-464e-93ed-d205f2b9d0ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:01.029833 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043255b9-54e7-464e-93ed-d205f2b9d0ec None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:01.041735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 199/386] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:01.047782 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627134e-e481-4eaf-887a-b365aecf323c None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:01.058038 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043255b9-54e7-464e-93ed-d205f2b9d0ec None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:01.192425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:01.232728 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627134e-e481-4eaf-887a-b365aecf323c None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:01.250884 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043255b9-54e7-464e-93ed-d205f2b9d0ec None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:01.276210 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:01.299150 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474bfc1e-b6b0-4baf-ad09-f9f3413924ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:01.299801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bfc1e-b6b0-4baf-ad09-f9f3413924ab None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:01.300088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bfc1e-b6b0-4baf-ad09-f9f3413924ab None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:01.300363 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bfc1e-b6b0-4baf-ad09-f9f3413924ab None admin] PATH_INFO: `/v3/groups/7820e2aa76d9466c9932f89425e54e06` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:01.301897 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474bfc1e-b6b0-4baf-ad09-f9f3413924ab None admin] RBAC: Authorizing `identity:get_group(group_id=7820e2aa76d9466c9932f89425e54e06)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:01.303395 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474bfc1e-b6b0-4baf-ad09-f9f3413924ab None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:01.309123 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 188/387] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 23 07:56:01 2022] GET /identity/v3/groups/7820e2aa76d9466c9932f89425e54e06 => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:01.311088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474bfc1e-b6b0-4baf-ad09-f9f3413924ab None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:01.328005 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b790d-c69b-44dc-b8b7-f11a57f9591c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:01.328720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b790d-c69b-44dc-b8b7-f11a57f9591c None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:01.329009 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b790d-c69b-44dc-b8b7-f11a57f9591c None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:01.329287 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b790d-c69b-44dc-b8b7-f11a57f9591c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:01.346206 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b790d-c69b-44dc-b8b7-f11a57f9591c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:01.352046 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-f53b790d-c69b-44dc-b8b7-f11a57f9591c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:56:01.352046 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:01.352046 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:01.352046 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:01.352046 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:01.352046 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:01.352046 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:01.352046 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:01.352046 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:01.352046 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:01.352046 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:01.352046 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:01.352046 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:01.352046 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:01.352046 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:01.352046 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:01.352936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:01.352936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:01.352936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:01.352936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:01.352936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:01.352936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:01.352936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:01.352936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:01.352936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:01.352936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:01.352936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:01.352936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:01.352936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:01.352936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:01.352936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:01.352936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:01.353708 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:01.353708 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:01.353708 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:01.353708 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:01.353708 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:01.353708 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:01.353708 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:01.353708 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:01.353708 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:01.353708 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:01.353708 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:56:01.353708 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:01.358923 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 200/388] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:56:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:01.359805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b790d-c69b-44dc-b8b7-f11a57f9591c None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:01.479957 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474bfc1e-b6b0-4baf-ad09-f9f3413924ab None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:01.522395 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a22a4-4d3c-4ac1-acac-7711d662eda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:01.522395 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a22a4-4d3c-4ac1-acac-7711d662eda3 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:01.522395 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a22a4-4d3c-4ac1-acac-7711d662eda3 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:01.522395 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a22a4-4d3c-4ac1-acac-7711d662eda3 None admin] PATH_INFO: `/v3/projects/dbd8608370894c55b5729ce6902c5722` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:01.522779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a22a4-4d3c-4ac1-acac-7711d662eda3 None admin] RBAC: Authorizing `identity:get_project(project_id=dbd8608370894c55b5729ce6902c5722)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:01.523347 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a22a4-4d3c-4ac1-acac-7711d662eda3 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:01.525674 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 189/389] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:56:01 2022] GET /identity/v3/projects/dbd8608370894c55b5729ce6902c5722 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:01.532981 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a22a4-4d3c-4ac1-acac-7711d662eda3 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:01.551031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b790d-c69b-44dc-b8b7-f11a57f9591c None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:01.561848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:01.589050 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ae3f6-ce28-4cb4-9797-dba7d0222c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:01.590054 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ae3f6-ce28-4cb4-9797-dba7d0222c63 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:01.590581 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ae3f6-ce28-4cb4-9797-dba7d0222c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:01.591125 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ae3f6-ce28-4cb4-9797-dba7d0222c63 None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:01.591999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ae3f6-ce28-4cb4-9797-dba7d0222c63 None admin] RBAC: Adding query filter params (name=member) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:01.592495 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ae3f6-ce28-4cb4-9797-dba7d0222c63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:01.594052 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ae3f6-ce28-4cb4-9797-dba7d0222c63 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:01.603756 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 201/390] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 23 07:56:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:01.610926 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ae3f6-ce28-4cb4-9797-dba7d0222c63 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:01.658832 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:01.685099 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a22a4-4d3c-4ac1-acac-7711d662eda3 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:01.723162 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3d02e-583c-4993-ab0d-0b8c5b6afb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:01.724123 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3d02e-583c-4993-ab0d-0b8c5b6afb38 None admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:01.724580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3d02e-583c-4993-ab0d-0b8c5b6afb38 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:01.725065 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3d02e-583c-4993-ab0d-0b8c5b6afb38 None admin] PATH_INFO: `/v3/projects/dbd8608370894c55b5729ce6902c5722/groups/7820e2aa76d9466c9932f89425e54e06/roles/4e9a14889d764731b59323f764f1bb85` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:01.728002 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3d02e-583c-4993-ab0d-0b8c5b6afb38 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbd8608370894c55b5729ce6902c5722, group_id=7820e2aa76d9466c9932f89425e54e06, role_id=4e9a14889d764731b59323f764f1bb85)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:01.728559 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ae3f6-ce28-4cb4-9797-dba7d0222c63 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:01.730212 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3d02e-583c-4993-ab0d-0b8c5b6afb38 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:01.764167 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959166f3-70e9-4239-8ac4-65198c85b6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:01.764900 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959166f3-70e9-4239-8ac4-65198c85b6bf None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:01.765287 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959166f3-70e9-4239-8ac4-65198c85b6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:01.765639 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959166f3-70e9-4239-8ac4-65198c85b6bf None admin] PATH_INFO: `/v3/groups/7820e2aa76d9466c9932f89425e54e06` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:01.766820 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959166f3-70e9-4239-8ac4-65198c85b6bf None admin] RBAC: Authorizing `identity:get_group(group_id=7820e2aa76d9466c9932f89425e54e06)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:01.768392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959166f3-70e9-4239-8ac4-65198c85b6bf None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:01.770228 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 202/391] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 23 07:56:01 2022] GET /identity/v3/groups/7820e2aa76d9466c9932f89425e54e06 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:01.771216 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cae736-2b17-4539-be18-cf29e8a5a784 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:01.771501 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cae736-2b17-4539-be18-cf29e8a5a784 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:01.771773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cae736-2b17-4539-be18-cf29e8a5a784 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:01.777172 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 203/392] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:01.777172 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cae736-2b17-4539-be18-cf29e8a5a784 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:01.822988 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 190/393] 10.222.0.57 () {58 vars in 1442 bytes} [Tue Aug 23 07:56:01 2022] PUT /identity/v3/projects/dbd8608370894c55b5729ce6902c5722/groups/7820e2aa76d9466c9932f89425e54e06/roles/4e9a14889d764731b59323f764f1bb85 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:56:01.833710 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc8665-f820-4bd7-a0b1-336aa734288b None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:01.833946 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc8665-f820-4bd7-a0b1-336aa734288b None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:01.834177 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc8665-f820-4bd7-a0b1-336aa734288b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:01.878479 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-a9dc8665-f820-4bd7-a0b1-336aa734288b None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:01.879711 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a9dc8665-f820-4bd7-a0b1-336aa734288b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:01.964248 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cae736-2b17-4539-be18-cf29e8a5a784 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:01.969488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:01.998207 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 191/394] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:02.020883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd56d2-eee1-4e2e-8eea-7fdff103d311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:02.021584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd56d2-eee1-4e2e-8eea-7fdff103d311 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:02.021863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd56d2-eee1-4e2e-8eea-7fdff103d311 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:02.022130 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd56d2-eee1-4e2e-8eea-7fdff103d311 None admin] PATH_INFO: `/v3/projects/dbd8608370894c55b5729ce6902c5722` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:02.023918 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd56d2-eee1-4e2e-8eea-7fdff103d311 None admin] RBAC: Authorizing `identity:get_project(project_id=dbd8608370894c55b5729ce6902c5722)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:02.025789 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd56d2-eee1-4e2e-8eea-7fdff103d311 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:02.028780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 204/395] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:56:01 2022] GET /identity/v3/projects/dbd8608370894c55b5729ce6902c5722 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:02.034338 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc8665-f820-4bd7-a0b1-336aa734288b None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:02.038716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:02.148196 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc8665-f820-4bd7-a0b1-336aa734288b None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:02.189711 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb853e-9d52-4ddd-b42a-2a3c1292d92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:02.190498 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb853e-9d52-4ddd-b42a-2a3c1292d92c None admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:02.190842 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb853e-9d52-4ddd-b42a-2a3c1292d92c None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:02.191180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb853e-9d52-4ddd-b42a-2a3c1292d92c None admin] PATH_INFO: `/v3/projects/dbd8608370894c55b5729ce6902c5722/groups/7820e2aa76d9466c9932f89425e54e06/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:02.194785 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb853e-9d52-4ddd-b42a-2a3c1292d92c None admin] RBAC: Authorizing `identity:create_grant(project_id=dbd8608370894c55b5729ce6902c5722, group_id=7820e2aa76d9466c9932f89425e54e06, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:02.196319 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb853e-9d52-4ddd-b42a-2a3c1292d92c None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:02.270726 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 192/396] 10.222.0.57 () {58 vars in 1442 bytes} [Tue Aug 23 07:56:02 2022] PUT /identity/v3/projects/dbd8608370894c55b5729ce6902c5722/groups/7820e2aa76d9466c9932f89425e54e06/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:56:02.327584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd56d2-eee1-4e2e-8eea-7fdff103d311 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:02.353502 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be9705-6b23-478c-864a-850a6d292f00 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:02.353836 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be9705-6b23-478c-864a-850a6d292f00 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:02.354043 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be9705-6b23-478c-864a-850a6d292f00 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:02.355855 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 193/397] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:56:02.367884 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d3c3c-ab8f-4e45-affe-998532d7117e None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:02.368192 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d3c3c-ab8f-4e45-affe-998532d7117e None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:02.368429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d3c3c-ab8f-4e45-affe-998532d7117e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:02.393584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-586d3c3c-ab8f-4e45-affe-998532d7117e None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:02.394847 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-586d3c3c-ab8f-4e45-affe-998532d7117e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:02.468037 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:02.477269 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 194/398] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:02.509126 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd56d2-eee1-4e2e-8eea-7fdff103d311 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:02.548597 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167fcc1-1d03-4ebe-99c2-12f376bd258a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:02.549280 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167fcc1-1d03-4ebe-99c2-12f376bd258a None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:02.549573 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167fcc1-1d03-4ebe-99c2-12f376bd258a None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:02.549847 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167fcc1-1d03-4ebe-99c2-12f376bd258a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:02.560802 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167fcc1-1d03-4ebe-99c2-12f376bd258a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:02.565713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-b167fcc1-1d03-4ebe-99c2-12f376bd258a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:56:02.565713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:02.565713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:02.565713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:02.565713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:02.565713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:02.565713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:02.565713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:02.565713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:02.565713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:02.565713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:02.565713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:02.565713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:02.565713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:02.565713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:02.565713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:02.566825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:02.566825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:02.566825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:02.566825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:02.566825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:02.566825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:02.566825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:02.566825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:02.566825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:02.566825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:02.566825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:02.566825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:02.566825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:02.566825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:02.566825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:02.566825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:02.567826 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:02.567826 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:02.567826 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:02.567826 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:02.567826 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:02.567826 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:02.567826 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:02.567826 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:02.567826 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:02.567826 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:02.567826 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:56:02.567826 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:02.568655 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248db0f4-5873-45d8-a151-c559858d7645 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:02.568655 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248db0f4-5873-45d8-a151-c559858d7645 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:02.568655 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248db0f4-5873-45d8-a151-c559858d7645 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:02.571202 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 195/400] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:56:02.571368 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 205/400] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:56:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:02.572964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248db0f4-5873-45d8-a151-c559858d7645 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:02.575313 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae6762-497b-4a5f-bdb2-189c8ee0f610 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:02.575783 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae6762-497b-4a5f-bdb2-189c8ee0f610 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:02.576200 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae6762-497b-4a5f-bdb2-189c8ee0f610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:02.599376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-0cae6762-497b-4a5f-bdb2-189c8ee0f610 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:02.600835 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-0cae6762-497b-4a5f-bdb2-189c8ee0f610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:02.656479 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:02.740460 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 206/401] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:02.758157 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248db0f4-5873-45d8-a151-c559858d7645 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:02.765032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae6762-497b-4a5f-bdb2-189c8ee0f610 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:02.841295 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162da9a-7da8-4215-b81f-3af9ff031324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:02.841917 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162da9a-7da8-4215-b81f-3af9ff031324 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:02.842203 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162da9a-7da8-4215-b81f-3af9ff031324 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:02.842523 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162da9a-7da8-4215-b81f-3af9ff031324 None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:02.843186 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162da9a-7da8-4215-b81f-3af9ff031324 None admin] RBAC: Adding query filter params (name=member) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:02.843489 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162da9a-7da8-4215-b81f-3af9ff031324 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:02.847921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162da9a-7da8-4215-b81f-3af9ff031324 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:02.863827 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 196/402] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 23 07:56:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:02.869272 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162da9a-7da8-4215-b81f-3af9ff031324 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:02.959617 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae6762-497b-4a5f-bdb2-189c8ee0f610 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:02.965976 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:03.021397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3d610-acb0-4e8e-9999-88d303735ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:03.022453 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3d610-acb0-4e8e-9999-88d303735ebd None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:03.022931 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3d610-acb0-4e8e-9999-88d303735ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:03.023397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3d610-acb0-4e8e-9999-88d303735ebd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:03.032041 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162da9a-7da8-4215-b81f-3af9ff031324 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:03.035348 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3d610-acb0-4e8e-9999-88d303735ebd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:03.040452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-dfc3d610-acb0-4e8e-9999-88d303735ebd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:56:03.040452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:03.040452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:03.040452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:03.040452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:03.040452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:03.040452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:03.040452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:03.040452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:03.040452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:03.040452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:03.040452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:03.040452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:03.040452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:03.040452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:03.040452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:03.041337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:03.041337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:03.041337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:03.041337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:03.041337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:03.041337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:03.041337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:03.041337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:03.041337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:03.041337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:03.041337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:03.041337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:03.041337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:03.041337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:03.041337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:03.041337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:03.042124 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:03.042124 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:03.042124 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:03.042124 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:03.042124 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:03.042124 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:03.042124 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:03.042124 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:03.042124 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:03.042124 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:03.042124 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:56:03.042124 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:03.042124 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 207/403] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:56:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:03.042897 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3d610-acb0-4e8e-9999-88d303735ebd None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:03.073420 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2d1e6-8cf0-49cb-9284-7c685da020cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:03.074119 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:03.075452 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2d1e6-8cf0-49cb-9284-7c685da020cd None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:03.075825 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2d1e6-8cf0-49cb-9284-7c685da020cd None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:03.076193 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2d1e6-8cf0-49cb-9284-7c685da020cd None admin] PATH_INFO: `/v3/groups/7820e2aa76d9466c9932f89425e54e06` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:03.077405 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2d1e6-8cf0-49cb-9284-7c685da020cd None admin] RBAC: Authorizing `identity:get_group(group_id=7820e2aa76d9466c9932f89425e54e06)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:03.079015 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2d1e6-8cf0-49cb-9284-7c685da020cd None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:03.080873 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 197/404] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 23 07:56:02 2022] GET /identity/v3/groups/7820e2aa76d9466c9932f89425e54e06 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:03.085401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2d1e6-8cf0-49cb-9284-7c685da020cd None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:03.177265 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3d610-acb0-4e8e-9999-88d303735ebd None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:03.188083 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2d1e6-8cf0-49cb-9284-7c685da020cd None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:03.211677 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:03.222716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d304413-dd1b-4822-a6b1-596554801c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:03.223429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d304413-dd1b-4822-a6b1-596554801c8b None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:03.223766 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d304413-dd1b-4822-a6b1-596554801c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:03.224329 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d304413-dd1b-4822-a6b1-596554801c8b None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:03.225001 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d304413-dd1b-4822-a6b1-596554801c8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:03.225405 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d304413-dd1b-4822-a6b1-596554801c8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:03.226926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d304413-dd1b-4822-a6b1-596554801c8b None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:03.228616 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084be78-8087-4d0a-9594-9624bf0ed855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:03.229767 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084be78-8087-4d0a-9594-9624bf0ed855 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:03.230213 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084be78-8087-4d0a-9594-9624bf0ed855 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:03.231232 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084be78-8087-4d0a-9594-9624bf0ed855 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:03.241614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 198/405] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:56:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:03.241614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d304413-dd1b-4822-a6b1-596554801c8b None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:03.249821 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084be78-8087-4d0a-9594-9624bf0ed855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:03.256112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-5084be78-8087-4d0a-9594-9624bf0ed855 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:56:03.256112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:03.256112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:03.256112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:03.256112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:03.256112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:03.256112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:03.256112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:03.256112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:03.256112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:03.256112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:03.256112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:03.256112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:03.256112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:03.256112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:03.256112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:03.256977 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:03.256977 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:03.256977 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:03.256977 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:03.256977 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:03.256977 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:03.256977 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:03.256977 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:03.256977 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:03.256977 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:03.256977 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:03.256977 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:03.256977 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:03.256977 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:03.256977 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:03.256977 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:03.257868 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:03.257868 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:03.257868 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:03.257868 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:03.257868 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:03.257868 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:03.257868 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:03.257868 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:03.257868 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:03.257868 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:03.257868 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:56:03.257868 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:03.257868 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 208/406] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 23 07:56:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:03.258559 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084be78-8087-4d0a-9594-9624bf0ed855 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:03.359847 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d304413-dd1b-4822-a6b1-596554801c8b None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:03.365119 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:03.391081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084be78-8087-4d0a-9594-9624bf0ed855 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:03.398395 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23284f-81e9-46e2-a2ed-435686eb7f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:03.398395 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23284f-81e9-46e2-a2ed-435686eb7f8a None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:03.398395 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23284f-81e9-46e2-a2ed-435686eb7f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:03.398395 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23284f-81e9-46e2-a2ed-435686eb7f8a None admin] PATH_INFO: `/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:03.399369 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23284f-81e9-46e2-a2ed-435686eb7f8a None admin] RBAC: Authorizing `identity:get_project(project_id=b2061ddf744e4b65bc58158bbf9baf3c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:03.401016 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23284f-81e9-46e2-a2ed-435686eb7f8a None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:03.403912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 199/407] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:56:03 2022] GET /identity/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:03.404954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23284f-81e9-46e2-a2ed-435686eb7f8a None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:03.431899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a42d1-2f3c-4029-8f8b-684b506b8a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:03.432499 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a42d1-2f3c-4029-8f8b-684b506b8a8a None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:03.432784 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a42d1-2f3c-4029-8f8b-684b506b8a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:03.433057 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a42d1-2f3c-4029-8f8b-684b506b8a8a None admin] PATH_INFO: `/v3/groups/a99b148aa2bd4bbfb6e1842cfceffcb4` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:03.434916 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a42d1-2f3c-4029-8f8b-684b506b8a8a None admin] RBAC: Authorizing `identity:get_group(group_id=a99b148aa2bd4bbfb6e1842cfceffcb4)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:03.436385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a42d1-2f3c-4029-8f8b-684b506b8a8a None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:03.437969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 209/408] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 23 07:56:03 2022] GET /identity/v3/groups/a99b148aa2bd4bbfb6e1842cfceffcb4 => generated 229 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:03.438822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a42d1-2f3c-4029-8f8b-684b506b8a8a None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:03.480839 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:03.537739 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23284f-81e9-46e2-a2ed-435686eb7f8a None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:03.571527 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a42d1-2f3c-4029-8f8b-684b506b8a8a None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:03.576167 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03515755-2aac-438a-bb0c-714f84ba9275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:03.577026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03515755-2aac-438a-bb0c-714f84ba9275 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:03.577508 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03515755-2aac-438a-bb0c-714f84ba9275 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:03.577995 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03515755-2aac-438a-bb0c-714f84ba9275 None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:03.578919 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03515755-2aac-438a-bb0c-714f84ba9275 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:03.579435 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03515755-2aac-438a-bb0c-714f84ba9275 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:03.581142 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03515755-2aac-438a-bb0c-714f84ba9275 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:03.592311 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 200/409] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:03.593743 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03515755-2aac-438a-bb0c-714f84ba9275 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:03.616740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee144847-e929-4d34-806b-d87c96ffdb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:03.617410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee144847-e929-4d34-806b-d87c96ffdb18 None admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:03.617697 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee144847-e929-4d34-806b-d87c96ffdb18 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:03.617964 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee144847-e929-4d34-806b-d87c96ffdb18 None admin] PATH_INFO: `/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c/groups/7820e2aa76d9466c9932f89425e54e06/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:03.619926 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee144847-e929-4d34-806b-d87c96ffdb18 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2061ddf744e4b65bc58158bbf9baf3c, group_id=7820e2aa76d9466c9932f89425e54e06, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:03.622674 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee144847-e929-4d34-806b-d87c96ffdb18 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:03.706883 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03515755-2aac-438a-bb0c-714f84ba9275 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:03.724525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:03.750313 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 210/410] 10.222.0.57 () {58 vars in 1442 bytes} [Tue Aug 23 07:56:03 2022] PUT /identity/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c/groups/7820e2aa76d9466c9932f89425e54e06/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:56:03.750313 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee144847-e929-4d34-806b-d87c96ffdb18 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:03.767899 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8b388-e165-42cf-b312-51ec3ce5b133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:03.771325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8b388-e165-42cf-b312-51ec3ce5b133 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:03.771325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8b388-e165-42cf-b312-51ec3ce5b133 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:03.771325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8b388-e165-42cf-b312-51ec3ce5b133 None admin] PATH_INFO: `/v3/projects/89fa3cf81b7a47a1bca14aee1213ee84` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:03.771928 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:03.772335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8b388-e165-42cf-b312-51ec3ce5b133 None admin] RBAC: Authorizing `identity:get_project(project_id=89fa3cf81b7a47a1bca14aee1213ee84)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:03.773974 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8b388-e165-42cf-b312-51ec3ce5b133 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:03.775714 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 201/411] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:56:03 2022] GET /identity/v3/projects/89fa3cf81b7a47a1bca14aee1213ee84 => generated 344 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:03.781752 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8b388-e165-42cf-b312-51ec3ce5b133 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:03.943380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee144847-e929-4d34-806b-d87c96ffdb18 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:03.972741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8b388-e165-42cf-b312-51ec3ce5b133 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:03.990569 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6aed1a-bfdd-4097-820e-c5ce66da81f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:03.991302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aed1a-bfdd-4097-820e-c5ce66da81f9 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:03.991653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aed1a-bfdd-4097-820e-c5ce66da81f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:03.992283 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aed1a-bfdd-4097-820e-c5ce66da81f9 None admin] PATH_INFO: `/v3/groups/7820e2aa76d9466c9932f89425e54e06` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:03.993299 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6aed1a-bfdd-4097-820e-c5ce66da81f9 None admin] RBAC: Authorizing `identity:get_group(group_id=7820e2aa76d9466c9932f89425e54e06)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:03.994873 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6aed1a-bfdd-4097-820e-c5ce66da81f9 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:03.998169 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 211/412] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 23 07:56:03 2022] GET /identity/v3/groups/7820e2aa76d9466c9932f89425e54e06 => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:04.004220 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6aed1a-bfdd-4097-820e-c5ce66da81f9 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:04.019946 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba92cec-64f6-4e9f-9b0e-4d2cf3da4404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:04.021237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba92cec-64f6-4e9f-9b0e-4d2cf3da4404 None admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:04.021237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba92cec-64f6-4e9f-9b0e-4d2cf3da4404 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:04.021450 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba92cec-64f6-4e9f-9b0e-4d2cf3da4404 None admin] PATH_INFO: `/v3/projects/89fa3cf81b7a47a1bca14aee1213ee84/groups/a99b148aa2bd4bbfb6e1842cfceffcb4/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:04.023769 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba92cec-64f6-4e9f-9b0e-4d2cf3da4404 None admin] RBAC: Authorizing `identity:create_grant(project_id=89fa3cf81b7a47a1bca14aee1213ee84, group_id=a99b148aa2bd4bbfb6e1842cfceffcb4, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:04.025301 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba92cec-64f6-4e9f-9b0e-4d2cf3da4404 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:04.100114 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 202/413] 10.222.0.57 () {58 vars in 1442 bytes} [Tue Aug 23 07:56:03 2022] PUT /identity/v3/projects/89fa3cf81b7a47a1bca14aee1213ee84/groups/a99b148aa2bd4bbfb6e1842cfceffcb4/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:56:04.107664 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:04.133228 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6aed1a-bfdd-4097-820e-c5ce66da81f9 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:04.171554 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f638468-b174-4237-89bb-ee76c39871df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:04.172193 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f638468-b174-4237-89bb-ee76c39871df None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:04.172520 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f638468-b174-4237-89bb-ee76c39871df None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:04.172839 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f638468-b174-4237-89bb-ee76c39871df None admin] PATH_INFO: `/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:04.174248 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f638468-b174-4237-89bb-ee76c39871df None admin] RBAC: Authorizing `identity:get_project(project_id=b2061ddf744e4b65bc58158bbf9baf3c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:04.176093 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f638468-b174-4237-89bb-ee76c39871df None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:04.178301 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 212/414] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:56:04 2022] GET /identity/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:56:04.184337 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba92cec-64f6-4e9f-9b0e-4d2cf3da4404 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:04.265612 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:04.288662 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa95f0-e543-4408-8f9e-48513a1e9524 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:04.288991 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa95f0-e543-4408-8f9e-48513a1e9524 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:04.289210 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa95f0-e543-4408-8f9e-48513a1e9524 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:04.290913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 213/415] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:56:04.302737 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a986f94-3fbe-4eb5-bf13-e86d34d3b3d7 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:04.303041 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a986f94-3fbe-4eb5-bf13-e86d34d3b3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:04.303808 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a986f94-3fbe-4eb5-bf13-e86d34d3b3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:04.343718 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-0a986f94-3fbe-4eb5-bf13-e86d34d3b3d7 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:04.344982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-0a986f94-3fbe-4eb5-bf13-e86d34d3b3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:04.356863 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba92cec-64f6-4e9f-9b0e-4d2cf3da4404 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:04.397660 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcf170-6479-4e4b-a622-ed9fc682b52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:04.398362 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcf170-6479-4e4b-a622-ed9fc682b52b None admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:04.398710 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcf170-6479-4e4b-a622-ed9fc682b52b None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:04.398993 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcf170-6479-4e4b-a622-ed9fc682b52b None admin] PATH_INFO: `/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c/groups/7820e2aa76d9466c9932f89425e54e06/roles/4e9a14889d764731b59323f764f1bb85` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:04.401231 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afcf170-6479-4e4b-a622-ed9fc682b52b None admin] RBAC: Authorizing `identity:create_grant(project_id=b2061ddf744e4b65bc58158bbf9baf3c, group_id=7820e2aa76d9466c9932f89425e54e06, role_id=4e9a14889d764731b59323f764f1bb85)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:04.403249 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afcf170-6479-4e4b-a622-ed9fc682b52b None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:04.444264 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 214/416] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 23 07:56:04.477286 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 203/417] 10.222.0.57 () {58 vars in 1442 bytes} [Tue Aug 23 07:56:04 2022] PUT /identity/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c/groups/7820e2aa76d9466c9932f89425e54e06/roles/4e9a14889d764731b59323f764f1bb85 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:56:04.498477 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c4718-38dd-43ef-b1ee-1ce9c11beaec None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:04.498812 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c4718-38dd-43ef-b1ee-1ce9c11beaec None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:04.499027 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c4718-38dd-43ef-b1ee-1ce9c11beaec None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:04.500507 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 215/418] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:04.506397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91199d2d-a3fd-44d6-8e13-167cf1fe6200 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:04.506690 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91199d2d-a3fd-44d6-8e13-167cf1fe6200 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:04.510479 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91199d2d-a3fd-44d6-8e13-167cf1fe6200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:04.531620 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-91199d2d-a3fd-44d6-8e13-167cf1fe6200 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:04.532800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-91199d2d-a3fd-44d6-8e13-167cf1fe6200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:04.616276 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 204/419] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:04.827461 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c4718-38dd-43ef-b1ee-1ce9c11beaec None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:04.922423 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:04.938101 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91199d2d-a3fd-44d6-8e13-167cf1fe6200 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:04.969694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c4718-38dd-43ef-b1ee-1ce9c11beaec None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:04.994793 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:05.041178 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a19fc-e713-401b-8523-0572a703bdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:05.042451 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a19fc-e713-401b-8523-0572a703bdb6 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:05.042818 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a19fc-e713-401b-8523-0572a703bdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:05.043721 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a19fc-e713-401b-8523-0572a703bdb6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:05.069180 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a19fc-e713-401b-8523-0572a703bdb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:05.074753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-a02a19fc-e713-401b-8523-0572a703bdb6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:56:05.074753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:05.074753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:05.074753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:05.074753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:05.074753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:05.074753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:05.074753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:05.074753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:05.074753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:05.074753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:05.074753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:05.074753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:05.074753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:05.074753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:05.074753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:05.075749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:05.075749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:05.075749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:05.075749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:05.075749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:05.075749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:05.075749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:05.075749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:05.075749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:05.075749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:05.075749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:05.075749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:05.075749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:05.075749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:05.075749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:05.075749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:05.076783 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:05.076783 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:05.076783 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:05.076783 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:05.076783 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:05.076783 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:05.076783 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:05.076783 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:05.076783 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:05.076783 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:05.076783 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:56:05.076783 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:05.085755 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 216/420] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 23 07:56:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:05.102064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91199d2d-a3fd-44d6-8e13-167cf1fe6200 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:05.108957 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a19fc-e713-401b-8523-0572a703bdb6 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:05.158826 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca939e-52b8-4f58-a3e0-02ac4586e017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:05.159727 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca939e-52b8-4f58-a3e0-02ac4586e017 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:05.160147 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca939e-52b8-4f58-a3e0-02ac4586e017 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:05.160569 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca939e-52b8-4f58-a3e0-02ac4586e017 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:05.171524 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca939e-52b8-4f58-a3e0-02ac4586e017 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:05.176537 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-29ca939e-52b8-4f58-a3e0-02ac4586e017 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:56:05.176537 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:05.176537 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:05.176537 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:05.176537 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:05.176537 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:05.176537 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:05.176537 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:05.176537 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:05.176537 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:05.176537 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:05.176537 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:05.176537 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:05.176537 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:05.176537 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:05.176537 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:05.177622 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:05.177622 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:05.177622 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:05.177622 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:05.177622 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:05.177622 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:05.177622 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:05.177622 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:05.177622 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:05.177622 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:05.177622 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:05.177622 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:05.177622 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:05.177622 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:05.177622 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:05.177622 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:05.178623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:05.178623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:05.178623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:05.178623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:05.178623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:05.178623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:05.178623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:05.178623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:05.178623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:05.178623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:05.178623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:56:05.178623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:05.180730 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 205/421] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:56:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:05.189151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca939e-52b8-4f58-a3e0-02ac4586e017 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:05.318358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:05.320231 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a19fc-e713-401b-8523-0572a703bdb6 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:05.327351 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca939e-52b8-4f58-a3e0-02ac4586e017 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:05.363862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e53e3c-0fca-45e9-a996-78b4f0b2d3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:05.364753 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e53e3c-0fca-45e9-a996-78b4f0b2d3d7 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:05.365215 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e53e3c-0fca-45e9-a996-78b4f0b2d3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:05.365680 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e53e3c-0fca-45e9-a996-78b4f0b2d3d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:05.366534 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e53e3c-0fca-45e9-a996-78b4f0b2d3d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:05.367019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e53e3c-0fca-45e9-a996-78b4f0b2d3d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:05.368625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e53e3c-0fca-45e9-a996-78b4f0b2d3d7 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:05.377390 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 206/422] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 23 07:56:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:05.382944 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e53e3c-0fca-45e9-a996-78b4f0b2d3d7 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:05.395239 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234adc6-f1e2-4de4-8ed4-d4b9709652ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:05.395718 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234adc6-f1e2-4de4-8ed4-d4b9709652ef None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:05.396006 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234adc6-f1e2-4de4-8ed4-d4b9709652ef None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:05.396284 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234adc6-f1e2-4de4-8ed4-d4b9709652ef None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:05.396951 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234adc6-f1e2-4de4-8ed4-d4b9709652ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:05.397255 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234adc6-f1e2-4de4-8ed4-d4b9709652ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:05.398660 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234adc6-f1e2-4de4-8ed4-d4b9709652ef None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:05.410854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:05.415964 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 217/423] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:56:05.431314 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234adc6-f1e2-4de4-8ed4-d4b9709652ef None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:05.496447 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e53e3c-0fca-45e9-a996-78b4f0b2d3d7 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:05.534154 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b9d7a-9481-402c-910d-84a5df91b508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:05.534800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b9d7a-9481-402c-910d-84a5df91b508 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:05.535080 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b9d7a-9481-402c-910d-84a5df91b508 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:05.535351 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b9d7a-9481-402c-910d-84a5df91b508 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:05.561958 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:05.571958 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234adc6-f1e2-4de4-8ed4-d4b9709652ef None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:05.610331 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b9d7a-9481-402c-910d-84a5df91b508 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:05.610331 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b9d7a-9481-402c-910d-84a5df91b508 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:05.616855 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf2833-7a6d-4c70-983f-04e8117a9bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:05.617743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf2833-7a6d-4c70-983f-04e8117a9bfa None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:05.618227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf2833-7a6d-4c70-983f-04e8117a9bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:05.618718 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf2833-7a6d-4c70-983f-04e8117a9bfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:05.708252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:05.718768 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf2833-7a6d-4c70-983f-04e8117a9bfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:05.720290 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf2833-7a6d-4c70-983f-04e8117a9bfa None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:05.753179 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 207/424] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:56:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 07:56:05.766879 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b9d7a-9481-402c-910d-84a5df91b508 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:05.828490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:05.876715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b9d7a-9481-402c-910d-84a5df91b508 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:05.912750 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c181c-f36d-42cd-8e14-baa72ee2bdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:05.913774 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c181c-f36d-42cd-8e14-baa72ee2bdbb None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:05.914264 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c181c-f36d-42cd-8e14-baa72ee2bdbb None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:05.914794 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c181c-f36d-42cd-8e14-baa72ee2bdbb None admin] PATH_INFO: `/v3/projects/dbd8608370894c55b5729ce6902c5722` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:05.916130 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c181c-f36d-42cd-8e14-baa72ee2bdbb None admin] RBAC: Authorizing `identity:get_project(project_id=dbd8608370894c55b5729ce6902c5722)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:05.917956 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c181c-f36d-42cd-8e14-baa72ee2bdbb None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:05.920165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 208/425] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:56:05 2022] GET /identity/v3/projects/dbd8608370894c55b5729ce6902c5722 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:56:05.925778 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c181c-f36d-42cd-8e14-baa72ee2bdbb None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:05.930368 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 218/426] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:56:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:56:05.939070 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf2833-7a6d-4c70-983f-04e8117a9bfa None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:06.078405 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c181c-f36d-42cd-8e14-baa72ee2bdbb None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:06.103377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:06.116246 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bed70-8e4d-4a22-a925-bd0698a3c1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:06.117155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bed70-8e4d-4a22-a925-bd0698a3c1a3 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:06.117701 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bed70-8e4d-4a22-a925-bd0698a3c1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:06.118166 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bed70-8e4d-4a22-a925-bd0698a3c1a3 None admin] PATH_INFO: `/v3/groups/7820e2aa76d9466c9932f89425e54e06` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:06.119474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5bed70-8e4d-4a22-a925-bd0698a3c1a3 None admin] RBAC: Authorizing `identity:get_group(group_id=7820e2aa76d9466c9932f89425e54e06)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:06.121359 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5bed70-8e4d-4a22-a925-bd0698a3c1a3 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:06.123460 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 209/427] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 23 07:56:05 2022] GET /identity/v3/groups/7820e2aa76d9466c9932f89425e54e06 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:06.135382 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bed70-8e4d-4a22-a925-bd0698a3c1a3 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:06.144706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:06.153735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf2833-7a6d-4c70-983f-04e8117a9bfa None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:06.189521 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a520d5-5d57-45b2-82b9-a11b9d40b55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:06.190154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a520d5-5d57-45b2-82b9-a11b9d40b55e None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:06.190464 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a520d5-5d57-45b2-82b9-a11b9d40b55e None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:06.190740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a520d5-5d57-45b2-82b9-a11b9d40b55e None admin] PATH_INFO: `/v3/projects/dbd8608370894c55b5729ce6902c5722` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:06.191863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a520d5-5d57-45b2-82b9-a11b9d40b55e None admin] RBAC: Authorizing `identity:get_project(project_id=dbd8608370894c55b5729ce6902c5722)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:06.193325 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a520d5-5d57-45b2-82b9-a11b9d40b55e None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:06.194977 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 219/428] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:56:05 2022] GET /identity/v3/projects/dbd8608370894c55b5729ce6902c5722 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:06.201238 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a520d5-5d57-45b2-82b9-a11b9d40b55e None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:06.301619 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bed70-8e4d-4a22-a925-bd0698a3c1a3 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:06.310532 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a520d5-5d57-45b2-82b9-a11b9d40b55e None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:06.345139 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43120af0-32b0-40be-aee2-8471de7fea4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:06.346663 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43120af0-32b0-40be-aee2-8471de7fea4b None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:06.346950 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43120af0-32b0-40be-aee2-8471de7fea4b None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:06.347224 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43120af0-32b0-40be-aee2-8471de7fea4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:06.347956 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43120af0-32b0-40be-aee2-8471de7fea4b None admin] RBAC: Adding query filter params (group.id=7820e2aa76d9466c9932f89425e54e06, role.id=4ed852223bc54be09a9487ff788b7644, scope.project.id=dbd8608370894c55b5729ce6902c5722) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:06.348261 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43120af0-32b0-40be-aee2-8471de7fea4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:06.349695 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43120af0-32b0-40be-aee2-8471de7fea4b None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:06.353102 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc76f45-bd9d-4bb9-868e-6bb08fa7e062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:06.354261 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc76f45-bd9d-4bb9-868e-6bb08fa7e062 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:06.354758 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc76f45-bd9d-4bb9-868e-6bb08fa7e062 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:06.355236 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc76f45-bd9d-4bb9-868e-6bb08fa7e062 None admin] PATH_INFO: `/v3/groups/7820e2aa76d9466c9932f89425e54e06` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:06.357116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc76f45-bd9d-4bb9-868e-6bb08fa7e062 None admin] RBAC: Authorizing `identity:get_group(group_id=7820e2aa76d9466c9932f89425e54e06)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:06.358796 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc76f45-bd9d-4bb9-868e-6bb08fa7e062 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:06.360936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 220/430] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 23 07:56:06 2022] GET /identity/v3/groups/7820e2aa76d9466c9932f89425e54e06 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:56:06.362366 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fbf43-b06f-4e9e-9b94-b0559b2f667d None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:06.362856 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fbf43-b06f-4e9e-9b94-b0559b2f667d None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:06.363326 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fbf43-b06f-4e9e-9b94-b0559b2f667d None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:06.364700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 221/431] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:06.365338 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 210/431] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 23 07:56:06 2022] GET /identity/v3/role_assignments?group.id=7820e2aa76d9466c9932f89425e54e06&scope.project.id=dbd8608370894c55b5729ce6902c5722&role.id=4ed852223bc54be09a9487ff788b7644 => generated 611 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:06.366388 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fbf43-b06f-4e9e-9b94-b0559b2f667d None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:06.375172 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8905859-686d-4e12-ae3d-6a01165ba824 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:06.375172 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8905859-686d-4e12-ae3d-6a01165ba824 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:06.375172 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8905859-686d-4e12-ae3d-6a01165ba824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:06.394104 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-d8905859-686d-4e12-ae3d-6a01165ba824 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:06.395449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-d8905859-686d-4e12-ae3d-6a01165ba824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:06.443624 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:06.495745 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:06.526884 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 211/432] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:06.556001 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fbf43-b06f-4e9e-9b94-b0559b2f667d None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:06.592978 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065ada8-69a5-4436-afc6-4f0a6bbd4e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:06.593595 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065ada8-69a5-4436-afc6-4f0a6bbd4e20 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:06.593862 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065ada8-69a5-4436-afc6-4f0a6bbd4e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:06.594133 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065ada8-69a5-4436-afc6-4f0a6bbd4e20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:06.594886 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065ada8-69a5-4436-afc6-4f0a6bbd4e20 None admin] RBAC: Adding query filter params (group.id=7820e2aa76d9466c9932f89425e54e06, role.id=4e9a14889d764731b59323f764f1bb85, scope.project.id=dbd8608370894c55b5729ce6902c5722) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:06.595192 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065ada8-69a5-4436-afc6-4f0a6bbd4e20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:06.596702 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065ada8-69a5-4436-afc6-4f0a6bbd4e20 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:06.603389 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 222/433] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 23 07:56:06 2022] GET /identity/v3/role_assignments?group.id=7820e2aa76d9466c9932f89425e54e06&scope.project.id=dbd8608370894c55b5729ce6902c5722&role.id=4e9a14889d764731b59323f764f1bb85 => generated 611 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:06.706616 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3dc15-e015-431e-a11f-b1766676a691 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:06.707449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3dc15-e015-431e-a11f-b1766676a691 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:06.707938 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3dc15-e015-431e-a11f-b1766676a691 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:06.709838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 212/434] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:06.716238 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ad949-fd94-43d6-a223-ec1ec75eb153 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:06.716521 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ad949-fd94-43d6-a223-ec1ec75eb153 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:06.716785 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ad949-fd94-43d6-a223-ec1ec75eb153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:06.738177 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-ac3ad949-fd94-43d6-a223-ec1ec75eb153 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:06.739708 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-ac3ad949-fd94-43d6-a223-ec1ec75eb153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:06.792260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620394c8-5d89-4a28-b333-df8145a8ab85 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:06.792569 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620394c8-5d89-4a28-b333-df8145a8ab85 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:06.793323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620394c8-5d89-4a28-b333-df8145a8ab85 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:06.795713 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 213/435] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:06.801050 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e0aec-0204-4115-a9bd-5ab91463c97d None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:06.801336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e0aec-0204-4115-a9bd-5ab91463c97d None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:06.801615 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e0aec-0204-4115-a9bd-5ab91463c97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:06.825368 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-2a0e0aec-0204-4115-a9bd-5ab91463c97d None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:06.826635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-2a0e0aec-0204-4115-a9bd-5ab91463c97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:06.827003 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 223/436] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:06.846569 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ad949-fd94-43d6-a223-ec1ec75eb153 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:06.882834 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:06.910710 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 214/437] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:56:06.990302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ad949-fd94-43d6-a223-ec1ec75eb153 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:07.029196 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f68b18-1b18-4858-a9f7-19941b0e9ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:07.030069 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f68b18-1b18-4858-a9f7-19941b0e9ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:07.030381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f68b18-1b18-4858-a9f7-19941b0e9ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:07.030659 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f68b18-1b18-4858-a9f7-19941b0e9ae8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:07.042038 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f68b18-1b18-4858-a9f7-19941b0e9ae8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:07.047296 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-d1f68b18-1b18-4858-a9f7-19941b0e9ae8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:56:07.047296 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:07.047296 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:07.047296 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:07.047296 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:07.047296 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:07.047296 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:07.047296 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:07.047296 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:07.047296 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:07.047296 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:07.047296 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:07.047296 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:07.047296 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:07.047296 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:07.047296 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:07.048168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:07.048168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:07.048168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:07.048168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:07.048168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:07.048168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:07.048168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:07.048168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:07.048168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:07.048168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:07.048168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:07.048168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:07.048168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:07.048168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:07.048168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:07.048168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:07.048951 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:07.048951 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:07.048951 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:07.048951 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:07.048951 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:07.048951 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:07.048951 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:07.048951 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:07.048951 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:07.048951 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:07.048951 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:56:07.048951 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:07.048951 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 224/438] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:56:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:07.054273 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e0aec-0204-4115-a9bd-5ab91463c97d None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:07.117253 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f68b18-1b18-4858-a9f7-19941b0e9ae8 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:07.174717 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e0aec-0204-4115-a9bd-5ab91463c97d None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:07.194246 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:07.224948 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a63fa4-d96e-40eb-aa25-faca35720c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:07.225889 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a63fa4-d96e-40eb-aa25-faca35720c4e None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:07.226427 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a63fa4-d96e-40eb-aa25-faca35720c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:07.227012 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:07.227827 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a63fa4-d96e-40eb-aa25-faca35720c4e None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:07.228583 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a63fa4-d96e-40eb-aa25-faca35720c4e None admin] RBAC: Adding query filter params (name=member) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:07.228897 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a63fa4-d96e-40eb-aa25-faca35720c4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:07.230603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a63fa4-d96e-40eb-aa25-faca35720c4e None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:07.240029 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 215/439] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 23 07:56:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:07.241091 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a63fa4-d96e-40eb-aa25-faca35720c4e None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:07.241223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f68b18-1b18-4858-a9f7-19941b0e9ae8 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:07.283808 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e435ad8-6b94-4191-909f-14df46dc8f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:07.284475 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e435ad8-6b94-4191-909f-14df46dc8f2d None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:07.284746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e435ad8-6b94-4191-909f-14df46dc8f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:07.285019 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e435ad8-6b94-4191-909f-14df46dc8f2d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:07.296168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e435ad8-6b94-4191-909f-14df46dc8f2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:07.301395 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-2e435ad8-6b94-4191-909f-14df46dc8f2d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:56:07.301395 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:07.301395 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:07.301395 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:07.301395 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:07.301395 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:07.301395 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:07.301395 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:07.301395 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:07.301395 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:07.301395 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:07.301395 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:07.301395 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:07.301395 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:07.301395 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:07.301395 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:07.302488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:07.302488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:07.302488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:07.302488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:07.302488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:07.302488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:07.302488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:07.302488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:07.302488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:07.302488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:07.302488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:07.302488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:07.302488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:07.302488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:07.302488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:07.302488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:07.307788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:07.307788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:07.307788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:07.307788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:07.307788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:07.307788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:07.307788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:07.307788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:07.307788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:07.307788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:07.307788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:56:07.307788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:07.307788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 225/440] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 23 07:56:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:07.307788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e435ad8-6b94-4191-909f-14df46dc8f2d None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:07.353047 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a63fa4-d96e-40eb-aa25-faca35720c4e None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:07.385679 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8031b68-db50-4326-a426-d3bd3d584ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:07.386326 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8031b68-db50-4326-a426-d3bd3d584ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:07.386640 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8031b68-db50-4326-a426-d3bd3d584ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:07.386913 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8031b68-db50-4326-a426-d3bd3d584ed6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:07.396874 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8031b68-db50-4326-a426-d3bd3d584ed6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:07.402788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-a8031b68-db50-4326-a426-d3bd3d584ed6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:56:07.402788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:07.402788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:07.402788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:07.402788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:07.402788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:07.402788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:07.402788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:07.402788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:07.402788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:07.402788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:07.402788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:07.402788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:07.402788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:07.402788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:07.402788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:07.403994 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:07.403994 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:07.403994 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:07.403994 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:07.403994 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:07.403994 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:07.403994 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:07.403994 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:07.403994 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:07.403994 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:07.403994 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:07.403994 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:07.403994 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:07.403994 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:07.403994 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:07.403994 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:07.404828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:07.404828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:07.404828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:07.404828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:07.404828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:07.404828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:07.404828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:07.404828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:07.404828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:07.404828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:07.404828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:56:07.404828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:07.405471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e435ad8-6b94-4191-909f-14df46dc8f2d None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:07.406577 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 216/441] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:56:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:07.407269 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8031b68-db50-4326-a426-d3bd3d584ed6 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:07.436636 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4294b-2577-4781-92fb-1d73e8d98e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:07.437163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4294b-2577-4781-92fb-1d73e8d98e22 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:07.437440 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4294b-2577-4781-92fb-1d73e8d98e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:07.437715 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4294b-2577-4781-92fb-1d73e8d98e22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:07.446549 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:07.455600 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:07.503488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4294b-2577-4781-92fb-1d73e8d98e22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:07.504946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4294b-2577-4781-92fb-1d73e8d98e22 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:07.505069 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8031b68-db50-4326-a426-d3bd3d584ed6 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:07.540473 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47edf5-333f-4b3b-9a82-e5af54afdc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:07.541088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47edf5-333f-4b3b-9a82-e5af54afdc20 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:07.541371 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47edf5-333f-4b3b-9a82-e5af54afdc20 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:07.541641 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47edf5-333f-4b3b-9a82-e5af54afdc20 None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:07.542328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47edf5-333f-4b3b-9a82-e5af54afdc20 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:07.542628 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47edf5-333f-4b3b-9a82-e5af54afdc20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:07.544827 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47edf5-333f-4b3b-9a82-e5af54afdc20 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:07.555202 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 217/442] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:07.556030 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47edf5-333f-4b3b-9a82-e5af54afdc20 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:07.610986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 226/443] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:56:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:56:07.611670 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4294b-2577-4781-92fb-1d73e8d98e22 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:07.662767 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:07.666664 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:07.669601 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47edf5-333f-4b3b-9a82-e5af54afdc20 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:07.703094 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcb731-df04-453d-a8a6-7e3f9d61e6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:07.703707 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcb731-df04-453d-a8a6-7e3f9d61e6c2 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:07.703993 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcb731-df04-453d-a8a6-7e3f9d61e6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:07.704267 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcb731-df04-453d-a8a6-7e3f9d61e6c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:07.704955 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcb731-df04-453d-a8a6-7e3f9d61e6c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:07.705257 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcb731-df04-453d-a8a6-7e3f9d61e6c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:07.706685 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcb731-df04-453d-a8a6-7e3f9d61e6c2 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:07.712754 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4294b-2577-4781-92fb-1d73e8d98e22 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:07.714498 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 218/444] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:56:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:07.715998 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcb731-df04-453d-a8a6-7e3f9d61e6c2 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:07.747287 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e50f45-cf48-4859-8598-4fb584e9a6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:07.747883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e50f45-cf48-4859-8598-4fb584e9a6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:07.748161 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e50f45-cf48-4859-8598-4fb584e9a6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:07.748432 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e50f45-cf48-4859-8598-4fb584e9a6f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:07.813068 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcb731-df04-453d-a8a6-7e3f9d61e6c2 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:07.815028 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e50f45-cf48-4859-8598-4fb584e9a6f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:07.816488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e50f45-cf48-4859-8598-4fb584e9a6f4 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:07.846018 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93845e5-b945-4027-a9c4-4af8a97223cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:07.846659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93845e5-b945-4027-a9c4-4af8a97223cc None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:07.846937 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93845e5-b945-4027-a9c4-4af8a97223cc None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:07.847210 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93845e5-b945-4027-a9c4-4af8a97223cc None admin] PATH_INFO: `/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:07.848312 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93845e5-b945-4027-a9c4-4af8a97223cc None admin] RBAC: Authorizing `identity:get_project(project_id=b2061ddf744e4b65bc58158bbf9baf3c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:07.849744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93845e5-b945-4027-a9c4-4af8a97223cc None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:07.851376 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 219/445] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:56:07 2022] GET /identity/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:07.852124 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93845e5-b945-4027-a9c4-4af8a97223cc None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:07.865513 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:07.881440 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:07.917941 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 227/446] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:56:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:56:07.918830 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e50f45-cf48-4859-8598-4fb584e9a6f4 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:07.951482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93845e5-b945-4027-a9c4-4af8a97223cc None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:07.984416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d81232-b1ba-4fad-9850-08f16e19bb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:07.984954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d81232-b1ba-4fad-9850-08f16e19bb6d None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:07.985235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d81232-b1ba-4fad-9850-08f16e19bb6d None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:07.985506 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d81232-b1ba-4fad-9850-08f16e19bb6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:08.016621 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e50f45-cf48-4859-8598-4fb584e9a6f4 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:08.049651 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb325b-40b4-464b-842d-c25086ce6564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:08.050269 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb325b-40b4-464b-842d-c25086ce6564 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:08.050599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb325b-40b4-464b-842d-c25086ce6564 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:08.050699 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d81232-b1ba-4fad-9850-08f16e19bb6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:08.050869 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb325b-40b4-464b-842d-c25086ce6564 None admin] PATH_INFO: `/v3/groups/7820e2aa76d9466c9932f89425e54e06` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:08.051956 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb325b-40b4-464b-842d-c25086ce6564 None admin] RBAC: Authorizing `identity:get_group(group_id=7820e2aa76d9466c9932f89425e54e06)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:08.052155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d81232-b1ba-4fad-9850-08f16e19bb6d None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:08.053370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb325b-40b4-464b-842d-c25086ce6564 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:08.054949 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 228/447] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 23 07:56:07 2022] GET /identity/v3/groups/7820e2aa76d9466c9932f89425e54e06 => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:08.055701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb325b-40b4-464b-842d-c25086ce6564 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:08.072942 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:08.081685 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:08.149192 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 220/448] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:56:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:56:08.149967 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d81232-b1ba-4fad-9850-08f16e19bb6d None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:08.155230 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb325b-40b4-464b-842d-c25086ce6564 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:08.188430 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7faff9-b681-4bbd-95bb-9c347a00a557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:08.189056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7faff9-b681-4bbd-95bb-9c347a00a557 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:08.189336 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7faff9-b681-4bbd-95bb-9c347a00a557 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:08.189609 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7faff9-b681-4bbd-95bb-9c347a00a557 None admin] PATH_INFO: `/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:08.190756 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7faff9-b681-4bbd-95bb-9c347a00a557 None admin] RBAC: Authorizing `identity:get_project(project_id=b2061ddf744e4b65bc58158bbf9baf3c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:08.192179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7faff9-b681-4bbd-95bb-9c347a00a557 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:08.193784 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 229/449] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:56:08 2022] GET /identity/v3/projects/b2061ddf744e4b65bc58158bbf9baf3c => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:08.194568 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7faff9-b681-4bbd-95bb-9c347a00a557 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:08.252192 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d81232-b1ba-4fad-9850-08f16e19bb6d None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:08.276032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:08.279992 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:08.285686 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06269717-8bf9-4e99-ad63-7a3494cd6bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:08.290778 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06269717-8bf9-4e99-ad63-7a3494cd6bfe None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:08.290778 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06269717-8bf9-4e99-ad63-7a3494cd6bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:08.290778 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06269717-8bf9-4e99-ad63-7a3494cd6bfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:08.290778 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06269717-8bf9-4e99-ad63-7a3494cd6bfe None admin] RBAC: Adding query filter params (group.id=7820e2aa76d9466c9932f89425e54e06, role.id=4ed852223bc54be09a9487ff788b7644, scope.project.id=b2061ddf744e4b65bc58158bbf9baf3c) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:08.290778 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06269717-8bf9-4e99-ad63-7a3494cd6bfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:08.290778 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06269717-8bf9-4e99-ad63-7a3494cd6bfe None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:08.292913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7faff9-b681-4bbd-95bb-9c347a00a557 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:08.306558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 221/450] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 23 07:56:08 2022] GET /identity/v3/role_assignments?group.id=7820e2aa76d9466c9932f89425e54e06&scope.project.id=b2061ddf744e4b65bc58158bbf9baf3c&role.id=4ed852223bc54be09a9487ff788b7644 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:08.306558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06269717-8bf9-4e99-ad63-7a3494cd6bfe None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:08.334952 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f178ec5-a65d-41ab-9ddf-cd8e8db66391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:08.335601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f178ec5-a65d-41ab-9ddf-cd8e8db66391 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:08.335879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f178ec5-a65d-41ab-9ddf-cd8e8db66391 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:08.336152 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f178ec5-a65d-41ab-9ddf-cd8e8db66391 None admin] PATH_INFO: `/v3/projects/89fa3cf81b7a47a1bca14aee1213ee84` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:08.337308 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f178ec5-a65d-41ab-9ddf-cd8e8db66391 None admin] RBAC: Authorizing `identity:get_project(project_id=89fa3cf81b7a47a1bca14aee1213ee84)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:08.339534 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f178ec5-a65d-41ab-9ddf-cd8e8db66391 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:08.343673 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 230/451] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:56:08 2022] GET /identity/v3/projects/89fa3cf81b7a47a1bca14aee1213ee84 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:08.348876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f178ec5-a65d-41ab-9ddf-cd8e8db66391 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:08.412653 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06269717-8bf9-4e99-ad63-7a3494cd6bfe None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:08.453934 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0177f17-1477-4e99-a9ad-7eaaadcf0198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:08.462524 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0177f17-1477-4e99-a9ad-7eaaadcf0198 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:08.462524 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0177f17-1477-4e99-a9ad-7eaaadcf0198 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:08.462524 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0177f17-1477-4e99-a9ad-7eaaadcf0198 None admin] PATH_INFO: `/v3/groups/7820e2aa76d9466c9932f89425e54e06` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:08.462524 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0177f17-1477-4e99-a9ad-7eaaadcf0198 None admin] RBAC: Authorizing `identity:get_group(group_id=7820e2aa76d9466c9932f89425e54e06)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:08.462524 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0177f17-1477-4e99-a9ad-7eaaadcf0198 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:08.462524 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 222/452] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 23 07:56:08 2022] GET /identity/v3/groups/7820e2aa76d9466c9932f89425e54e06 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:08.466551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0177f17-1477-4e99-a9ad-7eaaadcf0198 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:08.472478 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f178ec5-a65d-41ab-9ddf-cd8e8db66391 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:08.517919 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf9f77-09b9-46b8-a562-66674b05ccd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:08.518234 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf9f77-09b9-46b8-a562-66674b05ccd3 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:08.518501 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf9f77-09b9-46b8-a562-66674b05ccd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:08.518777 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf9f77-09b9-46b8-a562-66674b05ccd3 None admin] PATH_INFO: `/v3/groups/a99b148aa2bd4bbfb6e1842cfceffcb4` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:08.521426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf9f77-09b9-46b8-a562-66674b05ccd3 None admin] RBAC: Authorizing `identity:get_group(group_id=a99b148aa2bd4bbfb6e1842cfceffcb4)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:08.521538 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf9f77-09b9-46b8-a562-66674b05ccd3 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:08.523137 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 231/453] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 23 07:56:08 2022] GET /identity/v3/groups/a99b148aa2bd4bbfb6e1842cfceffcb4 => generated 229 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:08.530508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf9f77-09b9-46b8-a562-66674b05ccd3 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:08.535431 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:08.555008 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:08.577128 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0177f17-1477-4e99-a9ad-7eaaadcf0198 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:08.623225 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed7b39-a570-496b-bd2d-fd6c827e021d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:08.623838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed7b39-a570-496b-bd2d-fd6c827e021d None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:08.624117 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed7b39-a570-496b-bd2d-fd6c827e021d None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:08.624385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed7b39-a570-496b-bd2d-fd6c827e021d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:08.625110 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed7b39-a570-496b-bd2d-fd6c827e021d None admin] RBAC: Adding query filter params (group.id=7820e2aa76d9466c9932f89425e54e06, role.id=4e9a14889d764731b59323f764f1bb85, scope.project.id=b2061ddf744e4b65bc58158bbf9baf3c) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:08.625746 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed7b39-a570-496b-bd2d-fd6c827e021d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:08.626952 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed7b39-a570-496b-bd2d-fd6c827e021d None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:08.633560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 223/454] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 23 07:56:08 2022] GET /identity/v3/role_assignments?group.id=7820e2aa76d9466c9932f89425e54e06&scope.project.id=b2061ddf744e4b65bc58158bbf9baf3c&role.id=4e9a14889d764731b59323f764f1bb85 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:56:08.648928 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf9f77-09b9-46b8-a562-66674b05ccd3 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:08.691264 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fdd9c-1f33-4c8d-b938-065c9c76ce1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:08.691899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fdd9c-1f33-4c8d-b938-065c9c76ce1e None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:08.692209 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fdd9c-1f33-4c8d-b938-065c9c76ce1e None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:08.692484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fdd9c-1f33-4c8d-b938-065c9c76ce1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:08.693226 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fdd9c-1f33-4c8d-b938-065c9c76ce1e None admin] RBAC: Adding query filter params (group.id=a99b148aa2bd4bbfb6e1842cfceffcb4, role.id=e905040849d04aadbb8da8b0d216c92c, scope.project.id=89fa3cf81b7a47a1bca14aee1213ee84) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:08.693534 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fdd9c-1f33-4c8d-b938-065c9c76ce1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:08.695062 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fdd9c-1f33-4c8d-b938-065c9c76ce1e None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:08.702499 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 232/455] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 23 07:56:08 2022] GET /identity/v3/role_assignments?group.id=a99b148aa2bd4bbfb6e1842cfceffcb4&scope.project.id=89fa3cf81b7a47a1bca14aee1213ee84&role.id=e905040849d04aadbb8da8b0d216c92c => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:56:11.181648 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62227f27-9173-4bc3-ac4a-7883ee04f4ef None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:11.182158 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62227f27-9173-4bc3-ac4a-7883ee04f4ef None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:11.182260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62227f27-9173-4bc3-ac4a-7883ee04f4ef None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:11.184320 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 224/456] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:11.189874 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deff1bf-c457-43d9-a0bb-09b726533a77 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:11.190753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deff1bf-c457-43d9-a0bb-09b726533a77 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:11.191239 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deff1bf-c457-43d9-a0bb-09b726533a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:11.209876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-0deff1bf-c457-43d9-a0bb-09b726533a77 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:11.211430 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-0deff1bf-c457-43d9-a0bb-09b726533a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:11.247708 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778ef95-483e-4f04-aeb0-0ee989af9374 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:11.248318 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778ef95-483e-4f04-aeb0-0ee989af9374 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:11.248786 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778ef95-483e-4f04-aeb0-0ee989af9374 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:11.250410 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 225/457] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:56:11.255745 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70114780-99fb-48c4-9efc-aa88d356ac09 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:11.256279 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70114780-99fb-48c4-9efc-aa88d356ac09 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:11.256749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70114780-99fb-48c4-9efc-aa88d356ac09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:11.286624 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-70114780-99fb-48c4-9efc-aa88d356ac09 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:11.288167 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-70114780-99fb-48c4-9efc-aa88d356ac09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:11.331360 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 233/458] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:11.405173 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 226/459] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:11.666568 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deff1bf-c457-43d9-a0bb-09b726533a77 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:11.682849 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:11.768540 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a52a94-dd28-4053-b8a1-60dc7140ec7c None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:11.769188 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a52a94-dd28-4053-b8a1-60dc7140ec7c None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:11.769667 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a52a94-dd28-4053-b8a1-60dc7140ec7c None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:11.771485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 227/460] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:11.774313 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deff1bf-c457-43d9-a0bb-09b726533a77 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:11.777984 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a0fb3-f2c1-46c1-b912-a5af6bee7e22 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:11.778561 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a0fb3-f2c1-46c1-b912-a5af6bee7e22 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:11.779038 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a0fb3-f2c1-46c1-b912-a5af6bee7e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:11.808810 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42cd27-00ed-4d1c-8701-6de840b0bb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:11.809443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42cd27-00ed-4d1c-8701-6de840b0bb75 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:11.809720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42cd27-00ed-4d1c-8701-6de840b0bb75 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:11.809991 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42cd27-00ed-4d1c-8701-6de840b0bb75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:11.817496 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-312a0fb3-f2c1-46c1-b912-a5af6bee7e22 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:11.819555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-312a0fb3-f2c1-46c1-b912-a5af6bee7e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:11.820391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42cd27-00ed-4d1c-8701-6de840b0bb75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:11.822082 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42cd27-00ed-4d1c-8701-6de840b0bb75 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:11.838031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-ea42cd27-00ed-4d1c-8701-6de840b0bb75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:11.838031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:11.838031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:11.838031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:11.838031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:11.838031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:11.838031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:11.838031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:11.838031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:11.838031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:11.838031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:11.838031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:11.838031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:11.838031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:11.838031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:11.838031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:11.838983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:11.838983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:11.838983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:11.838983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:11.838983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:11.838983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:11.838983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:11.838983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:11.838983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:11.838983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:11.838983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:11.838983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:11.838983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:11.838983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:11.838983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:11.838983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:11.838983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:11.840443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:11.840443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:11.840443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:11.842613 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 234/461] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:11.848393 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91763c9c-d68f-4704-af58-1b57d335ac44 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:11.849237 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91763c9c-d68f-4704-af58-1b57d335ac44 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:11.849692 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91763c9c-d68f-4704-af58-1b57d335ac44 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:11.851407 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 235/462] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:11.852383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91763c9c-d68f-4704-af58-1b57d335ac44 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:11.880632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:11.909866 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 228/463] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:11.909866 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a7e7d-3e76-4e08-a145-01b93358280c None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:11.909866 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a7e7d-3e76-4e08-a145-01b93358280c None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:11.909866 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a7e7d-3e76-4e08-a145-01b93358280c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:11.928935 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-f43a7e7d-3e76-4e08-a145-01b93358280c None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:11.930320 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-f43a7e7d-3e76-4e08-a145-01b93358280c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:11.930508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:11.969328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91763c9c-d68f-4704-af58-1b57d335ac44 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:12.009866 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cda7f-89f0-45e0-9fe6-58127a373753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:12.010765 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cda7f-89f0-45e0-9fe6-58127a373753 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:12.011212 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cda7f-89f0-45e0-9fe6-58127a373753 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:12.012179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cda7f-89f0-45e0-9fe6-58127a373753 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:12.012973 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9cda7f-89f0-45e0-9fe6-58127a373753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:12.013562 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9cda7f-89f0-45e0-9fe6-58127a373753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:12.015112 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 229/464] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:12.016205 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a7e7d-3e76-4e08-a145-01b93358280c None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:12.022701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9cda7f-89f0-45e0-9fe6-58127a373753 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:12.065541 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 236/465] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:12.066717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cda7f-89f0-45e0-9fe6-58127a373753 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:12.192412 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a7e7d-3e76-4e08-a145-01b93358280c None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:12.213480 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:12.226747 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cda7f-89f0-45e0-9fe6-58127a373753 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:12.237300 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e8e2e-f287-4a6e-a6d6-7aeb3d4fa825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:12.238199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e8e2e-f287-4a6e-a6d6-7aeb3d4fa825 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:12.238637 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e8e2e-f287-4a6e-a6d6-7aeb3d4fa825 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:12.239493 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e8e2e-f287-4a6e-a6d6-7aeb3d4fa825 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:12.253145 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e8e2e-f287-4a6e-a6d6-7aeb3d4fa825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:12.255211 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e8e2e-f287-4a6e-a6d6-7aeb3d4fa825 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:12.259374 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:12.269301 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418e6d6-1eca-4c3b-8cbc-3cdd59622874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:12.270127 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418e6d6-1eca-4c3b-8cbc-3cdd59622874 None admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:12.270617 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418e6d6-1eca-4c3b-8cbc-3cdd59622874 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:12.271060 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418e6d6-1eca-4c3b-8cbc-3cdd59622874 None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:12.271859 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418e6d6-1eca-4c3b-8cbc-3cdd59622874 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:12.273476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418e6d6-1eca-4c3b-8cbc-3cdd59622874 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:12.273756 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-0b0e8e2e-f287-4a6e-a6d6-7aeb3d4fa825 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:12.273756 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:12.273756 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:12.273756 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:12.273756 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:12.273756 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:12.273756 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:12.273756 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:12.273756 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:12.273756 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:12.273756 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:12.273756 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:12.273756 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:12.273756 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:12.273756 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:12.273756 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:12.274891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:12.274891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:12.274891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:12.274891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:12.274891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:12.274891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:12.274891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:12.274891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:12.274891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:12.274891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:12.274891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:12.274891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:12.274891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:12.274891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:12.274891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:12.274891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:12.274891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:12.275993 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:12.275993 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:12.275993 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:12.279700 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 230/466] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:12.280543 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e8e2e-f287-4a6e-a6d6-7aeb3d4fa825 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:12.384750 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e8e2e-f287-4a6e-a6d6-7aeb3d4fa825 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:12.418135 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb911b7-7e2f-4704-920e-3191410ea077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:12.418793 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb911b7-7e2f-4704-920e-3191410ea077 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:12.419077 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb911b7-7e2f-4704-920e-3191410ea077 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:12.419355 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb911b7-7e2f-4704-920e-3191410ea077 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:12.423978 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 237/467] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 23 07:56:12 2022] POST /identity/v3/users => generated 248 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:56:12.430525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb911b7-7e2f-4704-920e-3191410ea077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:12.432097 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb911b7-7e2f-4704-920e-3191410ea077 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:12.435472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418e6d6-1eca-4c3b-8cbc-3cdd59622874 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:12.455125 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-5fb911b7-7e2f-4704-920e-3191410ea077 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:12.455125 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:12.455125 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:12.455125 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:12.455125 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:12.455125 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:12.455125 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:12.455125 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:12.455125 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:12.455125 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:12.455125 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:12.455125 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:12.455125 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:12.455125 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:12.455125 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:12.455125 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:12.456116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:12.456116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:12.456116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:12.456116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:12.456116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:12.456116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:12.456116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:12.456116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:12.456116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:12.456116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:12.456116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:12.456116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:12.456116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:12.456116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:12.456116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:12.456116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:12.456116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:12.456954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:12.456954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:12.456954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:12.456954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 231/468] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:12.457629 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb911b7-7e2f-4704-920e-3191410ea077 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:12.489674 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:12.574648 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418e6d6-1eca-4c3b-8cbc-3cdd59622874 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:12.596125 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb911b7-7e2f-4704-920e-3191410ea077 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:12.615030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd7341-e307-4088-b79a-406d888a4bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:12.615640 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd7341-e307-4088-b79a-406d888a4bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:12.615924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd7341-e307-4088-b79a-406d888a4bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:12.616193 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd7341-e307-4088-b79a-406d888a4bc8 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:12.616829 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd7341-e307-4088-b79a-406d888a4bc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:12.617127 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd7341-e307-4088-b79a-406d888a4bc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:12.619291 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd7341-e307-4088-b79a-406d888a4bc8 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:12.634394 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 238/469] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:12.635271 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd7341-e307-4088-b79a-406d888a4bc8 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:12.642028 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c358aca-ec97-4c2a-a825-3809c8b41356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:12.643088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c358aca-ec97-4c2a-a825-3809c8b41356 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:12.643573 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c358aca-ec97-4c2a-a825-3809c8b41356 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:12.644064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c358aca-ec97-4c2a-a825-3809c8b41356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:12.661190 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c358aca-ec97-4c2a-a825-3809c8b41356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:12.661190 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c358aca-ec97-4c2a-a825-3809c8b41356 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:12.678178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-7c358aca-ec97-4c2a-a825-3809c8b41356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:12.678178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:12.678178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:12.678178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:12.678178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:12.678178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:12.678178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:12.678178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:12.678178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:12.678178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:12.678178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:12.678178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:12.678178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:12.678178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:12.678178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:12.678178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:12.679385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:12.679385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:12.679385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:12.679385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:12.679385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:12.679385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:12.679385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:12.679385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:12.679385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:12.679385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:12.679385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:12.679385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:12.679385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:12.679385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:12.679385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:12.679385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:12.679385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:12.680240 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:12.680240 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:12.680240 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:12.680240 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 232/470] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:12.680463 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c358aca-ec97-4c2a-a825-3809c8b41356 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:12.693852 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:12.752886 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:12.753182 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd7341-e307-4088-b79a-406d888a4bc8 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:12.786430 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c358aca-ec97-4c2a-a825-3809c8b41356 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:12.787442 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce9833-bb5d-460f-9e7f-42b608d7e36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:12.788047 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce9833-bb5d-460f-9e7f-42b608d7e36a None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:12.788326 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce9833-bb5d-460f-9e7f-42b608d7e36a None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:12.788600 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce9833-bb5d-460f-9e7f-42b608d7e36a None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:12.789215 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce9833-bb5d-460f-9e7f-42b608d7e36a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:12.789518 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce9833-bb5d-460f-9e7f-42b608d7e36a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:12.790940 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce9833-bb5d-460f-9e7f-42b608d7e36a None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:12.803116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 239/471] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:12.804332 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad1cdf-a4dd-414d-b01d-95f9cd45dae3 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:12.804615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad1cdf-a4dd-414d-b01d-95f9cd45dae3 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:12.804888 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad1cdf-a4dd-414d-b01d-95f9cd45dae3 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:12.806223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 240/472] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:12.806772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad1cdf-a4dd-414d-b01d-95f9cd45dae3 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:12.832687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af3678-1110-437c-9cc8-5f4815de9be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:12.833342 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af3678-1110-437c-9cc8-5f4815de9be0 None admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:12.833625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af3678-1110-437c-9cc8-5f4815de9be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:12.834124 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af3678-1110-437c-9cc8-5f4815de9be0 None admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:12.834557 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af3678-1110-437c-9cc8-5f4815de9be0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:12.836000 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af3678-1110-437c-9cc8-5f4815de9be0 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:12.909350 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad1cdf-a4dd-414d-b01d-95f9cd45dae3 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:12.910917 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:12.930324 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 233/473] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 23 07:56:12 2022] POST /identity/v3/users => generated 246 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:56:12.930324 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af3678-1110-437c-9cc8-5f4815de9be0 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:12.947084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d346e44-d8e1-436f-859a-ac16312bb2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:12.947707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d346e44-d8e1-436f-859a-ac16312bb2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:12.947975 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d346e44-d8e1-436f-859a-ac16312bb2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:12.948246 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d346e44-d8e1-436f-859a-ac16312bb2e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:12.949852 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d346e44-d8e1-436f-859a-ac16312bb2e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:12.950454 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d346e44-d8e1-436f-859a-ac16312bb2e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:12.956083 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d346e44-d8e1-436f-859a-ac16312bb2e6 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:12.970376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 241/474] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:12.970376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb4267-5861-4f9c-8387-b989885edf14 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:12.970376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb4267-5861-4f9c-8387-b989885edf14 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:12.970376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb4267-5861-4f9c-8387-b989885edf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:12.989545 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-73cb4267-5861-4f9c-8387-b989885edf14 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:12.990850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-73cb4267-5861-4f9c-8387-b989885edf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:13.069240 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af3678-1110-437c-9cc8-5f4815de9be0 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:13.070364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 242/475] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:13.071632 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb4267-5861-4f9c-8387-b989885edf14 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:13.109995 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:13.139001 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf884f-907c-4935-b5bd-c3627825867c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:13.140793 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf884f-907c-4935-b5bd-c3627825867c None admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:13.140980 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf884f-907c-4935-b5bd-c3627825867c None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:13.141255 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf884f-907c-4935-b5bd-c3627825867c None admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:13.142556 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf884f-907c-4935-b5bd-c3627825867c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:13.144035 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf884f-907c-4935-b5bd-c3627825867c None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:13.193206 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:13.205717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb4267-5861-4f9c-8387-b989885edf14 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:13.239526 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd13dfe-880c-4161-b71b-dc8ab33fa8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:13.240162 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd13dfe-880c-4161-b71b-dc8ab33fa8ae None admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:13.240387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd13dfe-880c-4161-b71b-dc8ab33fa8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:13.240710 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd13dfe-880c-4161-b71b-dc8ab33fa8ae None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:13.241338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd13dfe-880c-4161-b71b-dc8ab33fa8ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:13.243177 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd13dfe-880c-4161-b71b-dc8ab33fa8ae None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:13.265876 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 234/476] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 23 07:56:12 2022] POST /identity/v3/users => generated 248 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:56:13.357488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 243/477] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 23 07:56:13 2022] POST /identity/v3/users => generated 249 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:56:13.395884 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf884f-907c-4935-b5bd-c3627825867c None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:13.519042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf884f-907c-4935-b5bd-c3627825867c None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:13.555433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44102553-034a-44d7-a35e-c4c1f3cf74f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:13.556048 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44102553-034a-44d7-a35e-c4c1f3cf74f1 None admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:13.556326 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44102553-034a-44d7-a35e-c4c1f3cf74f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:13.556596 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44102553-034a-44d7-a35e-c4c1f3cf74f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:13.557261 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44102553-034a-44d7-a35e-c4c1f3cf74f1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:13.558926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44102553-034a-44d7-a35e-c4c1f3cf74f1 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:13.600403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.sql.core [None req-44102553-034a-44d7-a35e-c4c1f3cf74f1 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 07:56:13.600403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 23 07:56:13.600403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [parameters: {'id': '757a76d09610407a8542b693340ce616', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 23 07:56:13.600403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81770) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 07:56:13.616868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-44102553-034a-44d7-a35e-c4c1f3cf74f1 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 23 07:56:13.616868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:13.616868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 07:56:13.616868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 07:56:13.616868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 07:56:13.616868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 07:56:13.616868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 07:56:13.616868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 07:56:13.616868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 07:56:13.616868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application conn.query(q) Aug 23 07:56:13.616868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 07:56:13.616868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 07:56:13.616868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 07:56:13.616868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application result.read() Aug 23 07:56:13.616868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 07:56:13.617741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 07:56:13.617741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 07:56:13.617741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 07:56:13.617741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 07:56:13.617741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 07:56:13.617741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 07:56:13.617741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 07:56:13.617741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 07:56:13.617741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:13.617741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 07:56:13.617741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:13.617741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:13.617741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 07:56:13.617741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 07:56:13.617741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 23 07:56:13.617741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return ref.to_dict() Aug 23 07:56:13.617741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 07:56:13.617741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application next(self.gen) Aug 23 07:56:13.618709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 07:56:13.618709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application yield resource Aug 23 07:56:13.618709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 07:56:13.618709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application next(self.gen) Aug 23 07:56:13.618709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 07:56:13.618709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 07:56:13.618709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 07:56:13.618709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 07:56:13.618709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 07:56:13.618709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise self.value Aug 23 07:56:13.618709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 07:56:13.618709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 07:56:13.618709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 07:56:13.618709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application session.commit() Aug 23 07:56:13.618709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 07:56:13.618709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 07:56:13.618709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 07:56:13.619563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 07:56:13.619563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 07:56:13.619563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self.session.flush() Aug 23 07:56:13.619563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 07:56:13.619563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 07:56:13.619563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 07:56:13.619563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 07:56:13.619563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 07:56:13.619563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application compat.raise_( Aug 23 07:56:13.619563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 07:56:13.619563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception Aug 23 07:56:13.619563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 07:56:13.619563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 07:56:13.619563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 07:56:13.619563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 07:56:13.619563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 07:56:13.619563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 07:56:13.620470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 07:56:13.620470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 07:56:13.620470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 23 07:56:13.620470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 23 07:56:13.620470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 07:56:13.620470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 07:56:13.620470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 07:56:13.620470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 07:56:13.620470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 07:56:13.620470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 07:56:13.620470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 07:56:13.620470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 07:56:13.620470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 07:56:13.620470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 07:56:13.620470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 07:56:13.620470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception Aug 23 07:56:13.621335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 07:56:13.621335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 07:56:13.621335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 07:56:13.621335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 07:56:13.621335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 07:56:13.621335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 07:56:13.621335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 07:56:13.621335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application conn.query(q) Aug 23 07:56:13.621335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 07:56:13.621335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 07:56:13.621335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 07:56:13.621335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application result.read() Aug 23 07:56:13.621335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 07:56:13.621335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 07:56:13.621335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 07:56:13.621335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 07:56:13.622152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 07:56:13.622152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 07:56:13.622152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 07:56:13.622152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 07:56:13.622152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 07:56:13.622152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 23 07:56:13.622152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [parameters: {'id': '757a76d09610407a8542b693340ce616', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 23 07:56:13.622152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 07:56:13.622152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:13.622152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:56:13.622152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:13.622152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:13.622152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:13.622152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:13.622152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:13.622152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:13.624348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:13.624348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:13.624348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:13.624348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:13.624348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:13.624348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:13.624348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 23 07:56:13.624348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 23 07:56:13.624348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:13.624348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:13.624348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 23 07:56:13.624348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 23 07:56:13.624348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 07:56:13.624348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 07:56:13.624348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 23 07:56:13.624348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:13.625353 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 235/478] 10.222.0.57 () {60 vars in 1131 bytes} [Tue Aug 23 07:56:13 2022] POST /identity/v3/roles => generated 144 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:13.627802 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd13dfe-880c-4161-b71b-dc8ab33fa8ae None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:13.739839 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd13dfe-880c-4161-b71b-dc8ab33fa8ae None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:13.781719 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05de95-4cf3-4860-a780-c6ba76e83437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:13.782378 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05de95-4cf3-4860-a780-c6ba76e83437 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:13.782662 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05de95-4cf3-4860-a780-c6ba76e83437 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:13.782935 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05de95-4cf3-4860-a780-c6ba76e83437 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:13.799313 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05de95-4cf3-4860-a780-c6ba76e83437 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:13.804615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-5a05de95-4cf3-4860-a780-c6ba76e83437 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:56:13.804615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:13.804615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:13.804615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:13.804615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:13.804615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:13.804615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:13.804615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:13.804615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:13.804615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:13.804615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:13.804615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:13.804615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:13.804615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:13.804615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:13.804615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:13.805476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:13.805476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:13.805476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:13.805476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:13.805476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:13.805476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:13.805476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:13.805476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:13.805476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:13.805476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:13.805476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:13.805476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:13.805476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:13.805476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:13.805476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:13.805476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:13.806250 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:13.806250 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:13.806250 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:13.806250 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:13.806250 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:13.806250 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:13.806250 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:13.806250 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:13.806250 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:13.806250 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:13.806250 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:56:13.806250 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:13.806250 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 244/479] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 23 07:56:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:13.811749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44102553-034a-44d7-a35e-c4c1f3cf74f1 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:13.875670 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:13.941817 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44102553-034a-44d7-a35e-c4c1f3cf74f1 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:13.989415 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18c038-ed22-4fcb-a453-caa2c16f898a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:13.990027 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18c038-ed22-4fcb-a453-caa2c16f898a None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:13.990382 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18c038-ed22-4fcb-a453-caa2c16f898a None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:13.990655 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18c038-ed22-4fcb-a453-caa2c16f898a None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:13.991319 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18c038-ed22-4fcb-a453-caa2c16f898a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:13.991625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18c038-ed22-4fcb-a453-caa2c16f898a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:13.993000 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18c038-ed22-4fcb-a453-caa2c16f898a None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:14.005904 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 236/480] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:14.615849 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e2d1c-9beb-4945-b8d8-a53f1ad1af66 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:14.616549 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e2d1c-9beb-4945-b8d8-a53f1ad1af66 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:14.616549 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e2d1c-9beb-4945-b8d8-a53f1ad1af66 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:14.617969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 245/481] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:14.623970 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa9b53-d5e5-4730-ad74-bdba399b4c87 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:14.624479 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa9b53-d5e5-4730-ad74-bdba399b4c87 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:14.624634 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa9b53-d5e5-4730-ad74-bdba399b4c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:14.647462 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-84aa9b53-d5e5-4730-ad74-bdba399b4c87 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:14.648719 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-84aa9b53-d5e5-4730-ad74-bdba399b4c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:14.741149 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 237/482] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:15.031217 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e2d1c-9beb-4945-b8d8-a53f1ad1af66 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:15.044179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:15.164195 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e2d1c-9beb-4945-b8d8-a53f1ad1af66 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:15.206038 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4ddc5-b6b3-4452-91fb-e0653d0f22f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:15.206981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4ddc5-b6b3-4452-91fb-e0653d0f22f3 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:15.207440 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4ddc5-b6b3-4452-91fb-e0653d0f22f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:15.207888 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4ddc5-b6b3-4452-91fb-e0653d0f22f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:15.218538 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4ddc5-b6b3-4452-91fb-e0653d0f22f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:15.223924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-f9e4ddc5-b6b3-4452-91fb-e0653d0f22f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:15.223924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:15.223924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:15.223924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:15.223924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:15.223924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:15.223924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:15.223924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:15.223924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:15.223924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:15.223924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:15.223924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:15.223924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:15.223924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:15.223924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:15.223924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:15.224781 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:15.224781 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:15.224781 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:15.224781 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:15.224781 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:15.224781 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:15.224781 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:15.224781 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:15.224781 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:15.224781 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:15.224781 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:15.224781 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:15.224781 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:15.224781 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:15.224781 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:15.224781 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:15.225584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:15.225584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:15.225584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:15.225584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:15.225584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:15.225584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:15.225584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:15.225584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:15.225584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:15.225584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:15.225584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:15.225584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:15.227806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 246/483] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 23 07:56:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:15.234008 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa9b53-d5e5-4730-ad74-bdba399b4c87 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:15.303885 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:15.384060 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa9b53-d5e5-4730-ad74-bdba399b4c87 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:15.431938 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba54af-19e1-46e9-b54a-32b0fa4851ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:15.432565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba54af-19e1-46e9-b54a-32b0fa4851ce None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:15.432847 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba54af-19e1-46e9-b54a-32b0fa4851ce None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:15.433648 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba54af-19e1-46e9-b54a-32b0fa4851ce None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:15.434644 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba54af-19e1-46e9-b54a-32b0fa4851ce None admin] RBAC: Adding query filter params (name=service) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:15.434950 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba54af-19e1-46e9-b54a-32b0fa4851ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:15.436355 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba54af-19e1-46e9-b54a-32b0fa4851ce None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:15.445020 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 238/484] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 23 07:56:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:15.451627 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4ddc5-b6b3-4452-91fb-e0653d0f22f3 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:15.520151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:15.542676 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e59cb-d506-43af-b73e-1306bfe79c9c None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:15.543186 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e59cb-d506-43af-b73e-1306bfe79c9c None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:15.543571 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e59cb-d506-43af-b73e-1306bfe79c9c None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:15.544985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 239/485] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:56:15.550153 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271973e7-c180-45ff-a373-d22f1d4c372f None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:15.550496 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271973e7-c180-45ff-a373-d22f1d4c372f None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:15.550778 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271973e7-c180-45ff-a373-d22f1d4c372f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:15.570795 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4ddc5-b6b3-4452-91fb-e0653d0f22f3 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:15.577483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-271973e7-c180-45ff-a373-d22f1d4c372f None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:15.579707 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-271973e7-c180-45ff-a373-d22f1d4c372f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:15.661393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 240/486] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:15.697461 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b99064-5733-4730-94a7-da4b5a6360ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:15.698143 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b99064-5733-4730-94a7-da4b5a6360ae None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:15.698408 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b99064-5733-4730-94a7-da4b5a6360ae None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:15.699060 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b99064-5733-4730-94a7-da4b5a6360ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:15.713279 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b99064-5733-4730-94a7-da4b5a6360ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:15.723059 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b99064-5733-4730-94a7-da4b5a6360ae None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:15.742163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-a0b99064-5733-4730-94a7-da4b5a6360ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:15.742163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:15.742163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:15.742163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:15.742163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:15.742163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:15.742163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:15.742163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:15.742163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:15.742163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:15.742163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:15.742163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:15.742163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:15.742163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:15.742163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:15.742163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:15.743149 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:15.743149 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:15.743149 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:15.743149 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:15.743149 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:15.743149 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:15.743149 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:15.743149 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:15.743149 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:15.743149 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:15.743149 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:15.743149 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:15.743149 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:15.743149 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:15.743149 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:15.743149 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:15.743149 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:15.744012 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:15.744012 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:15.744012 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:15.744012 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 247/487] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:15.749561 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271973e7-c180-45ff-a373-d22f1d4c372f None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:15.790024 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:15.838879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e87b8-59dd-400e-b879-5249dbf31f59 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:15.839174 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e87b8-59dd-400e-b879-5249dbf31f59 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:15.839477 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e87b8-59dd-400e-b879-5249dbf31f59 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:15.841076 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 248/488] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:15.842222 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af84b5-3e90-4ab0-a169-ab9f970c213c None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:15.842526 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af84b5-3e90-4ab0-a169-ab9f970c213c None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:15.842799 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af84b5-3e90-4ab0-a169-ab9f970c213c None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:15.844207 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 249/489] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:15.849197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1bc89-d91f-4f91-8ed1-88f47f130684 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:15.849492 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1bc89-d91f-4f91-8ed1-88f47f130684 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:15.849763 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1bc89-d91f-4f91-8ed1-88f47f130684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:15.864616 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271973e7-c180-45ff-a373-d22f1d4c372f None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:15.868759 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-b3a1bc89-d91f-4f91-8ed1-88f47f130684 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:15.869942 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-b3a1bc89-d91f-4f91-8ed1-88f47f130684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:15.900396 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f69904-9dfd-42d3-b63f-2df742623d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:15.901011 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f69904-9dfd-42d3-b63f-2df742623d2e None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:15.901294 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f69904-9dfd-42d3-b63f-2df742623d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:15.901568 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f69904-9dfd-42d3-b63f-2df742623d2e None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:15.902320 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f69904-9dfd-42d3-b63f-2df742623d2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:15.902632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f69904-9dfd-42d3-b63f-2df742623d2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:15.904286 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f69904-9dfd-42d3-b63f-2df742623d2e None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:15.916154 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 241/490] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:15.917167 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b43d1-edd9-44cf-88be-43be8d494f9a None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:15.917984 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b43d1-edd9-44cf-88be-43be8d494f9a None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:15.918489 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b43d1-edd9-44cf-88be-43be8d494f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:15.942480 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-2b2b43d1-edd9-44cf-88be-43be8d494f9a None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:15.944184 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-2b2b43d1-edd9-44cf-88be-43be8d494f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:15.945823 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 250/491] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:56:15.954446 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1bc89-d91f-4f91-8ed1-88f47f130684 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:16.018787 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:16.049976 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 242/492] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:16.051411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b43d1-edd9-44cf-88be-43be8d494f9a None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:16.084184 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:16.094581 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1bc89-d91f-4f91-8ed1-88f47f130684 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:16.154236 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c7ec7-d39e-45de-a93f-c2c903a8a0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:16.154236 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c7ec7-d39e-45de-a93f-c2c903a8a0d5 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:16.154546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c7ec7-d39e-45de-a93f-c2c903a8a0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:16.154916 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c7ec7-d39e-45de-a93f-c2c903a8a0d5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:16.171549 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c7ec7-d39e-45de-a93f-c2c903a8a0d5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:16.173028 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c7ec7-d39e-45de-a93f-c2c903a8a0d5 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:16.199274 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-fa0c7ec7-d39e-45de-a93f-c2c903a8a0d5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 07:56:16.199274 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:16.199274 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:16.199274 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:16.199274 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:16.199274 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:16.199274 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:16.199274 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:16.199274 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:16.199274 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:16.199274 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:16.199274 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:16.199274 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:56:16.199274 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:56:16.199274 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:56:16.199274 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:56:16.200227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:16.200227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:16.200227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:56:16.200227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:16.200227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:56:16.200227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:16.200227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:16.200227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:16.200227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:16.200227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:16.200227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:16.200227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:16.200227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:16.200227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:16.200227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:16.200227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:16.200227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:16.200227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:16.201118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:16.201118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:16.201118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:56:16.201118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:56:16.201118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:56:16.201118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:56:16.201118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:56:16.201118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:56:16.201118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 07:56:16.201118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:16.201118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 251/493] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:56:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:16.205900 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c7ec7-d39e-45de-a93f-c2c903a8a0d5 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:16.223175 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b43d1-edd9-44cf-88be-43be8d494f9a None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:16.268264 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd43967-0ce4-4bca-971e-67f4a0f65977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:16.269628 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd43967-0ce4-4bca-971e-67f4a0f65977 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:16.270481 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd43967-0ce4-4bca-971e-67f4a0f65977 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:16.271112 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd43967-0ce4-4bca-971e-67f4a0f65977 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:16.285399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd43967-0ce4-4bca-971e-67f4a0f65977 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:16.292108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-fdd43967-0ce4-4bca-971e-67f4a0f65977 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:16.292108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:16.292108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:16.292108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:16.292108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:16.292108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:16.292108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:16.292108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:16.292108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:16.292108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:16.292108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:16.292108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:16.292108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:16.292108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:16.292108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:16.292108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:16.293054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:16.293054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:16.293054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:16.293054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:16.293054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:16.293054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:16.293054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:16.293054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:16.293054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:16.293054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:16.293054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:16.293054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:16.293054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:16.293054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:16.293054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:16.293054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:16.294019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:16.294019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:16.294019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:16.294019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:16.294019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:16.294019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:16.294019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:16.294019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:16.294019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:16.294019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:16.294019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:16.294019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:16.295667 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 243/494] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 23 07:56:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:16.300969 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd43967-0ce4-4bca-971e-67f4a0f65977 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:16.351429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c7ec7-d39e-45de-a93f-c2c903a8a0d5 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:16.365125 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:16.391452 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:16.391922 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dabe73-d1ac-4eab-ae08-4fa08231db11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:16.392727 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dabe73-d1ac-4eab-ae08-4fa08231db11 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:16.393164 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dabe73-d1ac-4eab-ae08-4fa08231db11 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:16.393443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dabe73-d1ac-4eab-ae08-4fa08231db11 None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:16.394189 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dabe73-d1ac-4eab-ae08-4fa08231db11 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:16.394504 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dabe73-d1ac-4eab-ae08-4fa08231db11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:16.395945 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dabe73-d1ac-4eab-ae08-4fa08231db11 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:16.410018 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd43967-0ce4-4bca-971e-67f4a0f65977 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:16.434218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 252/495] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Aug 23 07:56:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:16.435103 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dabe73-d1ac-4eab-ae08-4fa08231db11 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:16.447736 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5c816-42db-4f15-a3b8-255a5e021e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:16.448364 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5c816-42db-4f15-a3b8-255a5e021e5c None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:16.448689 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5c816-42db-4f15-a3b8-255a5e021e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:16.449225 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5c816-42db-4f15-a3b8-255a5e021e5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:16.460591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c5c816-42db-4f15-a3b8-255a5e021e5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:16.466088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-b1c5c816-42db-4f15-a3b8-255a5e021e5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:16.466088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:16.466088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:16.466088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:16.466088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:16.466088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:16.466088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:16.466088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:16.466088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:16.466088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:16.466088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:16.466088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:16.466088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:16.466088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:16.466088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:16.466088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:16.467237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:16.467237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:16.467237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:16.467237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:16.467237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:16.467237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:16.467237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:16.467237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:16.467237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:16.467237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:16.467237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:16.467237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:16.467237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:16.467237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:16.467237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:16.467237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:16.468042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:16.468042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:16.468042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:16.468042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:16.468042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:16.468042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:16.468042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:16.468042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:16.468042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:16.468042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:16.468042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:16.468042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:16.468042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 244/496] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 23 07:56:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:16.468684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5c816-42db-4f15-a3b8-255a5e021e5c None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:16.548160 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dabe73-d1ac-4eab-ae08-4fa08231db11 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:16.573285 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5c816-42db-4f15-a3b8-255a5e021e5c None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:16.587426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6ae90-1af3-4123-b485-fda3507b6c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:16.588037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ae90-1af3-4123-b485-fda3507b6c52 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:16.588315 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ae90-1af3-4123-b485-fda3507b6c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:16.588587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ae90-1af3-4123-b485-fda3507b6c52 None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:16.589327 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6ae90-1af3-4123-b485-fda3507b6c52 None admin] RBAC: Adding query filter params (name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:16.590145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6ae90-1af3-4123-b485-fda3507b6c52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:16.591726 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6ae90-1af3-4123-b485-fda3507b6c52 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:16.600324 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 253/497] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 23 07:56:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:16.601126 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6ae90-1af3-4123-b485-fda3507b6c52 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:16.613281 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1901a-9914-4989-83fd-c89f18c45342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:16.614036 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1901a-9914-4989-83fd-c89f18c45342 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:16.614144 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1901a-9914-4989-83fd-c89f18c45342 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:16.614415 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1901a-9914-4989-83fd-c89f18c45342 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:16.625488 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1901a-9914-4989-83fd-c89f18c45342 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:16.629912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-abc1901a-9914-4989-83fd-c89f18c45342 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:16.629912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:16.629912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:16.629912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:16.629912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:16.629912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:16.629912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:16.629912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:16.629912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:16.629912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:16.629912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:16.629912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:16.629912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:16.629912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:16.629912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:16.629912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:16.630985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:16.630985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:16.630985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:16.630985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:16.630985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:16.630985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:16.630985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:16.630985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:16.630985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:16.630985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:16.630985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:16.630985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:16.630985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:16.630985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:16.630985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:16.630985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:16.631771 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:16.631771 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:16.631771 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:16.631771 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:16.631771 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:16.631771 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:16.631771 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:16.631771 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:16.631771 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:16.631771 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:16.631771 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:16.631771 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:16.631771 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 245/498] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 23 07:56:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:16.632411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1901a-9914-4989-83fd-c89f18c45342 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:16.635436 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:16.640107 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:16.710578 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6ae90-1af3-4123-b485-fda3507b6c52 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:16.732806 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1901a-9914-4989-83fd-c89f18c45342 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:16.742950 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c3350-19e2-4807-a036-dab055009b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:16.743561 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c3350-19e2-4807-a036-dab055009b69 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:16.743840 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c3350-19e2-4807-a036-dab055009b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:16.744115 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c3350-19e2-4807-a036-dab055009b69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:16.768121 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621a6f1-f7f6-478a-84d0-108799849473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:16.768748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621a6f1-f7f6-478a-84d0-108799849473 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:16.769027 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621a6f1-f7f6-478a-84d0-108799849473 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:16.769295 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621a6f1-f7f6-478a-84d0-108799849473 None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:16.769943 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621a6f1-f7f6-478a-84d0-108799849473 None admin] RBAC: Adding query filter params (name=service) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:16.770240 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621a6f1-f7f6-478a-84d0-108799849473 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:16.771670 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621a6f1-f7f6-478a-84d0-108799849473 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:16.779260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 246/499] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 23 07:56:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:16.780037 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621a6f1-f7f6-478a-84d0-108799849473 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:16.812843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c3350-19e2-4807-a036-dab055009b69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:16.814350 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c3350-19e2-4807-a036-dab055009b69 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:16.842157 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:16.842426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:16.878344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621a6f1-f7f6-478a-84d0-108799849473 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:16.911419 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 254/500] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:56:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:56:16.911612 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e9bfe-7058-43d9-926c-f9b868f48a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:16.912119 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e9bfe-7058-43d9-926c-f9b868f48a48 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:16.912284 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c3350-19e2-4807-a036-dab055009b69 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:16.912396 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e9bfe-7058-43d9-926c-f9b868f48a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:16.912737 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e9bfe-7058-43d9-926c-f9b868f48a48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:16.923423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e9bfe-7058-43d9-926c-f9b868f48a48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:16.924870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e9bfe-7058-43d9-926c-f9b868f48a48 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:16.938872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-ed7e9bfe-7058-43d9-926c-f9b868f48a48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:16.938872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:16.938872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:16.938872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:16.938872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:16.938872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:16.938872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:16.938872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:16.938872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:16.938872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:16.938872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:16.938872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:16.938872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:16.938872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:16.938872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:16.938872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:16.939966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:16.939966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:16.939966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:16.939966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:16.939966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:16.939966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:16.939966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:16.939966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:16.939966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:16.939966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:16.939966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:16.939966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:16.939966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:16.939966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:16.939966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:16.939966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:16.939966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:16.941004 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:16.941004 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:16.941004 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:16.941004 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 247/501] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:16.941273 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed6672-7a29-4931-b5ea-fd7d43003613 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:16.941399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed6672-7a29-4931-b5ea-fd7d43003613 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:16.941672 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed6672-7a29-4931-b5ea-fd7d43003613 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:16.942968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 248/502] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:16.943649 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed6672-7a29-4931-b5ea-fd7d43003613 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:17.017187 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c3350-19e2-4807-a036-dab055009b69 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:17.043694 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed6672-7a29-4931-b5ea-fd7d43003613 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:17.045595 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:17.051975 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56914bdd-a5a1-4cb5-b9ab-133fb803b699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:17.052585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56914bdd-a5a1-4cb5-b9ab-133fb803b699 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:17.052875 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56914bdd-a5a1-4cb5-b9ab-133fb803b699 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:17.053150 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56914bdd-a5a1-4cb5-b9ab-133fb803b699 None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:17.053813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56914bdd-a5a1-4cb5-b9ab-133fb803b699 None admin] RBAC: Adding query filter params (name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:17.054122 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56914bdd-a5a1-4cb5-b9ab-133fb803b699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:17.055552 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56914bdd-a5a1-4cb5-b9ab-133fb803b699 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:17.060239 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:17.064380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 255/503] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 23 07:56:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:17.064909 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56914bdd-a5a1-4cb5-b9ab-133fb803b699 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:17.078995 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8c6a6-77fe-4dec-b072-1422b00e9a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:17.079620 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8c6a6-77fe-4dec-b072-1422b00e9a13 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:17.079900 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8c6a6-77fe-4dec-b072-1422b00e9a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:17.080172 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8c6a6-77fe-4dec-b072-1422b00e9a13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:17.090079 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8c6a6-77fe-4dec-b072-1422b00e9a13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:17.091578 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8c6a6-77fe-4dec-b072-1422b00e9a13 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:17.105904 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-77a8c6a6-77fe-4dec-b072-1422b00e9a13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:17.105904 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:17.105904 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:17.105904 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:17.105904 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:17.105904 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:17.105904 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:17.105904 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:17.105904 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:17.105904 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:17.105904 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:17.105904 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:17.105904 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:17.105904 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:17.105904 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:17.105904 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:17.106898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:17.106898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:17.106898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:17.106898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:17.106898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:17.106898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:17.106898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:17.106898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:17.106898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:17.106898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:17.106898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:17.106898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:17.106898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:17.106898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:17.106898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:17.106898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:17.106898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:17.107786 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:17.107786 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:17.107786 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:17.107786 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 249/504] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:17.107786 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8c6a6-77fe-4dec-b072-1422b00e9a13 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:17.166517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56914bdd-a5a1-4cb5-b9ab-133fb803b699 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:17.200043 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64cf45-adfa-4cd6-b54f-1d6c6eb43627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:17.200662 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64cf45-adfa-4cd6-b54f-1d6c6eb43627 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:17.200944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64cf45-adfa-4cd6-b54f-1d6c6eb43627 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:17.201223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64cf45-adfa-4cd6-b54f-1d6c6eb43627 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:17.204940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8c6a6-77fe-4dec-b072-1422b00e9a13 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:17.211333 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64cf45-adfa-4cd6-b54f-1d6c6eb43627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:17.212805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64cf45-adfa-4cd6-b54f-1d6c6eb43627 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:17.226654 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-8a64cf45-adfa-4cd6-b54f-1d6c6eb43627 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:17.226654 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:17.226654 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:17.226654 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:17.226654 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:17.226654 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:17.226654 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:17.226654 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:17.226654 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:17.226654 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:17.226654 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:17.226654 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:17.226654 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:17.226654 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:17.226654 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:17.226654 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:17.227700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:17.227700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:17.227700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:17.227700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:17.227700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:17.227700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:17.227700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:17.227700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:17.227700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:17.227700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:17.227700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:17.227700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:17.227700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:17.227700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:17.227700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:17.227700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:17.227700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:17.228519 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:17.228519 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:17.228519 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:17.228519 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 256/505] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:17.229016 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79a4ae-77a5-4b77-818a-3dfd7c7c55fe None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:17.229117 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79a4ae-77a5-4b77-818a-3dfd7c7c55fe None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:17.229390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79a4ae-77a5-4b77-818a-3dfd7c7c55fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:17.241179 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc1514-5077-4d72-8f7b-e358859efcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:17.241776 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc1514-5077-4d72-8f7b-e358859efcf7 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:17.242054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc1514-5077-4d72-8f7b-e358859efcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:17.242348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc1514-5077-4d72-8f7b-e358859efcf7 None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:17.242980 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc1514-5077-4d72-8f7b-e358859efcf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:17.243277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc1514-5077-4d72-8f7b-e358859efcf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:17.244632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc1514-5077-4d72-8f7b-e358859efcf7 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:17.247736 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-1f79a4ae-77a5-4b77-818a-3dfd7c7c55fe None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:17.248960 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-1f79a4ae-77a5-4b77-818a-3dfd7c7c55fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:17.256950 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 250/506] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:17.257736 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc1514-5077-4d72-8f7b-e358859efcf7 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:17.285046 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:17.289100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:17.316612 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 257/507] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:17.317432 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79a4ae-77a5-4b77-818a-3dfd7c7c55fe None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:17.362136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc1514-5077-4d72-8f7b-e358859efcf7 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:17.403611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e804ae1-6676-4303-a0fc-5f1040a353bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:17.404538 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e804ae1-6676-4303-a0fc-5f1040a353bb None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:17.405030 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e804ae1-6676-4303-a0fc-5f1040a353bb None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:17.405991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e804ae1-6676-4303-a0fc-5f1040a353bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:17.417089 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e804ae1-6676-4303-a0fc-5f1040a353bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:17.418411 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79a4ae-77a5-4b77-818a-3dfd7c7c55fe None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:17.419039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e804ae1-6676-4303-a0fc-5f1040a353bb None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:17.435425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-0e804ae1-6676-4303-a0fc-5f1040a353bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:17.435425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:17.435425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:17.435425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:17.435425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:17.435425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:17.435425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:17.435425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:17.435425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:17.435425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:17.435425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:17.435425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:17.435425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:17.435425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:17.435425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:17.435425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:17.436325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:17.436325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:17.436325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:17.436325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:17.436325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:17.436325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:17.436325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:17.436325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:17.436325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:17.436325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:17.436325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:17.436325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:17.436325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:17.436325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:17.436325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:17.436325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:17.436325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:17.437162 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:17.437162 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:17.437162 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:17.437162 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 251/508] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:17.437379 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e804ae1-6676-4303-a0fc-5f1040a353bb None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:17.462257 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bfd79-95e6-459c-9e0a-4c3d0f55dd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:17.463554 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bfd79-95e6-459c-9e0a-4c3d0f55dd04 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:17.464316 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bfd79-95e6-459c-9e0a-4c3d0f55dd04 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:17.465218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bfd79-95e6-459c-9e0a-4c3d0f55dd04 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:17.466164 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97bfd79-95e6-459c-9e0a-4c3d0f55dd04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:17.466912 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97bfd79-95e6-459c-9e0a-4c3d0f55dd04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:17.468857 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97bfd79-95e6-459c-9e0a-4c3d0f55dd04 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:17.490820 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 258/509] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:17.490820 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bfd79-95e6-459c-9e0a-4c3d0f55dd04 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:17.529233 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:17.535539 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:17.554703 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e804ae1-6676-4303-a0fc-5f1040a353bb None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:17.589626 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d60e1f-6312-4a2f-91b0-80f1f7ea1f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:17.590257 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d60e1f-6312-4a2f-91b0-80f1f7ea1f8e None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:17.590568 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d60e1f-6312-4a2f-91b0-80f1f7ea1f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:17.590842 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d60e1f-6312-4a2f-91b0-80f1f7ea1f8e None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:17.591482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d60e1f-6312-4a2f-91b0-80f1f7ea1f8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:17.591853 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d60e1f-6312-4a2f-91b0-80f1f7ea1f8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:17.593268 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d60e1f-6312-4a2f-91b0-80f1f7ea1f8e None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:17.595970 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bfd79-95e6-459c-9e0a-4c3d0f55dd04 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:17.605813 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 252/510] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:17.606640 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d60e1f-6312-4a2f-91b0-80f1f7ea1f8e None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:17.638063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a987f0-7222-4146-8b8f-10c0186d12f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:17.638718 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a987f0-7222-4146-8b8f-10c0186d12f2 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:17.638995 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a987f0-7222-4146-8b8f-10c0186d12f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:17.639262 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a987f0-7222-4146-8b8f-10c0186d12f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:17.647557 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a987f0-7222-4146-8b8f-10c0186d12f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:17.649193 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a987f0-7222-4146-8b8f-10c0186d12f2 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:17.661118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-17a987f0-7222-4146-8b8f-10c0186d12f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:56:17.661118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:17.661118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:17.661118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:17.661118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:17.661118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:17.661118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:17.661118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:17.661118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:17.661118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:17.661118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:17.661118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:17.661118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:56:17.661118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:56:17.661118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:56:17.661118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:56:17.662056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:17.662056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:17.662056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:56:17.662056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:17.662056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:56:17.662056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:17.662056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:17.662056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:17.662056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:17.662056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:17.662056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:17.662056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:17.662056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:17.662056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:17.662056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:17.662056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:17.662056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:17.662056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:17.663014 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:17.663014 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:17.663014 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:56:17.663014 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:56:17.663014 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:56:17.663014 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:56:17.663014 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:56:17.663014 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:56:17.663014 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:56:17.663014 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:17.663014 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 259/511] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Aug 23 07:56:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:17.663014 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a987f0-7222-4146-8b8f-10c0186d12f2 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:17.719607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d60e1f-6312-4a2f-91b0-80f1f7ea1f8e None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:17.753709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147c65d-9710-4021-8d9c-c0e210cce342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:17.754343 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147c65d-9710-4021-8d9c-c0e210cce342 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:17.754527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147c65d-9710-4021-8d9c-c0e210cce342 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:17.754802 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147c65d-9710-4021-8d9c-c0e210cce342 None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:17.755436 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147c65d-9710-4021-8d9c-c0e210cce342 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:17.755736 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147c65d-9710-4021-8d9c-c0e210cce342 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:17.756748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:17.757119 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147c65d-9710-4021-8d9c-c0e210cce342 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:17.764642 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a987f0-7222-4146-8b8f-10c0186d12f2 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:17.765720 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:17.769187 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 253/512] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:17.773912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147c65d-9710-4021-8d9c-c0e210cce342 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:17.800476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0b4c3-3c5e-4e9f-9579-d46f982c1743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:17.801111 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0b4c3-3c5e-4e9f-9579-d46f982c1743 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:17.801396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0b4c3-3c5e-4e9f-9579-d46f982c1743 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:17.801668 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0b4c3-3c5e-4e9f-9579-d46f982c1743 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:17.810226 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0b4c3-3c5e-4e9f-9579-d46f982c1743 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:17.811726 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0b4c3-3c5e-4e9f-9579-d46f982c1743 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:17.822843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-73b0b4c3-3c5e-4e9f-9579-d46f982c1743 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 07:56:17.822843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:17.822843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:17.822843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:17.822843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:17.822843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:17.822843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:17.822843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:17.822843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:17.822843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:17.822843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:17.822843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:17.822843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:56:17.822843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:56:17.822843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:56:17.822843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:56:17.824132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:17.824132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:17.824132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:56:17.824132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:17.824132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:56:17.824132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:17.824132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:17.824132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:17.824132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:17.824132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:17.824132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:17.824132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:17.824132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:17.824132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:17.824132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:17.824132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:17.824132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:17.824132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:17.825100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:17.825100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:17.825100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:56:17.825100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:56:17.825100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:56:17.825100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:56:17.825100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:56:17.825100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:56:17.825100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 07:56:17.825100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:17.825100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 260/513] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 23 07:56:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:17.825100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0b4c3-3c5e-4e9f-9579-d46f982c1743 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:17.881203 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147c65d-9710-4021-8d9c-c0e210cce342 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:17.914489 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d445a-4c61-40d7-995b-d295c86bc8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:17.915107 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d445a-4c61-40d7-995b-d295c86bc8b7 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:17.915382 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d445a-4c61-40d7-995b-d295c86bc8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:17.915655 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d445a-4c61-40d7-995b-d295c86bc8b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:17.921562 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0b4c3-3c5e-4e9f-9579-d46f982c1743 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:17.926456 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d445a-4c61-40d7-995b-d295c86bc8b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:17.927910 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d445a-4c61-40d7-995b-d295c86bc8b7 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:17.941760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-be4d445a-4c61-40d7-995b-d295c86bc8b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:17.941760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:17.941760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:17.941760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:17.941760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:17.941760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:17.941760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:17.941760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:17.941760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:17.941760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:17.941760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:17.941760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:17.941760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:17.941760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:17.941760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:17.941760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:17.942692 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:17.942692 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:17.942692 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:17.942692 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:17.942692 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:17.942692 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:17.942692 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:17.942692 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:17.942692 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:17.942692 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:17.942692 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:17.942692 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:17.942692 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:17.942692 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:17.942692 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:17.942692 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:17.942692 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:17.943525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:17.943525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:17.943525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:17.943525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 254/514] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:17.943735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d445a-4c61-40d7-995b-d295c86bc8b7 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:17.957850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c6e68-aed3-45ff-aa2f-792ab9675ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:17.958509 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c6e68-aed3-45ff-aa2f-792ab9675ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:17.958795 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c6e68-aed3-45ff-aa2f-792ab9675ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:17.959067 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c6e68-aed3-45ff-aa2f-792ab9675ae9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:17.966167 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c6e68-aed3-45ff-aa2f-792ab9675ae9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:17.967657 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c6e68-aed3-45ff-aa2f-792ab9675ae9 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:17.979109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-4d0c6e68-aed3-45ff-aa2f-792ab9675ae9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:17.979109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:17.979109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:17.979109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:17.979109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:17.979109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:17.979109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:17.979109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:17.979109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:17.979109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:17.979109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:17.979109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:17.979109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:56:17.979109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:56:17.979109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:56:17.980822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:56:17.980822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:17.980822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:17.980822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:17.980822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:17.980822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:17.980822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:17.980822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:17.980822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:17.980822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:17.980822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:17.980822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:17.980822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:17.980822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:17.980822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:17.980822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:17.980822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:17.981696 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:56:17.981696 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:56:17.981696 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:56:17.981696 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:56:17.981696 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:56:17.981696 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:56:17.981696 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:17.981696 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:17.981696 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 261/515] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:17.982171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c6e68-aed3-45ff-aa2f-792ab9675ae9 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:17.996367 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:18.001181 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:18.044102 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d445a-4c61-40d7-995b-d295c86bc8b7 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:18.081947 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2596171-3893-45a6-9495-8f93a867b987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:18.082611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2596171-3893-45a6-9495-8f93a867b987 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:18.082893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2596171-3893-45a6-9495-8f93a867b987 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:18.083167 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2596171-3893-45a6-9495-8f93a867b987 None admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:18.083897 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2596171-3893-45a6-9495-8f93a867b987 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:18.084205 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2596171-3893-45a6-9495-8f93a867b987 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:18.084457 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c6e68-aed3-45ff-aa2f-792ab9675ae9 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:18.085661 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2596171-3893-45a6-9495-8f93a867b987 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:18.126256 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 255/516] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Aug 23 07:56:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:18.127202 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2596171-3893-45a6-9495-8f93a867b987 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:18.129724 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d4f10-a159-4c70-b0db-de2d37463270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:18.130536 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d4f10-a159-4c70-b0db-de2d37463270 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:18.130826 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d4f10-a159-4c70-b0db-de2d37463270 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:18.131093 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d4f10-a159-4c70-b0db-de2d37463270 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:18.139268 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d4f10-a159-4c70-b0db-de2d37463270 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:18.140716 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d4f10-a159-4c70-b0db-de2d37463270 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:18.151740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-9c9d4f10-a159-4c70-b0db-de2d37463270 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 07:56:18.151740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:18.151740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:18.151740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:18.151740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:18.151740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:18.151740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:18.151740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:18.151740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:18.151740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:18.151740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:18.151740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:18.151740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:56:18.151740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:56:18.151740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:56:18.151740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:56:18.153135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:18.153135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:18.153135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:56:18.153135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:18.153135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:56:18.153135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:18.153135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:18.153135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:18.153135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:18.153135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:18.153135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:18.153135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:18.153135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:18.153135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:18.153135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:18.153135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:18.153135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:18.153135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:18.154029 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:18.154029 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:18.154029 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:56:18.154029 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:56:18.154029 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:56:18.154029 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:56:18.154029 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:56:18.154029 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:56:18.154029 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 07:56:18.154029 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:18.154029 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 262/517] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:56:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:18.154633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d4f10-a159-4c70-b0db-de2d37463270 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:18.228193 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:18.230558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2596171-3893-45a6-9495-8f93a867b987 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:18.240764 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:18.251440 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d4f10-a159-4c70-b0db-de2d37463270 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:18.263506 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884edd9f-b13c-41d0-8cb7-d55934817f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:18.264114 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884edd9f-b13c-41d0-8cb7-d55934817f01 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:18.264392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884edd9f-b13c-41d0-8cb7-d55934817f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:18.264670 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884edd9f-b13c-41d0-8cb7-d55934817f01 None admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:18.266838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884edd9f-b13c-41d0-8cb7-d55934817f01 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:18.266838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884edd9f-b13c-41d0-8cb7-d55934817f01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:18.267203 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884edd9f-b13c-41d0-8cb7-d55934817f01 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:18.284142 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 256/518] 10.222.0.57 () {56 vars in 1139 bytes} [Tue Aug 23 07:56:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:18.284951 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ce143-4396-46d1-be58-165b78b6ef5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:18.285101 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884edd9f-b13c-41d0-8cb7-d55934817f01 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:18.285559 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ce143-4396-46d1-be58-165b78b6ef5e None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:18.285825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ce143-4396-46d1-be58-165b78b6ef5e None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:18.286094 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ce143-4396-46d1-be58-165b78b6ef5e None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:18.286752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ce143-4396-46d1-be58-165b78b6ef5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:18.287049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ce143-4396-46d1-be58-165b78b6ef5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:18.288408 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ce143-4396-46d1-be58-165b78b6ef5e None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:18.300296 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 263/519] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:18.301092 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ce143-4396-46d1-be58-165b78b6ef5e None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:18.383159 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884edd9f-b13c-41d0-8cb7-d55934817f01 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:18.397184 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ce143-4396-46d1-be58-165b78b6ef5e None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:18.416260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331acab3-9072-445a-9077-a03f05c41f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:18.416853 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331acab3-9072-445a-9077-a03f05c41f66 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:18.417138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331acab3-9072-445a-9077-a03f05c41f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:18.417944 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331acab3-9072-445a-9077-a03f05c41f66 None admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:18.418666 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331acab3-9072-445a-9077-a03f05c41f66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:18.418972 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331acab3-9072-445a-9077-a03f05c41f66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:18.420406 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331acab3-9072-445a-9077-a03f05c41f66 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:18.437962 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b50bfa-9373-4b3e-89dc-7acfd3ecbd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:18.438873 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b50bfa-9373-4b3e-89dc-7acfd3ecbd98 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:18.439010 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 257/520] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:56:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:18.439098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b50bfa-9373-4b3e-89dc-7acfd3ecbd98 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:18.439170 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b50bfa-9373-4b3e-89dc-7acfd3ecbd98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:18.439479 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331acab3-9072-445a-9077-a03f05c41f66 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:18.441738 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:18.470537 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:18.512418 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b50bfa-9373-4b3e-89dc-7acfd3ecbd98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:18.513813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b50bfa-9373-4b3e-89dc-7acfd3ecbd98 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:18.542335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331acab3-9072-445a-9077-a03f05c41f66 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:18.575858 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997baf98-c7b0-44df-9255-2b1b57b142b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:18.576467 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997baf98-c7b0-44df-9255-2b1b57b142b0 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:18.576744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997baf98-c7b0-44df-9255-2b1b57b142b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:18.577017 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997baf98-c7b0-44df-9255-2b1b57b142b0 None admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:18.577747 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997baf98-c7b0-44df-9255-2b1b57b142b0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:18.578051 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997baf98-c7b0-44df-9255-2b1b57b142b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:18.579532 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997baf98-c7b0-44df-9255-2b1b57b142b0 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:18.596504 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 258/521] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Aug 23 07:56:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:18.597302 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997baf98-c7b0-44df-9255-2b1b57b142b0 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:18.617618 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 264/522] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:56:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:56:18.618479 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b50bfa-9373-4b3e-89dc-7acfd3ecbd98 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:18.651875 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:18.684430 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:18.698372 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997baf98-c7b0-44df-9255-2b1b57b142b0 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:18.716946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b50bfa-9373-4b3e-89dc-7acfd3ecbd98 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:18.731344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23f744-59ca-4bce-bd92-409265c6bf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:18.731945 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23f744-59ca-4bce-bd92-409265c6bf67 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:18.732226 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23f744-59ca-4bce-bd92-409265c6bf67 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:18.732513 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23f744-59ca-4bce-bd92-409265c6bf67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:18.749944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641ea26-bdd2-47de-838c-4127dc531133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:18.750578 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641ea26-bdd2-47de-838c-4127dc531133 None admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:18.750862 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641ea26-bdd2-47de-838c-4127dc531133 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:18.751134 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641ea26-bdd2-47de-838c-4127dc531133 None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:18.751776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641ea26-bdd2-47de-838c-4127dc531133 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:18.753219 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641ea26-bdd2-47de-838c-4127dc531133 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:18.798731 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23f744-59ca-4bce-bd92-409265c6bf67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:18.800129 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23f744-59ca-4bce-bd92-409265c6bf67 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:18.870456 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 265/523] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 23 07:56:18 2022] POST /identity/v3/users => generated 247 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:56:18.871291 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641ea26-bdd2-47de-838c-4127dc531133 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:18.885185 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:18.908617 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 259/524] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:56:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:56:18.908617 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23f744-59ca-4bce-bd92-409265c6bf67 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:18.982816 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:18.992741 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641ea26-bdd2-47de-838c-4127dc531133 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:19.017549 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23f744-59ca-4bce-bd92-409265c6bf67 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:19.030185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d84c4-4bdb-40d1-a60f-7761b256bbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:19.030831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d84c4-4bdb-40d1-a60f-7761b256bbf5 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:19.031817 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d84c4-4bdb-40d1-a60f-7761b256bbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:19.031817 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d84c4-4bdb-40d1-a60f-7761b256bbf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:19.032102 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d84c4-4bdb-40d1-a60f-7761b256bbf5 None admin] RBAC: Adding query filter params (role.id=e005fb4b59104519a433fc31da70f47e, scope.project.id=a80ab70ab6b9415c98017d05512c33eb, user.id=2f4ee9c3c5be48699a24dfce9b30bda6) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:19.032400 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d84c4-4bdb-40d1-a60f-7761b256bbf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:19.033844 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d84c4-4bdb-40d1-a60f-7761b256bbf5 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:19.039330 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 266/525] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:56:18 2022] GET /identity/v3/role_assignments?user.id=2f4ee9c3c5be48699a24dfce9b30bda6&scope.project.id=a80ab70ab6b9415c98017d05512c33eb&role.id=e005fb4b59104519a433fc31da70f47e => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:19.041089 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d84c4-4bdb-40d1-a60f-7761b256bbf5 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:19.058640 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef2067-7f58-4dcd-b181-23e82f433748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:19.059273 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef2067-7f58-4dcd-b181-23e82f433748 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:19.059553 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef2067-7f58-4dcd-b181-23e82f433748 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:19.059830 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef2067-7f58-4dcd-b181-23e82f433748 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:19.136145 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:19.154929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef2067-7f58-4dcd-b181-23e82f433748 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:19.157219 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef2067-7f58-4dcd-b181-23e82f433748 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:19.179414 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d84c4-4bdb-40d1-a60f-7761b256bbf5 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:19.219153 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1991fe-8d0d-4533-bf23-4904a57fd3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:19.219876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1991fe-8d0d-4533-bf23-4904a57fd3ea None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:19.220259 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1991fe-8d0d-4533-bf23-4904a57fd3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:19.220651 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1991fe-8d0d-4533-bf23-4904a57fd3ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:19.232164 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1991fe-8d0d-4533-bf23-4904a57fd3ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:19.233771 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1991fe-8d0d-4533-bf23-4904a57fd3ea None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:19.249775 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-5d1991fe-8d0d-4533-bf23-4904a57fd3ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:19.249775 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:19.249775 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:19.249775 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:19.249775 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:19.249775 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:19.249775 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:19.249775 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:19.249775 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:19.249775 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:19.249775 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:19.249775 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:19.249775 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:19.249775 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:19.249775 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:19.249775 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:19.250748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:19.250748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:19.250748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:19.250748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:19.250748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:19.250748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:19.250748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:19.250748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:19.250748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:19.250748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:19.250748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:19.250748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:19.250748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:19.250748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:19.250748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:19.250748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:19.250748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:19.251807 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:19.251807 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:19.251807 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:19.251807 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 267/526] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:19.257242 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1991fe-8d0d-4533-bf23-4904a57fd3ea None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:19.267044 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:19.273345 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 260/527] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:56:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:56:19.274487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef2067-7f58-4dcd-b181-23e82f433748 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:19.364905 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:19.366979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1991fe-8d0d-4533-bf23-4904a57fd3ea None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:19.380967 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef2067-7f58-4dcd-b181-23e82f433748 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:19.404582 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51207200-ac62-4a01-b6bb-6806a44cf8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:19.405405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51207200-ac62-4a01-b6bb-6806a44cf8bc None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:19.405745 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51207200-ac62-4a01-b6bb-6806a44cf8bc None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:19.406121 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51207200-ac62-4a01-b6bb-6806a44cf8bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:19.418430 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51207200-ac62-4a01-b6bb-6806a44cf8bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:19.419190 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fd7d1-ca29-4ef2-a92a-b51941a0bfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:19.419962 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fd7d1-ca29-4ef2-a92a-b51941a0bfab None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:19.420258 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51207200-ac62-4a01-b6bb-6806a44cf8bc None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:19.420558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fd7d1-ca29-4ef2-a92a-b51941a0bfab None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:19.421167 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fd7d1-ca29-4ef2-a92a-b51941a0bfab None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:19.421963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fd7d1-ca29-4ef2-a92a-b51941a0bfab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:19.422444 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fd7d1-ca29-4ef2-a92a-b51941a0bfab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:19.424013 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fd7d1-ca29-4ef2-a92a-b51941a0bfab None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:19.436283 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-51207200-ac62-4a01-b6bb-6806a44cf8bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:19.436283 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:19.436283 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:19.436283 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:19.436283 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:19.436283 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:19.436283 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:19.436283 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:19.436283 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:19.436283 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:19.436283 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:19.436283 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:19.436283 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:19.436283 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:19.436283 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:19.436283 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:19.437225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:19.437225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:19.437225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:19.437225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:19.437225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:19.437225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:19.437225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:19.437225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:19.437225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:19.437225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:19.437225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:19.437225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:19.437225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:19.437225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:19.437225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:19.437225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:19.437225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:19.438079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:19.438079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:19.438079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:19.439298 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 261/528] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:19.440351 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fd7d1-ca29-4ef2-a92a-b51941a0bfab None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:19.442938 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 268/529] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:19.443819 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51207200-ac62-4a01-b6bb-6806a44cf8bc None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:19.520574 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:19.569615 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fd7d1-ca29-4ef2-a92a-b51941a0bfab None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:19.581578 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51207200-ac62-4a01-b6bb-6806a44cf8bc None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:19.609067 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6b0e9-586e-40cd-bd79-7db33f04831c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:19.610079 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6b0e9-586e-40cd-bd79-7db33f04831c None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:19.610584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6b0e9-586e-40cd-bd79-7db33f04831c None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:19.611079 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6b0e9-586e-40cd-bd79-7db33f04831c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:19.624093 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6b0e9-586e-40cd-bd79-7db33f04831c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:19.625980 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6b0e9-586e-40cd-bd79-7db33f04831c None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:19.626574 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7e637-953c-425a-bcd3-fd6100e67afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:19.627562 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7e637-953c-425a-bcd3-fd6100e67afb None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:19.628064 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7e637-953c-425a-bcd3-fd6100e67afb None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:19.628408 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7e637-953c-425a-bcd3-fd6100e67afb None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:19.630136 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7e637-953c-425a-bcd3-fd6100e67afb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:19.630631 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7e637-953c-425a-bcd3-fd6100e67afb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:19.632095 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7e637-953c-425a-bcd3-fd6100e67afb None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:19.635679 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:19.644752 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-a2d6b0e9-586e-40cd-bd79-7db33f04831c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:19.644752 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:19.644752 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:19.644752 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:19.644752 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:19.644752 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:19.644752 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:19.644752 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:19.644752 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:19.644752 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:19.644752 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:19.644752 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:19.644752 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:19.644752 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:19.644752 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:19.644752 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:19.645646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:19.645646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:19.645646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:19.645646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:19.645646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:19.645646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:19.645646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:19.645646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:19.645646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:19.645646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:19.645646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:19.645646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:19.645646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:19.645646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:19.645646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:19.645646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:19.645646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:19.646525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:19.646525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:19.646525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:19.647203 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 269/530] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:19.648599 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 262/531] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:19.651205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7e637-953c-425a-bcd3-fd6100e67afb None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:19.654182 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6b0e9-586e-40cd-bd79-7db33f04831c None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:19.812514 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7e637-953c-425a-bcd3-fd6100e67afb None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:19.831385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:19.837307 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6b0e9-586e-40cd-bd79-7db33f04831c None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:19.854195 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70256bd8-3586-435d-8289-c8fce415eb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:19.860138 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70256bd8-3586-435d-8289-c8fce415eb0c None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:19.860138 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70256bd8-3586-435d-8289-c8fce415eb0c None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:19.860138 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70256bd8-3586-435d-8289-c8fce415eb0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:19.864837 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70256bd8-3586-435d-8289-c8fce415eb0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:19.866668 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70256bd8-3586-435d-8289-c8fce415eb0c None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:19.883303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-70256bd8-3586-435d-8289-c8fce415eb0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:19.883303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:19.883303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:19.883303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:19.883303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:19.883303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:19.883303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:19.883303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:19.883303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:19.883303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:19.883303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:19.883303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:19.883303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:56:19.883303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:56:19.883303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:56:19.884845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:56:19.884845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:19.884845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:19.884845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:19.884845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:19.884845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:19.884845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:19.884845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:19.884845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:19.884845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:19.884845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:19.884845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:19.884845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:19.884845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:19.884845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:19.884845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:19.884845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:19.886001 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:56:19.886001 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:56:19.886001 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:56:19.886001 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:56:19.886001 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:56:19.886001 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:56:19.886001 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:19.886001 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:19.886856 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af93f38-90e7-40d0-afbf-a159786098c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:19.886856 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af93f38-90e7-40d0-afbf-a159786098c9 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:19.886856 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af93f38-90e7-40d0-afbf-a159786098c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:19.886856 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af93f38-90e7-40d0-afbf-a159786098c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:19.894564 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 270/532] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:19.895685 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70256bd8-3586-435d-8289-c8fce415eb0c None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:19.897333 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af93f38-90e7-40d0-afbf-a159786098c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:19.899494 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af93f38-90e7-40d0-afbf-a159786098c9 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:19.913501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-2af93f38-90e7-40d0-afbf-a159786098c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:19.913501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:19.913501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:19.913501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:19.913501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:19.913501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:19.913501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:19.913501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:19.913501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:19.913501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:19.913501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:19.913501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:19.913501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:56:19.913501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:56:19.913501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:56:19.914393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:56:19.914393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:19.914393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:19.914393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:19.914393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:19.914393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:19.914393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:19.914393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:19.914393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:19.914393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:19.914393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:19.914393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:19.914393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:19.914393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:19.914393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:19.914393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:19.914393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:19.915233 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:56:19.915233 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:56:19.915233 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:56:19.915233 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:56:19.915233 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:56:19.915233 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:56:19.915233 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:19.915233 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:19.918415 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 263/533] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:19.919242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af93f38-90e7-40d0-afbf-a159786098c9 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:19.984248 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:20.010480 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70256bd8-3586-435d-8289-c8fce415eb0c None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:20.030918 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af93f38-90e7-40d0-afbf-a159786098c9 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:20.050002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3322951-ea5a-433e-a15d-2cff02278247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:20.051080 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3322951-ea5a-433e-a15d-2cff02278247 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:20.051601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3322951-ea5a-433e-a15d-2cff02278247 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:20.052077 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3322951-ea5a-433e-a15d-2cff02278247 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:20.053018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3322951-ea5a-433e-a15d-2cff02278247 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:20.053520 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3322951-ea5a-433e-a15d-2cff02278247 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:20.055245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3322951-ea5a-433e-a15d-2cff02278247 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:20.067867 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3210ebf-84a5-44cb-8be5-a4b89892228c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:20.068485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3210ebf-84a5-44cb-8be5-a4b89892228c None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:20.068822 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3210ebf-84a5-44cb-8be5-a4b89892228c None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:20.069098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3210ebf-84a5-44cb-8be5-a4b89892228c None admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:20.069851 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3210ebf-84a5-44cb-8be5-a4b89892228c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:20.070159 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3210ebf-84a5-44cb-8be5-a4b89892228c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:20.070879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 271/534] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:20.071819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3210ebf-84a5-44cb-8be5-a4b89892228c None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:20.072211 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3322951-ea5a-433e-a15d-2cff02278247 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:20.090319 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 264/535] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:56:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:20.090319 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3210ebf-84a5-44cb-8be5-a4b89892228c None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:20.123478 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:20.192186 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3322951-ea5a-433e-a15d-2cff02278247 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:20.204012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3210ebf-84a5-44cb-8be5-a4b89892228c None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:20.225617 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:20.234246 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffece1-9cef-4f08-a7a4-8a30e853217e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:20.234900 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffece1-9cef-4f08-a7a4-8a30e853217e None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:20.235183 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffece1-9cef-4f08-a7a4-8a30e853217e None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:20.235459 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffece1-9cef-4f08-a7a4-8a30e853217e None admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:20.236148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffece1-9cef-4f08-a7a4-8a30e853217e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:20.236454 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffece1-9cef-4f08-a7a4-8a30e853217e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:20.237882 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffece1-9cef-4f08-a7a4-8a30e853217e None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:20.249260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b0bf5-6759-41e6-926f-de45c3ec036d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:20.250264 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b0bf5-6759-41e6-926f-de45c3ec036d None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:20.250775 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b0bf5-6759-41e6-926f-de45c3ec036d None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:20.251245 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b0bf5-6759-41e6-926f-de45c3ec036d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:20.259553 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 272/536] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:56:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:20.259553 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffece1-9cef-4f08-a7a4-8a30e853217e None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:20.265260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b0bf5-6759-41e6-926f-de45c3ec036d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:20.267316 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b0bf5-6759-41e6-926f-de45c3ec036d None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:20.280502 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-050b0bf5-6759-41e6-926f-de45c3ec036d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:20.280502 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:20.280502 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:20.280502 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:20.280502 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:20.280502 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:20.280502 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:20.280502 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:20.280502 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:20.280502 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:20.280502 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:20.280502 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:20.280502 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:56:20.280502 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:56:20.280502 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:56:20.281346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:56:20.281346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:20.281346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:20.281346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:20.281346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:20.281346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:20.281346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:20.281346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:20.281346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:20.281346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:20.281346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:20.281346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:20.281346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:20.281346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:20.281346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:20.281346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:20.281346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:20.282180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:56:20.282180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:56:20.282180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:56:20.282180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:56:20.282180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:56:20.282180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:56:20.282180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:20.282180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:20.284653 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 265/537] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:20.285943 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b0bf5-6759-41e6-926f-de45c3ec036d None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:20.363903 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:20.367688 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffece1-9cef-4f08-a7a4-8a30e853217e None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:20.393140 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b0bf5-6759-41e6-926f-de45c3ec036d None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:20.405477 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b7860-39d5-42cc-afae-124bf9042c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:20.406098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b7860-39d5-42cc-afae-124bf9042c00 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:20.406427 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b7860-39d5-42cc-afae-124bf9042c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:20.406708 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b7860-39d5-42cc-afae-124bf9042c00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:20.407442 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b7860-39d5-42cc-afae-124bf9042c00 None admin] RBAC: Adding query filter params (role.id=e005fb4b59104519a433fc31da70f47e, scope.project.id=a80ab70ab6b9415c98017d05512c33eb, user.id=b5c55e5c1cea47f29d378ea457384a31) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:20.407754 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b7860-39d5-42cc-afae-124bf9042c00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:20.409310 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b7860-39d5-42cc-afae-124bf9042c00 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:20.422607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 273/538] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:56:20 2022] GET /identity/v3/role_assignments?user.id=b5c55e5c1cea47f29d378ea457384a31&scope.project.id=a80ab70ab6b9415c98017d05512c33eb&role.id=e005fb4b59104519a433fc31da70f47e => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:20.423741 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b7860-39d5-42cc-afae-124bf9042c00 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:20.432283 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624122fd-ab5f-411f-b74c-3ce933d80073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:20.433265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624122fd-ab5f-411f-b74c-3ce933d80073 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:20.433772 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624122fd-ab5f-411f-b74c-3ce933d80073 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:20.434244 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624122fd-ab5f-411f-b74c-3ce933d80073 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:20.435329 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624122fd-ab5f-411f-b74c-3ce933d80073 None admin] RBAC: Adding query filter params (role.id=e005fb4b59104519a433fc31da70f47e, scope.project.id=a80ab70ab6b9415c98017d05512c33eb, user.id=4239cee14f954e95b4a6b0af2e8799b9) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:20.435846 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624122fd-ab5f-411f-b74c-3ce933d80073 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:20.437527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624122fd-ab5f-411f-b74c-3ce933d80073 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:20.450526 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 266/539] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:56:20 2022] GET /identity/v3/role_assignments?user.id=4239cee14f954e95b4a6b0af2e8799b9&scope.project.id=a80ab70ab6b9415c98017d05512c33eb&role.id=e005fb4b59104519a433fc31da70f47e => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:20.566584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b7860-39d5-42cc-afae-124bf9042c00 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:20.607283 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe21f0-8bce-4004-82ec-f9174885e478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:20.607920 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe21f0-8bce-4004-82ec-f9174885e478 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:20.608206 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe21f0-8bce-4004-82ec-f9174885e478 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:20.608491 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe21f0-8bce-4004-82ec-f9174885e478 None admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:20.609206 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe21f0-8bce-4004-82ec-f9174885e478 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:20.609512 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe21f0-8bce-4004-82ec-f9174885e478 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:20.611057 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe21f0-8bce-4004-82ec-f9174885e478 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:20.625956 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 274/540] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:56:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:20.631697 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624122fd-ab5f-411f-b74c-3ce933d80073 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:20.701487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:20.766425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624122fd-ab5f-411f-b74c-3ce933d80073 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:20.813008 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e85de-0322-495d-946d-deb163bfca0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:20.813952 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e85de-0322-495d-946d-deb163bfca0d None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:20.814406 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e85de-0322-495d-946d-deb163bfca0d None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:20.814830 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e85de-0322-495d-946d-deb163bfca0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:20.815765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e85de-0322-495d-946d-deb163bfca0d None admin] RBAC: Adding query filter params (role.id=e005fb4b59104519a433fc31da70f47e, scope.project.id=a80ab70ab6b9415c98017d05512c33eb, user.id=8c3e2f6c4d8f4798a5fa271bb0b0154b) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:20.816221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e85de-0322-495d-946d-deb163bfca0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:20.817817 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e85de-0322-495d-946d-deb163bfca0d None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:20.824573 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 267/541] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:56:20 2022] GET /identity/v3/role_assignments?user.id=8c3e2f6c4d8f4798a5fa271bb0b0154b&scope.project.id=a80ab70ab6b9415c98017d05512c33eb&role.id=e005fb4b59104519a433fc31da70f47e => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:21.095134 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50c823-b23f-457a-8c3e-1c79d851c84f None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:21.095621 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50c823-b23f-457a-8c3e-1c79d851c84f None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:21.095621 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50c823-b23f-457a-8c3e-1c79d851c84f None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:21.097079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 275/542] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:21.102660 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1c851-df84-4a34-a80d-85a8103ad663 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:21.103112 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1c851-df84-4a34-a80d-85a8103ad663 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:21.103302 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1c851-df84-4a34-a80d-85a8103ad663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:21.127113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-46c1c851-df84-4a34-a80d-85a8103ad663 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:21.128322 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-46c1c851-df84-4a34-a80d-85a8103ad663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:21.157171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ff632-a8dc-4de4-ac31-336c2bc6b18b None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:21.157478 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ff632-a8dc-4de4-ac31-336c2bc6b18b None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:21.157720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ff632-a8dc-4de4-ac31-336c2bc6b18b None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:21.159327 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 276/543] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:21.164609 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cc7b6-3c58-43ae-823e-0b6d663c7b91 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:21.164895 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cc7b6-3c58-43ae-823e-0b6d663c7b91 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:21.165315 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cc7b6-3c58-43ae-823e-0b6d663c7b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:21.192385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-e12cc7b6-3c58-43ae-823e-0b6d663c7b91 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:21.196623 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-e12cc7b6-3c58-43ae-823e-0b6d663c7b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:21.226862 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:21.232439 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 268/544] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:21.288760 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 277/545] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:21.568307 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1c851-df84-4a34-a80d-85a8103ad663 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:21.611185 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:21.616377 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12cc7b6-3c58-43ae-823e-0b6d663c7b91 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:21.744156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1c851-df84-4a34-a80d-85a8103ad663 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:21.797379 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12cc7b6-3c58-43ae-823e-0b6d663c7b91 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:21.814030 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d6604-0570-46eb-8289-172787efb806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:21.814696 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d6604-0570-46eb-8289-172787efb806 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:21.814978 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d6604-0570-46eb-8289-172787efb806 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:21.815249 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d6604-0570-46eb-8289-172787efb806 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:21.834927 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d6604-0570-46eb-8289-172787efb806 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:21.839894 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-bd5d6604-0570-46eb-8289-172787efb806 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:21.839894 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:21.839894 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:21.839894 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:21.839894 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:21.839894 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:21.839894 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:21.839894 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:21.839894 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:21.839894 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:21.839894 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:21.839894 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:21.839894 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:21.839894 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:21.839894 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:21.839894 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:21.840779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:21.840779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:21.840779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:21.840779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:21.840779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:21.840779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:21.840779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:21.840779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:21.840779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:21.840779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:21.840779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:21.840779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:21.840779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:21.840779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:21.840779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:21.840779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:21.841561 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:21.841561 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:21.841561 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:21.841561 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:21.841561 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:21.841561 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:21.841561 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:21.841561 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:21.841561 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:21.841561 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:21.841561 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:21.841561 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:21.842593 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 269/546] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 23 07:56:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:21.848202 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d6604-0570-46eb-8289-172787efb806 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:21.866610 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d993b09-8499-4446-9886-6b9c7c594a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:21.867500 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d993b09-8499-4446-9886-6b9c7c594a1e None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:21.867927 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d993b09-8499-4446-9886-6b9c7c594a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:21.868373 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d993b09-8499-4446-9886-6b9c7c594a1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:21.892644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d993b09-8499-4446-9886-6b9c7c594a1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:21.904220 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-4d993b09-8499-4446-9886-6b9c7c594a1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:21.904220 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:21.904220 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:21.904220 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:21.904220 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:21.904220 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:21.904220 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:21.904220 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:21.904220 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:21.904220 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:21.904220 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:21.904220 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:21.904220 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:21.904220 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:21.904220 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:21.904220 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:21.905780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:21.905780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:21.905780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:21.905780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:21.905780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:21.905780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:21.905780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:21.905780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:21.905780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:21.905780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:21.905780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:21.905780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:21.905780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:21.905780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:21.905780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:21.905780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:21.906820 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:21.906820 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:21.906820 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:21.906820 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:21.906820 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:21.906820 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:21.906820 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:21.906820 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:21.906820 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:21.906820 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:21.906820 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:21.906820 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:21.914627 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 278/547] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 23 07:56:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:21.921737 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d993b09-8499-4446-9886-6b9c7c594a1e None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:21.949370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:22.014768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:22.021742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d6604-0570-46eb-8289-172787efb806 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:22.063912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dc4ca-1a55-4593-a146-cc890251737e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:22.065697 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dc4ca-1a55-4593-a146-cc890251737e None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:22.069161 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dc4ca-1a55-4593-a146-cc890251737e None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:22.069599 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dc4ca-1a55-4593-a146-cc890251737e None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:22.070854 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347dc4ca-1a55-4593-a146-cc890251737e None admin] RBAC: Adding query filter params (name=service) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:22.071394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347dc4ca-1a55-4593-a146-cc890251737e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:22.072981 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347dc4ca-1a55-4593-a146-cc890251737e None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:22.087899 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 270/548] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 23 07:56:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:22.095553 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dc4ca-1a55-4593-a146-cc890251737e None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:22.118900 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d993b09-8499-4446-9886-6b9c7c594a1e None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:22.185609 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a3c9e-0071-44bd-8bc5-364c4db39bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:22.186221 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a3c9e-0071-44bd-8bc5-364c4db39bdb None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:22.186532 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a3c9e-0071-44bd-8bc5-364c4db39bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:22.186807 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a3c9e-0071-44bd-8bc5-364c4db39bdb None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:22.187525 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a3c9e-0071-44bd-8bc5-364c4db39bdb None admin] RBAC: Adding query filter params (name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:22.187830 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a3c9e-0071-44bd-8bc5-364c4db39bdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:22.189303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a3c9e-0071-44bd-8bc5-364c4db39bdb None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:22.209665 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 279/549] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 23 07:56:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:56:22.212149 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a3c9e-0071-44bd-8bc5-364c4db39bdb None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:22.298747 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dc4ca-1a55-4593-a146-cc890251737e None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:22.352781 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:22.377016 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb9b82-25b7-4fdf-9b93-a4cc72cb2b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:22.377677 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb9b82-25b7-4fdf-9b93-a4cc72cb2b7c None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:22.378009 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb9b82-25b7-4fdf-9b93-a4cc72cb2b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:22.378316 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb9b82-25b7-4fdf-9b93-a4cc72cb2b7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:22.392611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb9b82-25b7-4fdf-9b93-a4cc72cb2b7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:22.394200 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb9b82-25b7-4fdf-9b93-a4cc72cb2b7c None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:22.407563 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a3c9e-0071-44bd-8bc5-364c4db39bdb None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:22.421423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-f8bb9b82-25b7-4fdf-9b93-a4cc72cb2b7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:22.421423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:22.421423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:22.421423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:22.421423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:22.421423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:22.421423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:22.421423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:22.421423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:22.421423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:22.421423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:22.421423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:22.421423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:22.421423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:22.421423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:22.421423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:22.422399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:22.422399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:22.422399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:22.422399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:22.422399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:22.422399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:22.422399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:22.422399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:22.422399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:22.422399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:22.422399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:22.422399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:22.422399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:22.422399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:22.422399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:22.422399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:22.422399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:22.423245 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:22.423245 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:22.423245 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:22.423245 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 271/550] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:22.432475 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb9b82-25b7-4fdf-9b93-a4cc72cb2b7c None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:22.451914 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e62ea-6438-42f5-9e4d-c4ba5d43c9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:22.452545 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e62ea-6438-42f5-9e4d-c4ba5d43c9fb None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:22.452821 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e62ea-6438-42f5-9e4d-c4ba5d43c9fb None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:22.453094 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e62ea-6438-42f5-9e4d-c4ba5d43c9fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:22.461516 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:22.465537 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e62ea-6438-42f5-9e4d-c4ba5d43c9fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:22.467040 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e62ea-6438-42f5-9e4d-c4ba5d43c9fb None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:22.483717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-677e62ea-6438-42f5-9e4d-c4ba5d43c9fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:22.483717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:22.483717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:22.483717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:22.483717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:22.483717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:22.483717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:22.483717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:22.483717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:22.483717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:22.483717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:22.483717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:22.483717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:22.483717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:22.483717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:22.483717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:22.486042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:22.486042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:22.486042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:22.486042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:22.486042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:22.486042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:22.486042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:22.486042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:22.486042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:22.486042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:22.486042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:22.486042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:22.486042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:22.486042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:22.486042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:22.486042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:22.486042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:22.487082 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:22.487082 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:22.487082 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:22.487082 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 280/551] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:22.493540 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e62ea-6438-42f5-9e4d-c4ba5d43c9fb None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:22.624734 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e62ea-6438-42f5-9e4d-c4ba5d43c9fb None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:22.665635 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:22.672913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a04621-3b05-48b8-ae41-a8e694d649d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:22.673613 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a04621-3b05-48b8-ae41-a8e694d649d4 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:22.673945 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a04621-3b05-48b8-ae41-a8e694d649d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:22.674276 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a04621-3b05-48b8-ae41-a8e694d649d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:22.675362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a04621-3b05-48b8-ae41-a8e694d649d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:22.675682 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a04621-3b05-48b8-ae41-a8e694d649d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:22.677134 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a04621-3b05-48b8-ae41-a8e694d649d4 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:22.680215 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb9b82-25b7-4fdf-9b93-a4cc72cb2b7c None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:22.691145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 281/552] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:56:22.700913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a04621-3b05-48b8-ae41-a8e694d649d4 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:22.779031 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2596b-5262-4183-9a2d-f7cf0639366d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:22.779661 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2596b-5262-4183-9a2d-f7cf0639366d None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:22.779945 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2596b-5262-4183-9a2d-f7cf0639366d None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:22.780222 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2596b-5262-4183-9a2d-f7cf0639366d None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:22.780870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2596b-5262-4183-9a2d-f7cf0639366d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:22.781173 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2596b-5262-4183-9a2d-f7cf0639366d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:22.782582 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2596b-5262-4183-9a2d-f7cf0639366d None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:22.814709 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a04621-3b05-48b8-ae41-a8e694d649d4 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:22.820599 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 272/553] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:22.826675 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2596b-5262-4183-9a2d-f7cf0639366d None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:22.853964 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a99f37-dde3-4026-8722-5251e7fd532b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:22.854857 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a99f37-dde3-4026-8722-5251e7fd532b None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:22.855124 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a99f37-dde3-4026-8722-5251e7fd532b None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:22.855388 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a99f37-dde3-4026-8722-5251e7fd532b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:22.864567 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a99f37-dde3-4026-8722-5251e7fd532b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:22.866042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a99f37-dde3-4026-8722-5251e7fd532b None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:22.884803 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-92a99f37-dde3-4026-8722-5251e7fd532b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 07:56:22.884803 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:22.884803 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:22.884803 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:22.884803 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:22.884803 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:22.884803 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:22.884803 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:22.884803 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:22.884803 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:22.884803 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:22.884803 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:22.884803 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:56:22.884803 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:56:22.884803 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:56:22.884803 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:56:22.887773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:22.887773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:22.887773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:56:22.887773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:22.887773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:56:22.887773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:22.887773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:22.887773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:22.887773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:22.887773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:22.887773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:22.887773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:22.887773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:22.887773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:22.887773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:22.887773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:22.887773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:22.887773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:22.889936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:22.889936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:22.889936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:56:22.889936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:56:22.889936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:56:22.889936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:56:22.889936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:56:22.889936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:56:22.889936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 07:56:22.889936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:22.889936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 282/554] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:56:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:22.896300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3f2fc-3b90-4dad-85af-2bb9d7d29cb6 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:22.896662 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3f2fc-3b90-4dad-85af-2bb9d7d29cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:22.896955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3f2fc-3b90-4dad-85af-2bb9d7d29cb6 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:22.898602 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 283/555] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:22 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:22.899344 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3f2fc-3b90-4dad-85af-2bb9d7d29cb6 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:22.950023 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:22.953382 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:22.982197 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2596b-5262-4183-9a2d-f7cf0639366d None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:23.008114 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3f2fc-3b90-4dad-85af-2bb9d7d29cb6 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:23.017716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d9f9a-7b30-47e8-a253-2d838bbb6ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:23.018387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d9f9a-7b30-47e8-a253-2d838bbb6ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:23.018671 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d9f9a-7b30-47e8-a253-2d838bbb6ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:23.018953 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d9f9a-7b30-47e8-a253-2d838bbb6ff2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:23.029363 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d9f9a-7b30-47e8-a253-2d838bbb6ff2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:23.030862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d9f9a-7b30-47e8-a253-2d838bbb6ff2 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:23.044277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-d86d9f9a-7b30-47e8-a253-2d838bbb6ff2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 07:56:23.044277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:23.044277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:23.044277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:23.044277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:23.044277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:23.044277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:23.044277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:23.044277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:23.044277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:23.044277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:23.044277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:23.044277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:56:23.044277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:56:23.044277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:56:23.044277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:56:23.045433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:23.045433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:23.045433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:56:23.045433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:23.045433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:56:23.045433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:23.045433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:23.045433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:23.045433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:23.045433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:23.045433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:23.045433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:23.045433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:23.045433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:23.045433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:23.045433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:23.045433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:23.045433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:23.047175 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:23.047175 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:23.047175 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:56:23.047175 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:56:23.047175 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:56:23.047175 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:56:23.047175 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:56:23.047175 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:56:23.047175 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 07:56:23.047175 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:23.049874 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b3894-d32c-46fe-a9f5-c6028962e23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:23.050129 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 273/556] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:56:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:23.050872 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b3894-d32c-46fe-a9f5-c6028962e23d None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:23.051295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b3894-d32c-46fe-a9f5-c6028962e23d None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:23.051406 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36998f1-566b-4e72-8123-87d3aa0097c6 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:23.051671 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36998f1-566b-4e72-8123-87d3aa0097c6 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:23.051950 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36998f1-566b-4e72-8123-87d3aa0097c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:23.052090 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b3894-d32c-46fe-a9f5-c6028962e23d None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:23.052948 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b3894-d32c-46fe-a9f5-c6028962e23d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:23.053404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b3894-d32c-46fe-a9f5-c6028962e23d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:23.055159 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b3894-d32c-46fe-a9f5-c6028962e23d None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:23.069748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-f36998f1-566b-4e72-8123-87d3aa0097c6 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:23.070974 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-f36998f1-566b-4e72-8123-87d3aa0097c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:23.079944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 284/557] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Aug 23 07:56:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:23.081247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771db79-25e3-48f7-8b99-b804b9ae7245 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:23.081538 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771db79-25e3-48f7-8b99-b804b9ae7245 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:23.081817 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771db79-25e3-48f7-8b99-b804b9ae7245 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:23.086326 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 285/558] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:23.086326 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771db79-25e3-48f7-8b99-b804b9ae7245 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:23.145768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 274/559] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:23.146859 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36998f1-566b-4e72-8123-87d3aa0097c6 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:23.211602 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771db79-25e3-48f7-8b99-b804b9ae7245 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:23.215994 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:23.219195 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:23.250062 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f27a5-8569-4d66-a017-c2035bbc35b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:23.251018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f27a5-8569-4d66-a017-c2035bbc35b7 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:23.251529 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f27a5-8569-4d66-a017-c2035bbc35b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:23.251848 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f27a5-8569-4d66-a017-c2035bbc35b7 None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:23.252569 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f27a5-8569-4d66-a017-c2035bbc35b7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:23.252865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f27a5-8569-4d66-a017-c2035bbc35b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:23.254316 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f27a5-8569-4d66-a017-c2035bbc35b7 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:23.274116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 286/560] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Aug 23 07:56:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:23.276242 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6f10d-43df-48e9-b985-5e920bb9c56b None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:23.276815 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6f10d-43df-48e9-b985-5e920bb9c56b None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:23.277355 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6f10d-43df-48e9-b985-5e920bb9c56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:23.277639 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36998f1-566b-4e72-8123-87d3aa0097c6 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:23.305652 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-88c6f10d-43df-48e9-b985-5e920bb9c56b None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:23.306800 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-88c6f10d-43df-48e9-b985-5e920bb9c56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:23.318363 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34644d-bb63-48e9-a235-2087a15d8589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:23.319000 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34644d-bb63-48e9-a235-2087a15d8589 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:23.319275 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34644d-bb63-48e9-a235-2087a15d8589 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:23.319547 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34644d-bb63-48e9-a235-2087a15d8589 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:23.331486 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34644d-bb63-48e9-a235-2087a15d8589 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:23.333015 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34644d-bb63-48e9-a235-2087a15d8589 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:23.347474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-ed34644d-bb63-48e9-a235-2087a15d8589 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:23.347474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:23.347474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:23.347474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:23.347474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:23.347474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:23.347474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:23.347474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:23.347474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:23.347474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:23.347474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:23.347474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:23.347474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:23.347474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:23.347474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:23.347474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:23.348397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:23.348397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:23.348397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:23.348397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:23.348397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:23.348397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:23.348397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:23.348397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:23.348397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:23.348397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:23.348397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:23.348397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:23.348397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:23.348397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:23.348397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:23.348397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:23.348397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:23.349350 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:23.349350 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:23.349350 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:23.349350 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 275/561] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:23.350055 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf8cd6-694c-4ca2-b877-69ecdc9d1ac8 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:23.352138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf8cd6-694c-4ca2-b877-69ecdc9d1ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:23.352138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf8cd6-694c-4ca2-b877-69ecdc9d1ac8 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:23.356401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 276/562] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:23.357177 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf8cd6-694c-4ca2-b877-69ecdc9d1ac8 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:23.402397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 287/563] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:23.402397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6f10d-43df-48e9-b985-5e920bb9c56b None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:23.482532 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf8cd6-694c-4ca2-b877-69ecdc9d1ac8 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:23.515861 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:23.529096 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6f10d-43df-48e9-b985-5e920bb9c56b None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:23.546440 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:23.573146 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833d593-c82e-4d2e-8780-8b74a36b664b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:23.574033 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e11b21-4f5c-4540-86e5-30d78f48d25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:23.574139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833d593-c82e-4d2e-8780-8b74a36b664b None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:23.574493 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e11b21-4f5c-4540-86e5-30d78f48d25d None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:23.574610 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833d593-c82e-4d2e-8780-8b74a36b664b None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:23.574721 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e11b21-4f5c-4540-86e5-30d78f48d25d None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:23.574798 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833d593-c82e-4d2e-8780-8b74a36b664b None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:23.574995 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e11b21-4f5c-4540-86e5-30d78f48d25d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:23.575362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833d593-c82e-4d2e-8780-8b74a36b664b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:23.575663 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833d593-c82e-4d2e-8780-8b74a36b664b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:23.577763 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833d593-c82e-4d2e-8780-8b74a36b664b None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:23.592088 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 288/564] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:23.598080 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d59e6-891c-4fb1-81f8-fd774d433afa None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:23.598608 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d59e6-891c-4fb1-81f8-fd774d433afa None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:23.599101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d59e6-891c-4fb1-81f8-fd774d433afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:23.622089 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-701d59e6-891c-4fb1-81f8-fd774d433afa None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:23.623353 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-701d59e6-891c-4fb1-81f8-fd774d433afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:23.671026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e11b21-4f5c-4540-86e5-30d78f48d25d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:23.673394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e11b21-4f5c-4540-86e5-30d78f48d25d None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:23.716348 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 289/565] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:23.717277 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d59e6-891c-4fb1-81f8-fd774d433afa None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:23.811884 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 277/566] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:56:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:56:23.811884 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e11b21-4f5c-4540-86e5-30d78f48d25d None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:23.828411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:23.831273 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:23.849435 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d59e6-891c-4fb1-81f8-fd774d433afa None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:23.900804 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78d808-1991-4b28-8ea9-4c98cdfbce3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:23.901539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78d808-1991-4b28-8ea9-4c98cdfbce3c None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:23.901824 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78d808-1991-4b28-8ea9-4c98cdfbce3c None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:23.902098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78d808-1991-4b28-8ea9-4c98cdfbce3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:23.914191 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78d808-1991-4b28-8ea9-4c98cdfbce3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:23.920113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-9c78d808-1991-4b28-8ea9-4c98cdfbce3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:23.920113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:23.920113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:23.920113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:23.920113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:23.920113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:23.920113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:23.920113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:23.920113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:23.920113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:23.920113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:23.920113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:23.920113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:23.920113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:23.920113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:23.920113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:23.921063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:23.921063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:23.921063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:23.921063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:23.921063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:23.921063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:23.921063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:23.921063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:23.921063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:23.921063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:23.921063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:23.921063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:23.921063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:23.921063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:23.921063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:23.921063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:23.921914 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:23.921914 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:23.921914 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:23.921914 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:23.921914 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:23.921914 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:23.921914 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:23.921914 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:23.921914 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:23.921914 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:23.921914 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:23.921914 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:23.921914 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 290/567] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 23 07:56:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:23.922638 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78d808-1991-4b28-8ea9-4c98cdfbce3c None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:23.932106 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e11b21-4f5c-4540-86e5-30d78f48d25d None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:23.971101 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f36bbe-0533-4afd-92b5-c21dd978f595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:23.971740 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f36bbe-0533-4afd-92b5-c21dd978f595 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:23.972018 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f36bbe-0533-4afd-92b5-c21dd978f595 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:23.972301 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f36bbe-0533-4afd-92b5-c21dd978f595 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:23.981551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f36bbe-0533-4afd-92b5-c21dd978f595 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:23.983077 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f36bbe-0533-4afd-92b5-c21dd978f595 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:23.994629 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-c4f36bbe-0533-4afd-92b5-c21dd978f595 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:23.994629 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:23.994629 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:23.994629 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:23.994629 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:23.994629 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:23.994629 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:23.994629 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:23.994629 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:23.994629 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:23.994629 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:23.994629 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:23.994629 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:56:23.994629 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:56:23.994629 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:56:23.996288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:56:23.996288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:23.996288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:23.996288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:23.996288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:23.996288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:23.996288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:23.996288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:23.996288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:23.996288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:23.996288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:23.996288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:23.996288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:23.996288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:23.996288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:23.996288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:23.996288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:23.997281 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:56:23.997281 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:56:23.997281 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:56:23.997281 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:56:23.997281 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:56:23.997281 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:56:23.997281 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:23.997281 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:23.997281 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 278/568] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:23.997281 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f36bbe-0533-4afd-92b5-c21dd978f595 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:24.050445 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78d808-1991-4b28-8ea9-4c98cdfbce3c None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:24.088078 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301b648-87a7-4dd4-9c1a-316c814ea4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:24.088721 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301b648-87a7-4dd4-9c1a-316c814ea4df None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:24.089141 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301b648-87a7-4dd4-9c1a-316c814ea4df None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:24.089467 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301b648-87a7-4dd4-9c1a-316c814ea4df None admin] PATH_INFO: `/v3/roles/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:24.096430 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:24.102615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0301b648-87a7-4dd4-9c1a-316c814ea4df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:24.108498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-0301b648-87a7-4dd4-9c1a-316c814ea4df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:24.108498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:24.108498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:24.108498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:24.108498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:24.108498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:24.108498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:24.108498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:24.108498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:24.108498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:24.108498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:24.108498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:24.108498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:24.108498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:24.108498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:24.108498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:24.112955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:24.112955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:24.112955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:24.112955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:24.112955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:24.112955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:24.112955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:24.112955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:24.112955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:24.112955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:24.112955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:24.112955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:24.112955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:24.112955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:24.112955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:24.112955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:24.113896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:24.113896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:24.113896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:24.113896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:24.113896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:24.113896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:24.113896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:24.113896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:24.113896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:24.113896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:24.113896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:24.113896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:24.113896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 291/569] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 23 07:56:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:24.113896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301b648-87a7-4dd4-9c1a-316c814ea4df None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:24.115649 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:24.130076 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f36bbe-0533-4afd-92b5-c21dd978f595 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:24.171649 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1148a-bffd-41c6-a907-fb26407741e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:24.172196 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1148a-bffd-41c6-a907-fb26407741e4 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:24.172547 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1148a-bffd-41c6-a907-fb26407741e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:24.172935 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1148a-bffd-41c6-a907-fb26407741e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:24.187330 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa1148a-bffd-41c6-a907-fb26407741e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:24.190020 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa1148a-bffd-41c6-a907-fb26407741e4 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:24.206327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-8fa1148a-bffd-41c6-a907-fb26407741e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:24.206327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:24.206327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:24.206327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:24.206327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:24.206327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:24.206327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:24.206327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:24.206327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:24.206327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:24.206327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:24.206327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:24.206327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:24.206327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:24.206327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:24.206327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:24.208328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:24.208328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:24.208328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:24.208328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:24.208328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:24.208328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:24.208328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:24.208328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:24.208328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:24.208328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:24.208328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:24.208328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:24.208328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:24.208328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:24.208328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:24.208328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:24.208328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:24.209464 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:24.209464 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:24.209464 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:24.209464 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 279/570] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:24.209464 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1148a-bffd-41c6-a907-fb26407741e4 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:24.230258 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301b648-87a7-4dd4-9c1a-316c814ea4df None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:24.269101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735006e-7834-484f-bca7-620d0accba11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:24.269831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735006e-7834-484f-bca7-620d0accba11 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:24.270115 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735006e-7834-484f-bca7-620d0accba11 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:24.270421 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735006e-7834-484f-bca7-620d0accba11 None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:24.271092 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735006e-7834-484f-bca7-620d0accba11 None admin] RBAC: Adding query filter params (name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:24.271397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735006e-7834-484f-bca7-620d0accba11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:24.272813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735006e-7834-484f-bca7-620d0accba11 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:24.282240 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 292/571] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 23 07:56:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:24.283073 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735006e-7834-484f-bca7-620d0accba11 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:24.319239 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1148a-bffd-41c6-a907-fb26407741e4 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:24.342513 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:24.352931 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcfc6b-6f3c-468f-ac3c-9442a3acb08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:24.353542 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcfc6b-6f3c-468f-ac3c-9442a3acb08e None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:24.356200 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcfc6b-6f3c-468f-ac3c-9442a3acb08e None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:24.356200 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcfc6b-6f3c-468f-ac3c-9442a3acb08e None admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:24.356200 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebcfc6b-6f3c-468f-ac3c-9442a3acb08e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:24.356200 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebcfc6b-6f3c-468f-ac3c-9442a3acb08e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:24.357179 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebcfc6b-6f3c-468f-ac3c-9442a3acb08e None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:24.359018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:24.368990 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 280/572] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:56:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:24.369786 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcfc6b-6f3c-468f-ac3c-9442a3acb08e None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:24.396923 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735006e-7834-484f-bca7-620d0accba11 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:24.430088 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df17b6-97af-40af-a8e9-760b9ae5bf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:24.430662 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df17b6-97af-40af-a8e9-760b9ae5bf6c None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:24.430953 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df17b6-97af-40af-a8e9-760b9ae5bf6c None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:24.431222 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df17b6-97af-40af-a8e9-760b9ae5bf6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:24.441551 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df17b6-97af-40af-a8e9-760b9ae5bf6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:24.446664 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-10df17b6-97af-40af-a8e9-760b9ae5bf6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:24.446664 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:24.446664 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:24.446664 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:24.446664 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:24.446664 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:24.446664 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:24.446664 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:24.446664 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:24.446664 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:24.446664 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:24.446664 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:24.446664 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:24.446664 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:24.446664 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:24.446664 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:24.447772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:24.447772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:24.447772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:24.447772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:24.447772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:24.447772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:24.447772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:24.447772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:24.447772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:24.447772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:24.447772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:24.447772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:24.447772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:24.447772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:24.447772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:24.447772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:24.449455 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:24.449455 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:24.449455 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:24.449455 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:24.449455 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:24.449455 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:24.449455 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:24.449455 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:24.449455 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:24.449455 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:24.449455 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:24.449455 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:24.449455 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 293/573] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 23 07:56:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:24.450139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df17b6-97af-40af-a8e9-760b9ae5bf6c None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:24.477680 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcfc6b-6f3c-468f-ac3c-9442a3acb08e None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:24.512748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501bb8a5-ed96-4407-abdf-20d0d25a33ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:24.513356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bb8a5-ed96-4407-abdf-20d0d25a33ff None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:24.513633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bb8a5-ed96-4407-abdf-20d0d25a33ff None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:24.513906 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bb8a5-ed96-4407-abdf-20d0d25a33ff None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:24.514581 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501bb8a5-ed96-4407-abdf-20d0d25a33ff None admin] RBAC: Adding query filter params (name=service) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:24.514889 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501bb8a5-ed96-4407-abdf-20d0d25a33ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:24.516255 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501bb8a5-ed96-4407-abdf-20d0d25a33ff None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:24.524170 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 281/574] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 23 07:56:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:24.524805 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501bb8a5-ed96-4407-abdf-20d0d25a33ff None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:24.549494 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df17b6-97af-40af-a8e9-760b9ae5bf6c None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:24.572417 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:24.573130 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:24.583831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb02a1-d441-4646-8af8-1aaeb95d6551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:24.584433 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb02a1-d441-4646-8af8-1aaeb95d6551 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:24.584717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb02a1-d441-4646-8af8-1aaeb95d6551 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:24.584988 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb02a1-d441-4646-8af8-1aaeb95d6551 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:24.585674 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb02a1-d441-4646-8af8-1aaeb95d6551 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:24.590333 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb02a1-d441-4646-8af8-1aaeb95d6551 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:24.590333 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb02a1-d441-4646-8af8-1aaeb95d6551 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:24.598952 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 294/575] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:24.599736 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb02a1-d441-4646-8af8-1aaeb95d6551 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:24.627831 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501bb8a5-ed96-4407-abdf-20d0d25a33ff None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:24.665382 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362f8eb-8fb7-4178-a9b0-9dc2ea450f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:24.666028 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362f8eb-8fb7-4178-a9b0-9dc2ea450f35 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:24.666342 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362f8eb-8fb7-4178-a9b0-9dc2ea450f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:24.666623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362f8eb-8fb7-4178-a9b0-9dc2ea450f35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:24.677618 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362f8eb-8fb7-4178-a9b0-9dc2ea450f35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:24.679099 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362f8eb-8fb7-4178-a9b0-9dc2ea450f35 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:24.693398 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-9362f8eb-8fb7-4178-a9b0-9dc2ea450f35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:24.693398 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:24.693398 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:24.693398 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:24.693398 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:24.693398 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:24.693398 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:24.693398 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:24.693398 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:24.693398 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:24.693398 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:24.693398 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:24.693398 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:24.693398 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:24.693398 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:24.693398 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:24.694455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:24.694455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:24.694455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:24.694455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:24.694455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:24.694455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:24.694455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:24.694455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:24.694455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:24.694455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:24.694455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:24.694455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:24.694455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:24.694455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:24.694455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:24.694455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:24.694455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:24.695349 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:24.695349 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:24.695349 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:24.695349 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 282/576] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:24.695349 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362f8eb-8fb7-4178-a9b0-9dc2ea450f35 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:24.706631 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb02a1-d441-4646-8af8-1aaeb95d6551 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:24.742112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc6def-7b84-4a07-8e0c-a7f17fe87a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:24.742794 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc6def-7b84-4a07-8e0c-a7f17fe87a5d None admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:24.743084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc6def-7b84-4a07-8e0c-a7f17fe87a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:24.743357 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc6def-7b84-4a07-8e0c-a7f17fe87a5d None admin] PATH_INFO: `/v3/projects/a80ab70ab6b9415c98017d05512c33eb/users/2f4ee9c3c5be48699a24dfce9b30bda6/roles/e005fb4b59104519a433fc31da70f47e` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:24.758908 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc6def-7b84-4a07-8e0c-a7f17fe87a5d None admin] RBAC: Authorizing `identity:create_grant(project_id=a80ab70ab6b9415c98017d05512c33eb, user_id=2f4ee9c3c5be48699a24dfce9b30bda6, role_id=e005fb4b59104519a433fc31da70f47e)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:24.760386 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc6def-7b84-4a07-8e0c-a7f17fe87a5d None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:24.794236 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:24.797934 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362f8eb-8fb7-4178-a9b0-9dc2ea450f35 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:24.831030 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb977b-cdad-4007-a367-b20a9bfde571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:24.831661 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb977b-cdad-4007-a367-b20a9bfde571 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:24.831942 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb977b-cdad-4007-a367-b20a9bfde571 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:24.832216 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb977b-cdad-4007-a367-b20a9bfde571 None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:24.832875 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb977b-cdad-4007-a367-b20a9bfde571 None admin] RBAC: Adding query filter params (name=service) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:24.833178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb977b-cdad-4007-a367-b20a9bfde571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:24.834578 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb977b-cdad-4007-a367-b20a9bfde571 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:24.836809 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 295/577] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 23 07:56:24 2022] PUT /identity/v3/projects/a80ab70ab6b9415c98017d05512c33eb/users/2f4ee9c3c5be48699a24dfce9b30bda6/roles/e005fb4b59104519a433fc31da70f47e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:56:24.838400 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc6def-7b84-4a07-8e0c-a7f17fe87a5d None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:24.848224 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 283/578] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 23 07:56:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:24.848224 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb977b-cdad-4007-a367-b20a9bfde571 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:24.898830 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:24.969923 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb977b-cdad-4007-a367-b20a9bfde571 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:24.972417 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc6def-7b84-4a07-8e0c-a7f17fe87a5d None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:25.009756 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f7655-bbc9-4bd4-bade-f7ff1f7e526b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:25.010552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f7655-bbc9-4bd4-bade-f7ff1f7e526b None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:25.011665 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f7655-bbc9-4bd4-bade-f7ff1f7e526b None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:25.012024 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f7655-bbc9-4bd4-bade-f7ff1f7e526b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:25.015322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d11262-29ff-4b54-b20d-20108a079e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:25.015953 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d11262-29ff-4b54-b20d-20108a079e8f None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:25.016228 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d11262-29ff-4b54-b20d-20108a079e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:25.016498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d11262-29ff-4b54-b20d-20108a079e8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:25.021235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f7655-bbc9-4bd4-bade-f7ff1f7e526b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:25.022756 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f7655-bbc9-4bd4-bade-f7ff1f7e526b None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:25.027531 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d11262-29ff-4b54-b20d-20108a079e8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:25.029123 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d11262-29ff-4b54-b20d-20108a079e8f None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:25.035056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-500f7655-bbc9-4bd4-bade-f7ff1f7e526b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:25.035056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:25.035056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:25.035056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:25.035056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:25.035056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:25.035056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:25.035056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:25.035056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:25.035056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:25.035056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:25.035056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:25.035056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:56:25.035056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:56:25.035056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:56:25.035909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:56:25.035909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:25.035909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:25.035909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:25.035909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:25.035909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:25.035909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:25.035909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:25.035909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:25.035909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:25.035909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:25.035909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:25.035909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:25.035909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:25.035909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:25.035909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:25.035909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:25.037828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:56:25.037828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:56:25.037828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:56:25.037828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:56:25.037828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:56:25.037828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:56:25.037828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:25.037828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:25.037828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 284/579] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:25.037828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f7655-bbc9-4bd4-bade-f7ff1f7e526b None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:25.048906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-26d11262-29ff-4b54-b20d-20108a079e8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:25.048906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:25.048906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:25.048906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:25.048906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:25.048906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:25.048906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:25.048906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:25.048906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:25.048906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:25.048906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:25.048906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:25.048906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:25.048906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:25.048906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:25.048906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:25.049896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:25.049896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:25.049896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:25.049896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:25.049896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:25.049896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:25.049896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:25.049896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:25.049896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:25.049896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:25.049896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:25.049896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:25.049896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:25.049896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:25.049896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:25.049896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:25.049896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:25.050940 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:25.050940 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:25.050940 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:25.051113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 296/580] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:25.053132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d11262-29ff-4b54-b20d-20108a079e8f None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:25.060156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:25.142188 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f7655-bbc9-4bd4-bade-f7ff1f7e526b None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:25.148640 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:25.163952 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d11262-29ff-4b54-b20d-20108a079e8f None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:25.177795 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292d457-45db-4785-b01e-180eadf056aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:25.178432 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292d457-45db-4785-b01e-180eadf056aa None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:25.178717 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292d457-45db-4785-b01e-180eadf056aa None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:25.178989 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292d457-45db-4785-b01e-180eadf056aa None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:25.179621 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292d457-45db-4785-b01e-180eadf056aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:25.179921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292d457-45db-4785-b01e-180eadf056aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:25.181306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292d457-45db-4785-b01e-180eadf056aa None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:25.193305 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 285/581] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:25.194059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292d457-45db-4785-b01e-180eadf056aa None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:25.204149 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b6cfc-0f96-457b-827b-fd1e3f2e83f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:25.204779 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b6cfc-0f96-457b-827b-fd1e3f2e83f8 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:25.205423 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b6cfc-0f96-457b-827b-fd1e3f2e83f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:25.205705 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b6cfc-0f96-457b-827b-fd1e3f2e83f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:25.217377 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b6cfc-0f96-457b-827b-fd1e3f2e83f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:25.218858 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b6cfc-0f96-457b-827b-fd1e3f2e83f8 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:25.233486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-744b6cfc-0f96-457b-827b-fd1e3f2e83f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:25.233486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:25.233486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:25.233486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:25.233486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:25.233486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:25.233486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:25.233486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:25.233486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:25.233486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:25.233486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:25.233486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:25.233486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:25.233486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:25.233486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:25.233486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:25.234870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:25.234870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:25.234870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:25.234870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:25.234870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:25.234870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:25.234870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:25.234870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:25.234870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:25.234870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:25.234870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:25.234870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:25.234870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:25.234870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:25.234870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:25.234870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:25.234870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:25.235747 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:25.235747 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:25.235747 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:25.235747 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 297/582] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:25.235747 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b6cfc-0f96-457b-827b-fd1e3f2e83f8 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:25.281059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:25.299556 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292d457-45db-4785-b01e-180eadf056aa None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:25.337320 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27c7cc-09c2-47e2-a3e8-2bf0504a2815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:25.337987 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27c7cc-09c2-47e2-a3e8-2bf0504a2815 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:25.338207 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27c7cc-09c2-47e2-a3e8-2bf0504a2815 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:25.338512 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27c7cc-09c2-47e2-a3e8-2bf0504a2815 None admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:25.339734 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27c7cc-09c2-47e2-a3e8-2bf0504a2815 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:25.340226 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27c7cc-09c2-47e2-a3e8-2bf0504a2815 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:25.341670 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27c7cc-09c2-47e2-a3e8-2bf0504a2815 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:25.353988 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 286/583] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:56:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:25.355096 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27c7cc-09c2-47e2-a3e8-2bf0504a2815 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:25.360543 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b6cfc-0f96-457b-827b-fd1e3f2e83f8 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:25.400686 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79ab17-b93e-4841-9973-29ff47652a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:25.402082 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79ab17-b93e-4841-9973-29ff47652a95 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:25.402247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79ab17-b93e-4841-9973-29ff47652a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:25.402505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79ab17-b93e-4841-9973-29ff47652a95 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:25.403113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79ab17-b93e-4841-9973-29ff47652a95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:25.403409 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79ab17-b93e-4841-9973-29ff47652a95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:25.404780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79ab17-b93e-4841-9973-29ff47652a95 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:25.415015 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:25.423312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 298/584] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:25.424308 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79ab17-b93e-4841-9973-29ff47652a95 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:25.468148 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27c7cc-09c2-47e2-a3e8-2bf0504a2815 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:25.502483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dba628-086e-44d6-9bff-8f4bc18c02e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:25.503047 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dba628-086e-44d6-9bff-8f4bc18c02e4 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:25.503333 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dba628-086e-44d6-9bff-8f4bc18c02e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:25.503613 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dba628-086e-44d6-9bff-8f4bc18c02e4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:25.511969 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dba628-086e-44d6-9bff-8f4bc18c02e4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:25.513425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dba628-086e-44d6-9bff-8f4bc18c02e4 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:25.516092 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:25.525932 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-f4dba628-086e-44d6-9bff-8f4bc18c02e4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 07:56:25.525932 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:25.525932 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:25.525932 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:25.525932 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:25.525932 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:25.525932 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:25.525932 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:25.525932 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:25.525932 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:25.525932 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:25.525932 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:25.525932 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:56:25.525932 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:56:25.525932 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:56:25.525932 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:56:25.532397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:25.532397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:25.532397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:56:25.532397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:25.532397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:56:25.532397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:25.532397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:25.532397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:25.532397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:25.532397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:25.532397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:25.532397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:25.532397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:25.532397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:25.532397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:25.532397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:25.532397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:25.532397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:25.533344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:25.533344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:25.533344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:56:25.533344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:56:25.533344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:56:25.533344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:56:25.533344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:56:25.533344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:56:25.533344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 07:56:25.533344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:25.533344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 287/585] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 23 07:56:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:25.533344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dba628-086e-44d6-9bff-8f4bc18c02e4 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:25.536713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79ab17-b93e-4841-9973-29ff47652a95 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:25.574604 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa9ec3-1d49-4994-8e3f-c03de0ded53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:25.575547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa9ec3-1d49-4994-8e3f-c03de0ded53d None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:25.575978 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa9ec3-1d49-4994-8e3f-c03de0ded53d None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:25.576487 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa9ec3-1d49-4994-8e3f-c03de0ded53d None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:25.578174 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa9ec3-1d49-4994-8e3f-c03de0ded53d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:25.578174 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa9ec3-1d49-4994-8e3f-c03de0ded53d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:25.578942 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa9ec3-1d49-4994-8e3f-c03de0ded53d None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:25.598658 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 299/586] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:25.598658 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa9ec3-1d49-4994-8e3f-c03de0ded53d None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:25.665523 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dba628-086e-44d6-9bff-8f4bc18c02e4 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:25.665702 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:25.709200 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a51271-60ee-439e-873f-eeecf1f4c8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:25.709918 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a51271-60ee-439e-873f-eeecf1f4c8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:25.710182 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a51271-60ee-439e-873f-eeecf1f4c8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:25.710575 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a51271-60ee-439e-873f-eeecf1f4c8c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:25.711200 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a51271-60ee-439e-873f-eeecf1f4c8c2 None admin] RBAC: Adding query filter params (role.id=e005fb4b59104519a433fc31da70f47e, scope.project.id=a80ab70ab6b9415c98017d05512c33eb, user.id=4718cad0c0b9461d9c4152d7ea4b385d) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:25.711540 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a51271-60ee-439e-873f-eeecf1f4c8c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:25.713221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a51271-60ee-439e-873f-eeecf1f4c8c2 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:25.716078 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa9ec3-1d49-4994-8e3f-c03de0ded53d None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:25.719674 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 288/587] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:56:25 2022] GET /identity/v3/role_assignments?user.id=4718cad0c0b9461d9c4152d7ea4b385d&scope.project.id=a80ab70ab6b9415c98017d05512c33eb&role.id=e005fb4b59104519a433fc31da70f47e => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:25.720293 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a51271-60ee-439e-873f-eeecf1f4c8c2 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:25.774220 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117d75d-8511-41d0-8b24-cb66b1080903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:25.775583 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117d75d-8511-41d0-8b24-cb66b1080903 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:25.776078 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117d75d-8511-41d0-8b24-cb66b1080903 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:25.777793 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117d75d-8511-41d0-8b24-cb66b1080903 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:25.791784 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117d75d-8511-41d0-8b24-cb66b1080903 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:25.793898 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117d75d-8511-41d0-8b24-cb66b1080903 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:25.797483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:25.808735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-b117d75d-8511-41d0-8b24-cb66b1080903 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:56:25.808735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:25.808735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:25.808735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:25.808735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:25.808735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:25.808735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:25.808735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:25.808735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:25.808735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:25.808735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:25.808735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:25.808735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:56:25.808735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:56:25.808735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:56:25.808735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:56:25.810098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:25.810098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:25.810098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:56:25.810098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:25.810098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:56:25.810098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:25.810098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:25.810098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:25.810098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:25.810098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:25.810098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:25.810098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:25.810098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:25.810098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:25.810098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:25.810098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:25.810098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:25.810098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:25.811279 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:25.811279 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:25.811279 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:56:25.811279 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:56:25.811279 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:56:25.811279 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:56:25.811279 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:56:25.811279 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:56:25.811279 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:56:25.811279 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:25.817711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 300/588] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Aug 23 07:56:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:25.819078 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117d75d-8511-41d0-8b24-cb66b1080903 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:25.848708 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a51271-60ee-439e-873f-eeecf1f4c8c2 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:25.899313 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc054c-e1d3-447d-bc3d-dc7db621c160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:25.900531 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc054c-e1d3-447d-bc3d-dc7db621c160 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:25.900809 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc054c-e1d3-447d-bc3d-dc7db621c160 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:25.901082 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc054c-e1d3-447d-bc3d-dc7db621c160 None admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:25.902889 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc054c-e1d3-447d-bc3d-dc7db621c160 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:25.903198 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc054c-e1d3-447d-bc3d-dc7db621c160 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:25.905845 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc054c-e1d3-447d-bc3d-dc7db621c160 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:25.928679 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 289/589] 10.222.0.57 () {56 vars in 1139 bytes} [Tue Aug 23 07:56:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:25.929731 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc054c-e1d3-447d-bc3d-dc7db621c160 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:25.949287 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117d75d-8511-41d0-8b24-cb66b1080903 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:25.982711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:26.001116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a815d93-029c-40d2-87cc-d9a1fac63977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:26.001932 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a815d93-029c-40d2-87cc-d9a1fac63977 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:26.002375 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a815d93-029c-40d2-87cc-d9a1fac63977 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:26.002746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a815d93-029c-40d2-87cc-d9a1fac63977 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:26.013821 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a815d93-029c-40d2-87cc-d9a1fac63977 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:26.016339 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a815d93-029c-40d2-87cc-d9a1fac63977 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:26.032076 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-3a815d93-029c-40d2-87cc-d9a1fac63977 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 07:56:26.032076 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:26.032076 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:26.032076 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:26.032076 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:26.032076 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:26.032076 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:26.032076 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:26.032076 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:26.032076 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:26.032076 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:26.032076 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:26.032076 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:56:26.032076 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:56:26.032076 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:56:26.032076 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:56:26.033025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:26.033025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:26.033025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:56:26.033025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:26.033025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:56:26.033025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:26.033025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:26.033025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:26.033025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:26.033025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:26.033025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:26.033025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:26.033025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:26.033025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:26.033025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:26.033025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:26.033025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:26.033025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:26.033938 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:26.033938 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:26.033938 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:56:26.033938 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:56:26.033938 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:56:26.033938 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:56:26.033938 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:56:26.033938 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:56:26.033938 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 07:56:26.033938 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:26.038088 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 301/590] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:56:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:26.038993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a815d93-029c-40d2-87cc-d9a1fac63977 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:26.056762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc054c-e1d3-447d-bc3d-dc7db621c160 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:26.082055 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:26.095838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf9ec6-e3c8-45ac-a956-2d742cebd059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:26.096833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf9ec6-e3c8-45ac-a956-2d742cebd059 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:26.097408 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf9ec6-e3c8-45ac-a956-2d742cebd059 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:26.097901 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf9ec6-e3c8-45ac-a956-2d742cebd059 None admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:26.098928 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf9ec6-e3c8-45ac-a956-2d742cebd059 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:26.099429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf9ec6-e3c8-45ac-a956-2d742cebd059 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:26.101212 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf9ec6-e3c8-45ac-a956-2d742cebd059 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:26.121751 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 290/591] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Aug 23 07:56:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:26.123046 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf9ec6-e3c8-45ac-a956-2d742cebd059 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:26.167823 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a815d93-029c-40d2-87cc-d9a1fac63977 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:26.204598 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13d480-78ed-4229-b0d2-d7ded2caf85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:26.205623 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13d480-78ed-4229-b0d2-d7ded2caf85a None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:26.206102 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13d480-78ed-4229-b0d2-d7ded2caf85a None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:26.206725 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13d480-78ed-4229-b0d2-d7ded2caf85a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:26.218353 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13d480-78ed-4229-b0d2-d7ded2caf85a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:26.220210 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13d480-78ed-4229-b0d2-d7ded2caf85a None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:26.236300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-3c13d480-78ed-4229-b0d2-d7ded2caf85a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:26.236300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:26.236300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:26.236300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:26.236300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:26.236300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:26.236300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:26.236300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:26.236300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:26.236300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:26.236300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:26.236300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:26.236300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:26.236300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:26.236300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:26.236300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:26.237702 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:26.237702 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:26.237702 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:26.237702 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:26.237702 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:26.237702 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:26.237702 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:26.237702 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:26.237702 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:26.237702 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:26.237702 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:26.237702 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:26.237702 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:26.237702 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:26.237702 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:26.237702 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:26.237702 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:26.238981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:26.238981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:26.238981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:26.240907 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 302/592] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:26.242052 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13d480-78ed-4229-b0d2-d7ded2caf85a None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:26.245876 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf9ec6-e3c8-45ac-a956-2d742cebd059 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:26.275337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:26.292487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c7505-b853-4789-b66e-b41859838b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:26.292487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c7505-b853-4789-b66e-b41859838b18 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:26.292487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c7505-b853-4789-b66e-b41859838b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:26.292487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c7505-b853-4789-b66e-b41859838b18 None admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:26.293103 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c7505-b853-4789-b66e-b41859838b18 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:26.293418 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c7505-b853-4789-b66e-b41859838b18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:26.295437 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c7505-b853-4789-b66e-b41859838b18 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:26.321395 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 291/593] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Aug 23 07:56:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:26.322593 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c7505-b853-4789-b66e-b41859838b18 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:26.355790 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13d480-78ed-4229-b0d2-d7ded2caf85a None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:26.376568 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:26.398486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74667bf-653d-4e2b-b2b3-4d3f2456cbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:26.399165 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74667bf-653d-4e2b-b2b3-4d3f2456cbe8 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:26.399450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74667bf-653d-4e2b-b2b3-4d3f2456cbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:26.399727 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74667bf-653d-4e2b-b2b3-4d3f2456cbe8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:26.414526 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74667bf-653d-4e2b-b2b3-4d3f2456cbe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:26.416020 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74667bf-653d-4e2b-b2b3-4d3f2456cbe8 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:26.435380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-d74667bf-653d-4e2b-b2b3-4d3f2456cbe8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:26.435380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:26.435380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:26.435380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:26.435380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:26.435380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:26.435380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:26.435380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:26.435380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:26.435380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:26.435380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:26.435380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:26.435380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:26.435380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:26.435380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:26.435380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:26.436338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:26.436338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:26.436338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:26.436338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:26.436338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:26.436338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:26.436338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:26.436338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:26.436338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:26.436338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:26.436338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:26.436338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:26.436338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:26.436338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:26.436338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:26.436338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:26.436338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:26.437205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:26.437205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:26.437205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:26.441464 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 303/594] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:26.442609 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74667bf-653d-4e2b-b2b3-4d3f2456cbe8 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:26.452265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c7505-b853-4789-b66e-b41859838b18 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:26.489544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288267c6-8d71-44c5-8d41-895ae226293d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:26.490555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288267c6-8d71-44c5-8d41-895ae226293d None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:26.491061 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288267c6-8d71-44c5-8d41-895ae226293d None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:26.491548 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288267c6-8d71-44c5-8d41-895ae226293d None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:26.492377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288267c6-8d71-44c5-8d41-895ae226293d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:26.492878 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288267c6-8d71-44c5-8d41-895ae226293d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:26.494574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288267c6-8d71-44c5-8d41-895ae226293d None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:26.507723 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 292/595] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:26.511506 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288267c6-8d71-44c5-8d41-895ae226293d None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:26.546809 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:26.566319 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74667bf-653d-4e2b-b2b3-4d3f2456cbe8 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:26.603086 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361155f-1ad4-4c83-a6cd-e679390f22c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:26.604222 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361155f-1ad4-4c83-a6cd-e679390f22c0 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:26.604768 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361155f-1ad4-4c83-a6cd-e679390f22c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:26.605240 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361155f-1ad4-4c83-a6cd-e679390f22c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:26.616675 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361155f-1ad4-4c83-a6cd-e679390f22c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:26.618446 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361155f-1ad4-4c83-a6cd-e679390f22c0 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:26.627278 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:26.631493 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288267c6-8d71-44c5-8d41-895ae226293d None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:26.635501 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-e361155f-1ad4-4c83-a6cd-e679390f22c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:26.635501 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:26.635501 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:26.635501 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:26.635501 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:26.635501 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:26.635501 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:26.635501 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:26.635501 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:26.635501 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:26.635501 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:26.635501 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:26.635501 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:26.635501 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:26.635501 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:26.635501 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:26.643615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:26.643615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:26.643615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:26.643615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:26.643615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:26.643615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:26.643615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:26.643615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:26.643615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:26.643615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:26.643615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:26.643615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:26.643615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:26.643615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:26.643615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:26.643615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:26.643615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:26.644503 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:26.644503 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:26.644503 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:26.644503 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 304/596] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:26.644503 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361155f-1ad4-4c83-a6cd-e679390f22c0 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:26.688681 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd221b-d417-4326-9431-915bccc8b410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:26.689310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd221b-d417-4326-9431-915bccc8b410 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:26.689597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd221b-d417-4326-9431-915bccc8b410 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:26.689877 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd221b-d417-4326-9431-915bccc8b410 None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:26.691374 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd221b-d417-4326-9431-915bccc8b410 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:26.691688 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd221b-d417-4326-9431-915bccc8b410 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:26.693082 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd221b-d417-4326-9431-915bccc8b410 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:26.713115 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 293/597] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:26.713115 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd221b-d417-4326-9431-915bccc8b410 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:26.777060 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361155f-1ad4-4c83-a6cd-e679390f22c0 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:26.822039 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766f362-3da3-4f25-9015-2e75f477d432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:26.822730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766f362-3da3-4f25-9015-2e75f477d432 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:26.823021 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766f362-3da3-4f25-9015-2e75f477d432 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:26.823382 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766f362-3da3-4f25-9015-2e75f477d432 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:26.823530 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd221b-d417-4326-9431-915bccc8b410 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:26.825985 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:26.831233 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3766f362-3da3-4f25-9015-2e75f477d432 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:26.832678 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3766f362-3da3-4f25-9015-2e75f477d432 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:26.844484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-3766f362-3da3-4f25-9015-2e75f477d432 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:26.844484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:26.844484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:26.844484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:26.844484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:26.844484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:26.844484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:26.844484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:26.844484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:26.844484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:26.844484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:26.844484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:26.844484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:56:26.844484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:56:26.844484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:56:26.845387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:56:26.845387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:26.845387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:26.845387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:26.845387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:26.845387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:26.845387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:26.845387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:26.845387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:26.845387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:26.845387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:26.845387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:26.845387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:26.845387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:26.845387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:26.845387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:26.845387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:26.846278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:56:26.846278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:56:26.846278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:56:26.846278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:56:26.846278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:56:26.846278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:56:26.846278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:26.846278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:26.846278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 305/598] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:26.847702 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766f362-3da3-4f25-9015-2e75f477d432 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:26.864888 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5d2d8-ac1a-4afb-8979-321412ff6bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:26.865482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5d2d8-ac1a-4afb-8979-321412ff6bbe None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:26.865751 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5d2d8-ac1a-4afb-8979-321412ff6bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:26.866025 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5d2d8-ac1a-4afb-8979-321412ff6bbe None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:26.866684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e5d2d8-ac1a-4afb-8979-321412ff6bbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:26.866983 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e5d2d8-ac1a-4afb-8979-321412ff6bbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:26.868361 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e5d2d8-ac1a-4afb-8979-321412ff6bbe None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:26.881791 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 294/599] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:26.883038 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f50a9-88a8-408f-a90d-4fbe30ac9927 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:26.883326 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f50a9-88a8-408f-a90d-4fbe30ac9927 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:26.883599 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f50a9-88a8-408f-a90d-4fbe30ac9927 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:26.884930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 295/600] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:26.887053 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f50a9-88a8-408f-a90d-4fbe30ac9927 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:26.909510 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:26.966769 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766f362-3da3-4f25-9015-2e75f477d432 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:26.997308 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f50a9-88a8-408f-a90d-4fbe30ac9927 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:27.005272 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218be4f9-60f9-40ce-9e94-e59e9a8774de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:27.005607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218be4f9-60f9-40ce-9e94-e59e9a8774de None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:27.005889 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218be4f9-60f9-40ce-9e94-e59e9a8774de None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:27.006163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218be4f9-60f9-40ce-9e94-e59e9a8774de None admin] PATH_INFO: `/v3/projects/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:27.013979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218be4f9-60f9-40ce-9e94-e59e9a8774de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:27.015459 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218be4f9-60f9-40ce-9e94-e59e9a8774de None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:27.027305 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-218be4f9-60f9-40ce-9e94-e59e9a8774de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:27.027305 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:27.027305 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:27.027305 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:27.027305 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:27.027305 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:27.027305 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:27.027305 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:27.027305 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:27.027305 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:27.027305 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:27.027305 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:27.027305 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:56:27.027305 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:56:27.027305 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:56:27.028197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:56:27.028197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:27.028197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:27.028197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:27.028197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:27.028197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:27.028197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:27.028197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:27.028197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:27.028197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:27.028197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:27.028197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:27.028197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:27.028197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:27.028197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:27.028197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:27.028197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:27.029097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:56:27.029097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:56:27.029097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:56:27.029097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:56:27.029097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:56:27.029097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:56:27.029097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:27.029097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:27.029097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 306/601] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:27.029582 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218be4f9-60f9-40ce-9e94-e59e9a8774de None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:27.037501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d579e-c75b-40b3-8245-dfa911a53b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:27.038118 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d579e-c75b-40b3-8245-dfa911a53b29 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:27.038431 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d579e-c75b-40b3-8245-dfa911a53b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:27.038780 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d579e-c75b-40b3-8245-dfa911a53b29 None admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:27.039480 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d579e-c75b-40b3-8245-dfa911a53b29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:27.039788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d579e-c75b-40b3-8245-dfa911a53b29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:27.041232 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d579e-c75b-40b3-8245-dfa911a53b29 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:27.060044 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 296/602] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:56:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:27.060044 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bed381-020d-40d0-979c-ac08406b38ba None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:27.060044 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bed381-020d-40d0-979c-ac08406b38ba None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:27.060044 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bed381-020d-40d0-979c-ac08406b38ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:27.075160 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-f8bed381-020d-40d0-979c-ac08406b38ba None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:27.076299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-f8bed381-020d-40d0-979c-ac08406b38ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:27.094425 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:27.140009 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218be4f9-60f9-40ce-9e94-e59e9a8774de None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:27.150365 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 297/603] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:27.150365 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bed381-020d-40d0-979c-ac08406b38ba None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:27.164572 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:27.185120 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ebc1f-27f4-40b4-9bac-fc8a5e44385f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:27.185753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ebc1f-27f4-40b4-9bac-fc8a5e44385f None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:27.186037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ebc1f-27f4-40b4-9bac-fc8a5e44385f None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:27.186337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ebc1f-27f4-40b4-9bac-fc8a5e44385f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:27.193461 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ebc1f-27f4-40b4-9bac-fc8a5e44385f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:27.194952 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ebc1f-27f4-40b4-9bac-fc8a5e44385f None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:27.209877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-0d9ebc1f-27f4-40b4-9bac-fc8a5e44385f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:27.209877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:27.209877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:27.209877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:27.209877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:27.209877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:27.209877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:27.209877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:27.209877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:27.209877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:27.209877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:27.209877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:27.209877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:56:27.209877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:56:27.209877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:56:27.211037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:56:27.211037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:27.211037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:27.211037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:27.211037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:27.211037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:27.211037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:27.211037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:27.211037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:27.211037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:27.211037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:27.211037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:27.211037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:27.211037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:27.211037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:27.211037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:27.211037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:27.211979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:56:27.211979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:56:27.211979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:56:27.211979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:56:27.211979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:56:27.211979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:56:27.211979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:27.211979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:27.211979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 307/604] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:27.212476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ebc1f-27f4-40b4-9bac-fc8a5e44385f None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:27.280774 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bed381-020d-40d0-979c-ac08406b38ba None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:27.327192 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0487d-0ed4-4d70-be3d-7e64887be992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:27.328416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0487d-0ed4-4d70-be3d-7e64887be992 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:27.328947 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0487d-0ed4-4d70-be3d-7e64887be992 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:27.329403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0487d-0ed4-4d70-be3d-7e64887be992 None admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:27.329816 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ebc1f-27f4-40b4-9bac-fc8a5e44385f None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:27.330835 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0487d-0ed4-4d70-be3d-7e64887be992 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:27.331329 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0487d-0ed4-4d70-be3d-7e64887be992 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:27.333900 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0487d-0ed4-4d70-be3d-7e64887be992 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:27.345311 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:27.355889 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 298/605] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:56:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:27.357498 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0487d-0ed4-4d70-be3d-7e64887be992 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:27.370189 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997913f3-bb6b-45ea-8c58-44809bd64e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:27.370878 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997913f3-bb6b-45ea-8c58-44809bd64e37 None admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:27.371297 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997913f3-bb6b-45ea-8c58-44809bd64e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:27.371771 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997913f3-bb6b-45ea-8c58-44809bd64e37 None admin] PATH_INFO: `/v3/projects/a80ab70ab6b9415c98017d05512c33eb/users/4239cee14f954e95b4a6b0af2e8799b9/roles/e005fb4b59104519a433fc31da70f47e` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:27.390456 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997913f3-bb6b-45ea-8c58-44809bd64e37 None admin] RBAC: Authorizing `identity:create_grant(project_id=a80ab70ab6b9415c98017d05512c33eb, user_id=4239cee14f954e95b4a6b0af2e8799b9, role_id=e005fb4b59104519a433fc31da70f47e)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:27.392307 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997913f3-bb6b-45ea-8c58-44809bd64e37 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:27.435679 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:27.459311 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 308/606] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 23 07:56:27 2022] PUT /identity/v3/projects/a80ab70ab6b9415c98017d05512c33eb/users/4239cee14f954e95b4a6b0af2e8799b9/roles/e005fb4b59104519a433fc31da70f47e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:56:27.460284 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997913f3-bb6b-45ea-8c58-44809bd64e37 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:27.482248 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0487d-0ed4-4d70-be3d-7e64887be992 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:27.533704 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2020c0a-18ad-40ec-bf83-868a046e328a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:27.535407 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2020c0a-18ad-40ec-bf83-868a046e328a None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:27.535893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2020c0a-18ad-40ec-bf83-868a046e328a None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:27.536617 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2020c0a-18ad-40ec-bf83-868a046e328a None admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:27.537554 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2020c0a-18ad-40ec-bf83-868a046e328a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:27.538263 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2020c0a-18ad-40ec-bf83-868a046e328a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:27.540888 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2020c0a-18ad-40ec-bf83-868a046e328a None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:27.562454 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 299/607] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:56:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:27.563816 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2020c0a-18ad-40ec-bf83-868a046e328a None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:27.595406 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997913f3-bb6b-45ea-8c58-44809bd64e37 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:27.642561 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae7bb1-4e6e-4967-beeb-74eecc7ff2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:27.643340 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae7bb1-4e6e-4967-beeb-74eecc7ff2a5 None admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:27.643624 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae7bb1-4e6e-4967-beeb-74eecc7ff2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:27.643901 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae7bb1-4e6e-4967-beeb-74eecc7ff2a5 None admin] PATH_INFO: `/v3/projects/a80ab70ab6b9415c98017d05512c33eb/users/b5c55e5c1cea47f29d378ea457384a31/roles/e005fb4b59104519a433fc31da70f47e` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:27.666759 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae7bb1-4e6e-4967-beeb-74eecc7ff2a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a80ab70ab6b9415c98017d05512c33eb, user_id=b5c55e5c1cea47f29d378ea457384a31, role_id=e005fb4b59104519a433fc31da70f47e)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:27.668863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae7bb1-4e6e-4967-beeb-74eecc7ff2a5 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:27.694460 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2020c0a-18ad-40ec-bf83-868a046e328a None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:27.721840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:27.730581 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7df2e-679f-499f-b0bd-66f29a1e9bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:27.731211 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7df2e-679f-499f-b0bd-66f29a1e9bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:27.731605 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7df2e-679f-499f-b0bd-66f29a1e9bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:27.731891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7df2e-679f-499f-b0bd-66f29a1e9bf6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:27.741925 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a7df2e-679f-499f-b0bd-66f29a1e9bf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:27.747474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-b3a7df2e-679f-499f-b0bd-66f29a1e9bf6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:27.747474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:27.747474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:27.747474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:27.747474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:27.747474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:27.747474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:27.747474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:27.747474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:27.747474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:27.747474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:27.747474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:27.747474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:27.747474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:27.747474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:27.747474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:27.748402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:27.748402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:27.748402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:27.748402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:27.748402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:27.748402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:27.748402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:27.748402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:27.748402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:27.748402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:27.748402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:27.748402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:27.748402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:27.748402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:27.748402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:27.748402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:27.749253 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:27.749253 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:27.749253 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:27.749253 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:27.749253 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:27.749253 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:27.749253 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:27.749253 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:27.749253 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:27.749253 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:27.749253 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:27.749253 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:27.749253 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 300/608] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 23 07:56:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:27.749930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7df2e-679f-499f-b0bd-66f29a1e9bf6 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:27.771586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 309/609] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 23 07:56:27 2022] PUT /identity/v3/projects/a80ab70ab6b9415c98017d05512c33eb/users/b5c55e5c1cea47f29d378ea457384a31/roles/e005fb4b59104519a433fc31da70f47e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:56:27.772860 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad3a99-c498-4fb4-a3d6-a5cf491070cc None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:27.773137 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad3a99-c498-4fb4-a3d6-a5cf491070cc None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:27.773407 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad3a99-c498-4fb4-a3d6-a5cf491070cc None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:27.774946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 310/610] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:27.775480 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad3a99-c498-4fb4-a3d6-a5cf491070cc None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:27.793972 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:27.887515 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7df2e-679f-499f-b0bd-66f29a1e9bf6 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:27.922696 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad3a99-c498-4fb4-a3d6-a5cf491070cc None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:27.927634 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb968e8f-413a-4e01-8ddc-5760fca2b3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:27.928042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb968e8f-413a-4e01-8ddc-5760fca2b3bb None admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:27.929763 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb968e8f-413a-4e01-8ddc-5760fca2b3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:27.929763 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb968e8f-413a-4e01-8ddc-5760fca2b3bb None admin] PATH_INFO: `/v3/projects/a80ab70ab6b9415c98017d05512c33eb/users/8c3e2f6c4d8f4798a5fa271bb0b0154b/roles/e005fb4b59104519a433fc31da70f47e` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:27.949786 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb968e8f-413a-4e01-8ddc-5760fca2b3bb None admin] RBAC: Authorizing `identity:create_grant(project_id=a80ab70ab6b9415c98017d05512c33eb, user_id=8c3e2f6c4d8f4798a5fa271bb0b0154b, role_id=e005fb4b59104519a433fc31da70f47e)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:27.952011 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb968e8f-413a-4e01-8ddc-5760fca2b3bb None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:27.963981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb96dc3-b4d5-40da-a09c-6ede8c88ab4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:27.964669 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb96dc3-b4d5-40da-a09c-6ede8c88ab4e None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:27.965131 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb96dc3-b4d5-40da-a09c-6ede8c88ab4e None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:27.965406 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb96dc3-b4d5-40da-a09c-6ede8c88ab4e None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:27.966376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb96dc3-b4d5-40da-a09c-6ede8c88ab4e None admin] RBAC: Adding query filter params (name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:27.966680 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb96dc3-b4d5-40da-a09c-6ede8c88ab4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:27.972042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb96dc3-b4d5-40da-a09c-6ede8c88ab4e None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:27.980685 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 311/611] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 23 07:56:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:27.981715 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2699a99-4bbd-4805-b740-ad004f744ac5 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:27.981997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2699a99-4bbd-4805-b740-ad004f744ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:27.982276 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2699a99-4bbd-4805-b740-ad004f744ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:28.000883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-a2699a99-4bbd-4805-b740-ad004f744ac5 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:28.002180 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-a2699a99-4bbd-4805-b740-ad004f744ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:28.047933 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 301/612] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 23 07:56:27 2022] PUT /identity/v3/projects/a80ab70ab6b9415c98017d05512c33eb/users/8c3e2f6c4d8f4798a5fa271bb0b0154b/roles/e005fb4b59104519a433fc31da70f47e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:56:28.048782 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb968e8f-413a-4e01-8ddc-5760fca2b3bb None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:28.082557 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 312/613] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:28.166808 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:28.255076 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb968e8f-413a-4e01-8ddc-5760fca2b3bb None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:28.293940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce81ae-4573-417c-980e-666d1c60c19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:28.294974 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce81ae-4573-417c-980e-666d1c60c19d None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:28.295454 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce81ae-4573-417c-980e-666d1c60c19d None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:28.295947 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce81ae-4573-417c-980e-666d1c60c19d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:28.307073 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce81ae-4573-417c-980e-666d1c60c19d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:28.309080 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce81ae-4573-417c-980e-666d1c60c19d None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:28.324603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-74ce81ae-4573-417c-980e-666d1c60c19d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:28.324603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:28.324603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:28.324603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:28.324603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:28.324603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:28.324603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:28.324603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:28.324603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:28.324603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:28.324603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:28.324603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:28.324603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:28.324603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:28.324603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:28.324603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:28.325555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:28.325555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:28.325555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:28.325555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:28.325555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:28.325555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:28.325555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:28.325555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:28.325555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:28.325555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:28.325555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:28.325555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:28.325555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:28.325555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:28.325555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:28.325555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:28.325555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:28.326473 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:28.326473 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:28.326473 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:28.328688 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 302/614] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:28.334021 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2699a99-4bbd-4805-b740-ad004f744ac5 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:28.345314 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:28.367864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce81ae-4573-417c-980e-666d1c60c19d None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:28.483933 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:28.495215 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce81ae-4573-417c-980e-666d1c60c19d None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:28.508530 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2699a99-4bbd-4805-b740-ad004f744ac5 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:28.535586 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1984bb-c307-4980-ac0e-d039095febd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:28.536226 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1984bb-c307-4980-ac0e-d039095febd0 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:28.536508 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1984bb-c307-4980-ac0e-d039095febd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:28.537034 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1984bb-c307-4980-ac0e-d039095febd0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:28.548618 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1984bb-c307-4980-ac0e-d039095febd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:28.553840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-cf1984bb-c307-4980-ac0e-d039095febd0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:28.553840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:28.553840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:28.553840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:28.553840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:28.553840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:28.553840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:28.553840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:28.553840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:28.553840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:28.553840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:28.553840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:28.553840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:28.553840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:28.553840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:28.553840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:28.554798 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:28.554798 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:28.554798 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:28.554798 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:28.554798 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:28.554798 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:28.554798 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:28.554798 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:28.554798 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:28.554798 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:28.554798 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:28.554798 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:28.554798 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:28.554798 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:28.554798 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:28.554798 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:28.555651 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:28.555651 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:28.555651 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:28.555651 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:28.555651 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:28.555651 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:28.555651 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:28.555651 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:28.555651 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:28.555651 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:28.555651 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:28.555651 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:28.560737 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 303/615] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 23 07:56:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:28.561976 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1984bb-c307-4980-ac0e-d039095febd0 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:28.606569 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360501bd-5a44-431c-b9e4-0ac45741ffca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:28.607306 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360501bd-5a44-431c-b9e4-0ac45741ffca None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:28.607588 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360501bd-5a44-431c-b9e4-0ac45741ffca None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:28.607921 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360501bd-5a44-431c-b9e4-0ac45741ffca None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:28.608575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360501bd-5a44-431c-b9e4-0ac45741ffca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:28.608875 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360501bd-5a44-431c-b9e4-0ac45741ffca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:28.610418 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360501bd-5a44-431c-b9e4-0ac45741ffca None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:28.633686 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 313/616] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:28.639976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360501bd-5a44-431c-b9e4-0ac45741ffca None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:28.676071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1984bb-c307-4980-ac0e-d039095febd0 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:28.719456 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97f390-f2fb-425e-8a8b-93b64f20999b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:28.720084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97f390-f2fb-425e-8a8b-93b64f20999b None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:28.720363 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97f390-f2fb-425e-8a8b-93b64f20999b None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:28.720641 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97f390-f2fb-425e-8a8b-93b64f20999b None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:28.721713 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97f390-f2fb-425e-8a8b-93b64f20999b None admin] RBAC: Adding query filter params (name=service) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:28.722016 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97f390-f2fb-425e-8a8b-93b64f20999b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:28.723737 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97f390-f2fb-425e-8a8b-93b64f20999b None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:28.738391 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 304/617] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 23 07:56:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:56:28.739534 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97f390-f2fb-425e-8a8b-93b64f20999b None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:28.758677 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:28.808227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:28.857664 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360501bd-5a44-431c-b9e4-0ac45741ffca None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:28.860937 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97f390-f2fb-425e-8a8b-93b64f20999b None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:28.894711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ecf35-3a95-40f9-9041-a16adfe43011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:28.895346 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ecf35-3a95-40f9-9041-a16adfe43011 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:28.895622 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ecf35-3a95-40f9-9041-a16adfe43011 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:28.895888 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ecf35-3a95-40f9-9041-a16adfe43011 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:28.909613 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ecf35-3a95-40f9-9041-a16adfe43011 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:28.911096 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ecf35-3a95-40f9-9041-a16adfe43011 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:28.930533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-5c0ecf35-3a95-40f9-9041-a16adfe43011 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 07:56:28.930533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:28.930533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:28.930533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:28.930533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:28.930533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:28.930533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:28.930533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:28.930533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:28.930533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:28.930533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:28.930533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:28.930533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:56:28.930533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:56:28.930533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:56:28.930533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:56:28.931489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:28.931489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:28.931489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:56:28.931489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:28.931489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:56:28.931489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:28.931489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:28.931489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:28.931489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:28.931489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:28.931489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:28.931489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:28.931489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:28.931489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:28.931489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:28.931489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:28.931489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:28.931489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:28.932560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:28.932560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:28.932560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:56:28.932560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:56:28.932560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:56:28.932560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:56:28.932560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:56:28.932560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:56:28.932560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 07:56:28.932560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:28.932560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 314/618] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:56:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:28.937845 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646dd8e-7180-4d65-b466-ce2ab4b23c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:28.938579 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646dd8e-7180-4d65-b466-ce2ab4b23c1c None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:28.938920 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646dd8e-7180-4d65-b466-ce2ab4b23c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:28.939197 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646dd8e-7180-4d65-b466-ce2ab4b23c1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:28.940484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ecf35-3a95-40f9-9041-a16adfe43011 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:28.971273 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646dd8e-7180-4d65-b466-ce2ab4b23c1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:28.972777 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646dd8e-7180-4d65-b466-ce2ab4b23c1c None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:28.999238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-8646dd8e-7180-4d65-b466-ce2ab4b23c1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:28.999238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:28.999238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:28.999238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:28.999238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:28.999238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:28.999238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:28.999238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:28.999238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:28.999238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:28.999238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:28.999238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:28.999238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:28.999238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:28.999238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:28.999238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:29.000237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:29.000237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:29.000237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:29.000237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:29.000237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:29.000237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:29.000237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:29.000237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:29.000237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:29.000237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:29.000237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:29.000237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:29.000237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:29.000237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:29.000237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:29.000237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:29.000237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:29.001149 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:29.001149 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:29.001149 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:29.006793 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 305/619] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:29.007672 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646dd8e-7180-4d65-b466-ce2ab4b23c1c None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:29.092152 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ecf35-3a95-40f9-9041-a16adfe43011 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:29.094728 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:29.131978 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646dd8e-7180-4d65-b466-ce2ab4b23c1c None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:29.165579 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:29.167807 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe5dc1-b0db-497d-8579-c352eee2a5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:29.168651 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe5dc1-b0db-497d-8579-c352eee2a5d5 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:29.169154 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe5dc1-b0db-497d-8579-c352eee2a5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:29.169623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe5dc1-b0db-497d-8579-c352eee2a5d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:29.170551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe5dc1-b0db-497d-8579-c352eee2a5d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:29.171068 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe5dc1-b0db-497d-8579-c352eee2a5d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:29.172709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe5dc1-b0db-497d-8579-c352eee2a5d5 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:29.185914 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 306/620] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:29.193179 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe5dc1-b0db-497d-8579-c352eee2a5d5 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:29.193865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b28013-4328-42d5-b0f8-9fd79de9daca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:29.194650 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b28013-4328-42d5-b0f8-9fd79de9daca None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:29.194949 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b28013-4328-42d5-b0f8-9fd79de9daca None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:29.195226 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b28013-4328-42d5-b0f8-9fd79de9daca None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:29.195962 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b28013-4328-42d5-b0f8-9fd79de9daca None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:29.196268 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b28013-4328-42d5-b0f8-9fd79de9daca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:29.197771 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b28013-4328-42d5-b0f8-9fd79de9daca None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:29.217500 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 315/621] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Aug 23 07:56:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:29.222989 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b28013-4328-42d5-b0f8-9fd79de9daca None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:29.355720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b28013-4328-42d5-b0f8-9fd79de9daca None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:29.361533 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe5dc1-b0db-497d-8579-c352eee2a5d5 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:29.391091 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1432f-9d3c-42ba-8174-7cc4d914bb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:29.391710 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1432f-9d3c-42ba-8174-7cc4d914bb5a None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:29.391989 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1432f-9d3c-42ba-8174-7cc4d914bb5a None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:29.392261 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1432f-9d3c-42ba-8174-7cc4d914bb5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:29.402022 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:29.424755 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d0658-242f-4627-b8a7-0892158b9496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:29.425749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d0658-242f-4627-b8a7-0892158b9496 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:29.426258 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d0658-242f-4627-b8a7-0892158b9496 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:29.427059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d0658-242f-4627-b8a7-0892158b9496 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:29.446024 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d0658-242f-4627-b8a7-0892158b9496 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:29.447656 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:29.449446 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d0658-242f-4627-b8a7-0892158b9496 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:29.464640 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1432f-9d3c-42ba-8174-7cc4d914bb5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:29.466125 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1432f-9d3c-42ba-8174-7cc4d914bb5a None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:29.470635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-859d0658-242f-4627-b8a7-0892158b9496 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 07:56:29.470635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:29.470635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:29.470635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:29.470635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:29.470635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:29.470635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:29.470635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:29.470635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:29.470635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:29.470635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:29.470635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:29.470635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:56:29.470635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:56:29.470635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:56:29.470635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:56:29.471560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:29.471560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:29.471560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:56:29.471560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:29.471560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:56:29.471560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:29.471560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:29.471560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:29.471560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:29.471560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:29.471560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:29.471560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:29.471560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:29.471560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:29.471560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:29.471560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:29.471560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:29.471560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:29.472515 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:29.472515 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:29.472515 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:56:29.472515 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:56:29.472515 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:56:29.472515 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:56:29.472515 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:56:29.472515 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:56:29.472515 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 07:56:29.472515 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:29.480971 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 307/622] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:56:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:29.486939 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d0658-242f-4627-b8a7-0892158b9496 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:29.572420 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 316/623] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:56:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:56:29.579133 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1432f-9d3c-42ba-8174-7cc4d914bb5a None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:29.689660 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:29.704398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1432f-9d3c-42ba-8174-7cc4d914bb5a None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:29.743224 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07e14d-1e6b-4036-a53d-898f5c2dc993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:29.744031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07e14d-1e6b-4036-a53d-898f5c2dc993 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:29.744315 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07e14d-1e6b-4036-a53d-898f5c2dc993 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:29.744588 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07e14d-1e6b-4036-a53d-898f5c2dc993 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:29.756347 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07e14d-1e6b-4036-a53d-898f5c2dc993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:29.758031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07e14d-1e6b-4036-a53d-898f5c2dc993 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:29.766802 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d0658-242f-4627-b8a7-0892158b9496 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:29.778993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-ec07e14d-1e6b-4036-a53d-898f5c2dc993 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:29.778993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:29.778993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:29.778993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:29.778993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:29.778993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:29.778993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:29.778993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:29.778993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:29.778993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:29.778993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:29.778993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:29.778993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:29.778993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:29.778993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:29.778993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:29.779982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:29.779982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:29.779982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:29.779982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:29.779982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:29.779982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:29.779982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:29.779982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:29.779982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:29.779982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:29.779982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:29.779982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:29.779982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:29.779982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:29.779982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:29.779982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:29.779982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:29.780896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:29.780896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:29.780896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:29.780896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 317/624] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:29.786727 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07e14d-1e6b-4036-a53d-898f5c2dc993 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:29.843549 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a094a5-12e4-476a-9717-9d422d365e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:29.844402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a094a5-12e4-476a-9717-9d422d365e3c None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:29.844828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a094a5-12e4-476a-9717-9d422d365e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:29.845357 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a094a5-12e4-476a-9717-9d422d365e3c None admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:29.846391 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a094a5-12e4-476a-9717-9d422d365e3c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:29.846856 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a094a5-12e4-476a-9717-9d422d365e3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:29.848543 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a094a5-12e4-476a-9717-9d422d365e3c None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:29.869561 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 308/625] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Aug 23 07:56:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:56:29.871587 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc39ee-4af8-4d7d-afb7-2e956191f419 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:29.872495 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc39ee-4af8-4d7d-afb7-2e956191f419 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:29.873259 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc39ee-4af8-4d7d-afb7-2e956191f419 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:29.879316 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 309/626] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:29.880372 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc39ee-4af8-4d7d-afb7-2e956191f419 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:29.911589 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07e14d-1e6b-4036-a53d-898f5c2dc993 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:29.927838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:29.951429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b572b-ca31-4d3e-89bd-0e63f570e9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:29.952182 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b572b-ca31-4d3e-89bd-0e63f570e9ec None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:29.952465 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b572b-ca31-4d3e-89bd-0e63f570e9ec None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:29.952758 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b572b-ca31-4d3e-89bd-0e63f570e9ec None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:29.953399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b572b-ca31-4d3e-89bd-0e63f570e9ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:29.953803 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b572b-ca31-4d3e-89bd-0e63f570e9ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:29.955251 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b572b-ca31-4d3e-89bd-0e63f570e9ec None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:29.958354 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:29.973191 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 318/627] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:56:29.973191 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed3275-3a72-4064-8ccd-8a352af1c11c None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:29.973191 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed3275-3a72-4064-8ccd-8a352af1c11c None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:29.973191 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed3275-3a72-4064-8ccd-8a352af1c11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:29.989975 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-e7ed3275-3a72-4064-8ccd-8a352af1c11c None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:29.991189 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-e7ed3275-3a72-4064-8ccd-8a352af1c11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:29.992074 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc39ee-4af8-4d7d-afb7-2e956191f419 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:30.027237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0cc95-a9c3-4d7c-a2d9-11772d0b0f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:30.028653 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0cc95-a9c3-4d7c-a2d9-11772d0b0f2c None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:30.028954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0cc95-a9c3-4d7c-a2d9-11772d0b0f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:30.029233 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0cc95-a9c3-4d7c-a2d9-11772d0b0f2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:30.041455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0cc95-a9c3-4d7c-a2d9-11772d0b0f2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:30.043610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0cc95-a9c3-4d7c-a2d9-11772d0b0f2c None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:30.058337 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-5ce0cc95-a9c3-4d7c-a2d9-11772d0b0f2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:30.058337 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:30.058337 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:30.058337 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:30.058337 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:30.058337 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:30.058337 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:30.058337 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:30.058337 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:30.058337 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:30.058337 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:30.058337 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:30.058337 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:30.058337 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:30.058337 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:30.058337 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:30.059304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:30.059304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:30.059304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:30.059304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:30.059304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:30.059304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:30.059304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:30.059304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:30.059304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:30.059304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:30.059304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:30.059304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:30.059304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:30.059304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:30.059304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:30.059304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:30.059304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:30.060184 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:30.060184 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:30.060184 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:30.060184 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 310/628] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:30.060919 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d9c9a-914f-406f-adfe-32439d8da15a None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:30.060919 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d9c9a-914f-406f-adfe-32439d8da15a None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:30.061151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d9c9a-914f-406f-adfe-32439d8da15a None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:30.062503 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 311/629] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:30.063055 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d9c9a-914f-406f-adfe-32439d8da15a None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:30.070489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 319/630] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:30.071352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed3275-3a72-4064-8ccd-8a352af1c11c None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:30.179094 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed3275-3a72-4064-8ccd-8a352af1c11c None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:30.191238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:30.201227 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d9c9a-914f-406f-adfe-32439d8da15a None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:30.209383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:30.225494 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc0106-99a2-4874-b065-ff44af0d57c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:30.226337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc0106-99a2-4874-b065-ff44af0d57c1 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:30.226622 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc0106-99a2-4874-b065-ff44af0d57c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:30.226899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc0106-99a2-4874-b065-ff44af0d57c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:30.227539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc0106-99a2-4874-b065-ff44af0d57c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:30.227841 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc0106-99a2-4874-b065-ff44af0d57c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:30.229249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc0106-99a2-4874-b065-ff44af0d57c1 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:30.244947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 320/631] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:30.244947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a20b9-5500-49c8-afe0-c318beb66fcd None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:30.244947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a20b9-5500-49c8-afe0-c318beb66fcd None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:30.244947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a20b9-5500-49c8-afe0-c318beb66fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:30.262015 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff60123-a90f-4ec3-861f-758198a954ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:30.262356 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-a40a20b9-5500-49c8-afe0-c318beb66fcd None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:30.263189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff60123-a90f-4ec3-861f-758198a954ea None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:30.263630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-a40a20b9-5500-49c8-afe0-c318beb66fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:30.263903 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff60123-a90f-4ec3-861f-758198a954ea None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:30.264382 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff60123-a90f-4ec3-861f-758198a954ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:30.273973 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff60123-a90f-4ec3-861f-758198a954ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:30.276505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff60123-a90f-4ec3-861f-758198a954ea None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:30.293218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-fff60123-a90f-4ec3-861f-758198a954ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:30.293218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:30.293218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:30.293218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:30.293218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:30.293218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:30.293218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:30.293218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:30.293218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:30.293218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:30.293218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:30.293218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:30.293218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:56:30.293218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:56:30.293218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:56:30.294156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:56:30.294156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:30.294156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:30.294156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:30.294156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:30.294156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:30.294156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:30.294156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:30.294156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:30.294156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:30.294156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:30.294156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:30.294156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:30.294156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:30.294156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:30.294156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:30.294156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:30.295083 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:56:30.295083 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:56:30.295083 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:56:30.295083 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:56:30.295083 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:56:30.295083 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:56:30.295083 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:30.295083 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:30.300313 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 312/632] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:30.301224 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff60123-a90f-4ec3-861f-758198a954ea None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:30.348215 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 321/633] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:30.349378 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a20b9-5500-49c8-afe0-c318beb66fcd None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:30.415222 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff60123-a90f-4ec3-861f-758198a954ea None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:30.452135 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49408943-0b5c-4dc9-a066-3f3a2956657b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:30.452604 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49408943-0b5c-4dc9-a066-3f3a2956657b None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:30.452882 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49408943-0b5c-4dc9-a066-3f3a2956657b None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:30.453154 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49408943-0b5c-4dc9-a066-3f3a2956657b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:30.460360 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49408943-0b5c-4dc9-a066-3f3a2956657b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:30.461806 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49408943-0b5c-4dc9-a066-3f3a2956657b None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:30.474003 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-49408943-0b5c-4dc9-a066-3f3a2956657b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:30.474003 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:30.474003 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:30.474003 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:30.474003 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:30.474003 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:30.474003 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:30.474003 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:30.474003 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:30.474003 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:30.474003 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:30.474003 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:30.474003 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:56:30.474003 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:56:30.474003 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:56:30.474929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:56:30.474929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:30.474929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:30.474929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:30.474929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:30.474929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:30.474929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:30.474929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:30.474929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:30.474929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:30.474929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:30.474929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:30.474929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:30.474929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:30.474929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:30.474929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:30.474929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:30.475810 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:56:30.475810 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:56:30.475810 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:56:30.475810 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:56:30.475810 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:56:30.475810 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:56:30.475810 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:30.475810 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:30.478661 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 313/634] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:30.479634 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49408943-0b5c-4dc9-a066-3f3a2956657b None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:30.483766 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a20b9-5500-49c8-afe0-c318beb66fcd None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:30.499667 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:30.510183 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:30.531836 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a1232-13ef-4b48-99b2-4bb7d8c9e82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:30.532445 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a1232-13ef-4b48-99b2-4bb7d8c9e82d None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:30.532723 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a1232-13ef-4b48-99b2-4bb7d8c9e82d None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:30.533027 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a1232-13ef-4b48-99b2-4bb7d8c9e82d None admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:30.533681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a1232-13ef-4b48-99b2-4bb7d8c9e82d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:30.534060 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a1232-13ef-4b48-99b2-4bb7d8c9e82d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:30.535439 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a1232-13ef-4b48-99b2-4bb7d8c9e82d None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:30.547443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 322/635] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:56:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:30.548239 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a1232-13ef-4b48-99b2-4bb7d8c9e82d None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:30.596645 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49408943-0b5c-4dc9-a066-3f3a2956657b None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:30.631715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3e36d-9678-4598-bc29-da5f916278c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:30.632342 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3e36d-9678-4598-bc29-da5f916278c7 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:30.632623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3e36d-9678-4598-bc29-da5f916278c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:30.632896 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3e36d-9678-4598-bc29-da5f916278c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:30.643808 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3e36d-9678-4598-bc29-da5f916278c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:30.648976 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-bbd3e36d-9678-4598-bc29-da5f916278c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:30.648976 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:30.648976 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:30.648976 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:30.648976 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:30.648976 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:30.648976 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:30.648976 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:30.648976 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:30.648976 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:30.648976 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:30.648976 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:30.648976 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:30.648976 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:30.648976 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:30.648976 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:30.650098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:30.650098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:30.650098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:30.650098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:30.650098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:30.650098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:30.650098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:30.650098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:30.650098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:30.650098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:30.650098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:30.650098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:30.650098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:30.650098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:30.650098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:30.650098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:30.651056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:30.651056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:30.651056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:30.651056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:30.651056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:30.651056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:30.651056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:30.651056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:30.651056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:30.651056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:30.651056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:30.651056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:30.651056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 314/636] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 23 07:56:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:30.651767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95745506-a4aa-4e6a-a86f-71a08ad8e8c8 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:30.651767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95745506-a4aa-4e6a-a86f-71a08ad8e8c8 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:30.652031 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95745506-a4aa-4e6a-a86f-71a08ad8e8c8 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:30.653290 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 315/637] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:30.653849 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95745506-a4aa-4e6a-a86f-71a08ad8e8c8 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:30.662474 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a1232-13ef-4b48-99b2-4bb7d8c9e82d None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:30.695265 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92d8ba-32eb-4c39-bf68-5a896bc1f54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:30.695870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92d8ba-32eb-4c39-bf68-5a896bc1f54e None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:30.696145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92d8ba-32eb-4c39-bf68-5a896bc1f54e None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:30.696415 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92d8ba-32eb-4c39-bf68-5a896bc1f54e None admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:30.697089 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92d8ba-32eb-4c39-bf68-5a896bc1f54e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:30.697387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92d8ba-32eb-4c39-bf68-5a896bc1f54e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:30.699689 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92d8ba-32eb-4c39-bf68-5a896bc1f54e None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:30.711182 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 323/638] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:56:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:30.711897 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92d8ba-32eb-4c39-bf68-5a896bc1f54e None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:30.732566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:30.746465 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:30.757062 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95745506-a4aa-4e6a-a86f-71a08ad8e8c8 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:30.790620 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63690f9e-2bc0-4780-9358-70019092f0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:30.791216 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63690f9e-2bc0-4780-9358-70019092f0ea None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:30.791506 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63690f9e-2bc0-4780-9358-70019092f0ea None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:30.792274 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63690f9e-2bc0-4780-9358-70019092f0ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:30.792996 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63690f9e-2bc0-4780-9358-70019092f0ea None admin] RBAC: Adding query filter params (role.id=e005fb4b59104519a433fc31da70f47e, scope.project.id=a80ab70ab6b9415c98017d05512c33eb, user.id=2f4ee9c3c5be48699a24dfce9b30bda6) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:30.793298 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63690f9e-2bc0-4780-9358-70019092f0ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:30.794753 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63690f9e-2bc0-4780-9358-70019092f0ea None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:30.800561 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 316/639] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:56:30 2022] GET /identity/v3/role_assignments?user.id=2f4ee9c3c5be48699a24dfce9b30bda6&scope.project.id=a80ab70ab6b9415c98017d05512c33eb&role.id=e005fb4b59104519a433fc31da70f47e => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:30.801489 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a218a74-1d44-403c-98d1-7593cb0b560d None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:30.801774 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a218a74-1d44-403c-98d1-7593cb0b560d None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:30.802046 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a218a74-1d44-403c-98d1-7593cb0b560d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:30.809742 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92d8ba-32eb-4c39-bf68-5a896bc1f54e None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:30.824055 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-3a218a74-1d44-403c-98d1-7593cb0b560d None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:30.825438 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-3a218a74-1d44-403c-98d1-7593cb0b560d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:30.849534 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760ebfa-68a8-4de6-a468-87075e47f50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:30.850199 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760ebfa-68a8-4de6-a468-87075e47f50e None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:30.850515 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760ebfa-68a8-4de6-a468-87075e47f50e None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:30.850794 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760ebfa-68a8-4de6-a468-87075e47f50e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:30.863253 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760ebfa-68a8-4de6-a468-87075e47f50e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:30.869961 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-1760ebfa-68a8-4de6-a468-87075e47f50e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:30.869961 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:30.869961 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:30.869961 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:30.869961 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:30.869961 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:30.869961 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:30.869961 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:30.869961 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:30.869961 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:30.869961 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:30.869961 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:30.869961 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:30.869961 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:30.869961 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:30.869961 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:30.871109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:30.871109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:30.871109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:30.871109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:30.871109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:30.871109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:30.871109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:30.871109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:30.871109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:30.871109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:30.871109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:30.871109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:30.871109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:30.871109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:30.871109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:30.871109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:30.871984 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:30.871984 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:30.871984 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:30.871984 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:30.871984 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:30.871984 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:30.871984 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:30.871984 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:30.871984 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:30.871984 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:30.871984 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:30.871984 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:30.876931 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 324/640] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 23 07:56:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:30.877730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760ebfa-68a8-4de6-a468-87075e47f50e None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:30.909666 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 317/641] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:30.910624 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a218a74-1d44-403c-98d1-7593cb0b560d None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:31.011029 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:31.012083 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:31.018535 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760ebfa-68a8-4de6-a468-87075e47f50e None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:31.054921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a218a74-1d44-403c-98d1-7593cb0b560d None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:31.062870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc9bce-8b2b-478b-9ab2-ab1a75c1f45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:31.063794 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc9bce-8b2b-478b-9ab2-ab1a75c1f45d None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:31.064223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc9bce-8b2b-478b-9ab2-ab1a75c1f45d None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:31.064644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc9bce-8b2b-478b-9ab2-ab1a75c1f45d None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:31.074521 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc9bce-8b2b-478b-9ab2-ab1a75c1f45d None admin] RBAC: Adding query filter params (name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:31.074521 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc9bce-8b2b-478b-9ab2-ab1a75c1f45d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:31.074521 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc9bce-8b2b-478b-9ab2-ab1a75c1f45d None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:31.076191 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 325/642] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 23 07:56:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:31.077276 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc9bce-8b2b-478b-9ab2-ab1a75c1f45d None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:31.102400 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723939a6-0535-4148-b515-5180018f6e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:31.103166 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723939a6-0535-4148-b515-5180018f6e57 None admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:31.103525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723939a6-0535-4148-b515-5180018f6e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:31.103892 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723939a6-0535-4148-b515-5180018f6e57 None admin] PATH_INFO: `/v3/projects/a80ab70ab6b9415c98017d05512c33eb/users/4718cad0c0b9461d9c4152d7ea4b385d/roles/e005fb4b59104519a433fc31da70f47e` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:31.119363 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723939a6-0535-4148-b515-5180018f6e57 None admin] RBAC: Authorizing `identity:create_grant(project_id=a80ab70ab6b9415c98017d05512c33eb, user_id=4718cad0c0b9461d9c4152d7ea4b385d, role_id=e005fb4b59104519a433fc31da70f47e)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:31.121644 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723939a6-0535-4148-b515-5180018f6e57 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:31.194338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc9bce-8b2b-478b-9ab2-ab1a75c1f45d None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:31.224578 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 318/643] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 23 07:56:30 2022] PUT /identity/v3/projects/a80ab70ab6b9415c98017d05512c33eb/users/4718cad0c0b9461d9c4152d7ea4b385d/roles/e005fb4b59104519a433fc31da70f47e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:56:31.225715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723939a6-0535-4148-b515-5180018f6e57 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:31.238363 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0edea-bb28-4c77-ace3-d302861752f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:31.239005 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0edea-bb28-4c77-ace3-d302861752f9 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:31.239336 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0edea-bb28-4c77-ace3-d302861752f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:31.239617 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0edea-bb28-4c77-ace3-d302861752f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:31.240309 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0edea-bb28-4c77-ace3-d302861752f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:31.240613 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0edea-bb28-4c77-ace3-d302861752f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:31.242153 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0edea-bb28-4c77-ace3-d302861752f9 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:31.258480 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 326/644] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 23 07:56:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:31.259816 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0edea-bb28-4c77-ace3-d302861752f9 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:31.293784 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:31.369639 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723939a6-0535-4148-b515-5180018f6e57 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:31.397905 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0edea-bb28-4c77-ace3-d302861752f9 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:31.402720 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:31.420873 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c6434-2ea8-4700-8c19-6b0b728b5feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:31.421518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c6434-2ea8-4700-8c19-6b0b728b5feb None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:31.421794 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c6434-2ea8-4700-8c19-6b0b728b5feb None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:31.422071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c6434-2ea8-4700-8c19-6b0b728b5feb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:31.434655 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c6434-2ea8-4700-8c19-6b0b728b5feb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:31.436109 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c6434-2ea8-4700-8c19-6b0b728b5feb None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:31.445266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07db44-42a6-4e08-8f52-e3ddade572aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:31.446175 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07db44-42a6-4e08-8f52-e3ddade572aa None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:31.446659 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07db44-42a6-4e08-8f52-e3ddade572aa None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:31.447136 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07db44-42a6-4e08-8f52-e3ddade572aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:31.452257 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-a82c6434-2ea8-4700-8c19-6b0b728b5feb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:31.452257 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:31.452257 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:31.452257 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:31.452257 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:31.452257 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:31.452257 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:31.452257 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:31.452257 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:31.452257 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:31.452257 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:31.452257 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:31.452257 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:31.452257 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:31.452257 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:31.452257 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:31.459370 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:31.459370 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:31.459370 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:31.459370 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:31.459370 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:31.459370 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:31.459370 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:31.459370 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:31.459370 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:31.459370 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:31.459370 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:31.459370 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:31.459370 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:31.459370 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:31.459370 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:31.459370 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:31.459370 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:31.460348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:31.460348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:31.460348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:31.460348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 319/645] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:31.460348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c6434-2ea8-4700-8c19-6b0b728b5feb None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:31.462822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07db44-42a6-4e08-8f52-e3ddade572aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:31.469049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-ac07db44-42a6-4e08-8f52-e3ddade572aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:31.469049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:31.469049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:31.469049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:31.469049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:31.469049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:31.469049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:31.469049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:31.469049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:31.469049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:31.469049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:31.469049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:31.469049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:31.469049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:31.469049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:31.469049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:31.470205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:31.470205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:31.470205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:31.470205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:31.470205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:31.470205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:31.470205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:31.470205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:31.470205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:31.470205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:31.470205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:31.470205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:31.470205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:31.470205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:31.470205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:31.470205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:31.471405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:31.471405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:31.471405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:31.471405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:31.471405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:31.471405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:31.471405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:31.471405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:31.471405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:31.471405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:31.471405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:31.471405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:31.472700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 327/646] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 23 07:56:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:31.473537 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07db44-42a6-4e08-8f52-e3ddade572aa None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:31.579024 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:31.579642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c6434-2ea8-4700-8c19-6b0b728b5feb None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:31.607101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07db44-42a6-4e08-8f52-e3ddade572aa None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:31.616137 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822f6f8-3c5d-4931-8afe-9eddd0ea1138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:31.616852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822f6f8-3c5d-4931-8afe-9eddd0ea1138 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:31.617344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822f6f8-3c5d-4931-8afe-9eddd0ea1138 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:31.617565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822f6f8-3c5d-4931-8afe-9eddd0ea1138 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:31.628841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822f6f8-3c5d-4931-8afe-9eddd0ea1138 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:31.630911 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822f6f8-3c5d-4931-8afe-9eddd0ea1138 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:31.651401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-3822f6f8-3c5d-4931-8afe-9eddd0ea1138 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:31.651401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:31.651401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:31.651401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:31.651401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:31.651401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:31.651401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:31.651401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:31.651401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:31.651401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:31.651401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:31.651401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:31.651401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:31.651401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:31.651401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:31.651401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:31.652754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:31.652754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:31.652754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:31.652754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:31.652754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:31.652754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:31.652754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:31.652754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:31.652754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:31.652754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:31.652754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:31.652754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:31.652754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:31.652754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:31.652754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:31.652754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:31.652754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:31.653821 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:31.653821 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:31.653821 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:31.654741 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d5c71-aa2e-4331-b1a5-404292bdc2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:31.654864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 320/647] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:31.655700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d5c71-aa2e-4331-b1a5-404292bdc2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:31.655803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822f6f8-3c5d-4931-8afe-9eddd0ea1138 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:31.656368 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d5c71-aa2e-4331-b1a5-404292bdc2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:31.656837 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d5c71-aa2e-4331-b1a5-404292bdc2e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:31.657695 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d5c71-aa2e-4331-b1a5-404292bdc2e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:31.658174 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d5c71-aa2e-4331-b1a5-404292bdc2e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:31.661059 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d5c71-aa2e-4331-b1a5-404292bdc2e6 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:31.677000 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 328/648] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:31.678482 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d5c71-aa2e-4331-b1a5-404292bdc2e6 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:31.686771 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:31.771363 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822f6f8-3c5d-4931-8afe-9eddd0ea1138 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:31.816135 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366c9bb-44d1-45df-912f-8fe019bf6b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:31.816628 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d5c71-aa2e-4331-b1a5-404292bdc2e6 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:31.816908 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366c9bb-44d1-45df-912f-8fe019bf6b48 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:31.817270 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366c9bb-44d1-45df-912f-8fe019bf6b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:31.817606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366c9bb-44d1-45df-912f-8fe019bf6b48 None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:31.818355 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366c9bb-44d1-45df-912f-8fe019bf6b48 None admin] RBAC: Adding query filter params (name=service) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:31.818726 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366c9bb-44d1-45df-912f-8fe019bf6b48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:31.821162 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366c9bb-44d1-45df-912f-8fe019bf6b48 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:31.834514 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 321/649] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 23 07:56:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:31.835688 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366c9bb-44d1-45df-912f-8fe019bf6b48 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:31.865666 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f517ff-7985-41b3-afb8-fb0dbc5cf709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:31.866996 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f517ff-7985-41b3-afb8-fb0dbc5cf709 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:31.867278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f517ff-7985-41b3-afb8-fb0dbc5cf709 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:31.867550 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f517ff-7985-41b3-afb8-fb0dbc5cf709 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:31.868183 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f517ff-7985-41b3-afb8-fb0dbc5cf709 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:31.868480 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f517ff-7985-41b3-afb8-fb0dbc5cf709 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:31.870105 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f517ff-7985-41b3-afb8-fb0dbc5cf709 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:31.879459 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:31.883663 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 329/650] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:31.885017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f517ff-7985-41b3-afb8-fb0dbc5cf709 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:31.937321 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:31.954410 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366c9bb-44d1-45df-912f-8fe019bf6b48 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:31.991189 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f517ff-7985-41b3-afb8-fb0dbc5cf709 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:31.992671 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6aa8c-3089-4015-9552-caba0cf62bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:31.993531 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6aa8c-3089-4015-9552-caba0cf62bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:31.994015 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6aa8c-3089-4015-9552-caba0cf62bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:31.994533 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6aa8c-3089-4015-9552-caba0cf62bd6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:32.002276 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6aa8c-3089-4015-9552-caba0cf62bd6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:32.003988 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6aa8c-3089-4015-9552-caba0cf62bd6 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:32.016862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-1cb6aa8c-3089-4015-9552-caba0cf62bd6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 07:56:32.016862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:32.016862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:32.016862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:32.016862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:32.016862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:32.016862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:32.016862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:32.016862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:32.016862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:32.016862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:32.016862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:32.016862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:56:32.016862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:56:32.016862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:56:32.016862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:56:32.017818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:32.017818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:32.017818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:56:32.017818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:32.017818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:56:32.017818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:32.017818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:32.017818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:32.017818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:32.017818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:32.017818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:32.017818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:32.017818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:32.017818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:32.017818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:32.017818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:32.017818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:32.017818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:32.018768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:32.018768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:32.018768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:56:32.018768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:56:32.018768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:56:32.018768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:56:32.018768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:56:32.018768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:56:32.018768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 07:56:32.018768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:32.021573 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 322/651] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 23 07:56:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:32.022816 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6aa8c-3089-4015-9552-caba0cf62bd6 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:32.026689 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b429d-d381-40dc-9b16-ff3eb7fc3ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:32.027346 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b429d-d381-40dc-9b16-ff3eb7fc3ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:32.027627 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b429d-d381-40dc-9b16-ff3eb7fc3ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:32.027900 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b429d-d381-40dc-9b16-ff3eb7fc3ee6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:32.040063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b429d-d381-40dc-9b16-ff3eb7fc3ee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:32.041539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b429d-d381-40dc-9b16-ff3eb7fc3ee6 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:32.059433 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-624b429d-d381-40dc-9b16-ff3eb7fc3ee6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:32.059433 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:32.059433 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:32.059433 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:32.059433 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:32.059433 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:32.059433 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:32.059433 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:32.059433 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:32.059433 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:32.059433 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:32.059433 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:32.059433 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:32.059433 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:32.059433 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:32.059433 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:32.060426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:32.060426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:32.060426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:32.060426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:32.060426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:32.060426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:32.060426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:32.060426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:32.060426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:32.060426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:32.060426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:32.060426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:32.060426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:32.060426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:32.060426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:32.060426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:32.060426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:32.062599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:32.062599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:32.062599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:32.065568 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 330/652] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:32.066483 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b429d-d381-40dc-9b16-ff3eb7fc3ee6 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:32.120760 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:32.145195 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6aa8c-3089-4015-9552-caba0cf62bd6 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:32.173293 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b429d-d381-40dc-9b16-ff3eb7fc3ee6 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:32.187817 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d59d86-b2bd-4f68-9d42-cf8ca38f363d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:32.188452 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d59d86-b2bd-4f68-9d42-cf8ca38f363d None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:32.188732 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d59d86-b2bd-4f68-9d42-cf8ca38f363d None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:32.188998 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d59d86-b2bd-4f68-9d42-cf8ca38f363d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:32.198260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d59d86-b2bd-4f68-9d42-cf8ca38f363d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:32.200588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d59d86-b2bd-4f68-9d42-cf8ca38f363d None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:32.215126 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-b8d59d86-b2bd-4f68-9d42-cf8ca38f363d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:56:32.215126 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:32.215126 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:32.215126 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:32.215126 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:32.215126 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:32.215126 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:32.215126 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:32.215126 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:32.215126 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:32.215126 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:32.215126 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:32.215126 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:56:32.215126 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:56:32.215126 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:56:32.215126 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:56:32.216064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:32.216064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:32.216064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:56:32.216064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:32.216064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:56:32.216064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:32.216064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:32.216064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:32.216064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:32.216064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:32.216064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:32.216064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:32.216064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:32.216064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:32.216064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:32.216064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:32.216064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:32.216064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:32.217658 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:32.217658 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:32.217658 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:56:32.217658 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:56:32.217658 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:56:32.217658 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:56:32.217658 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:56:32.217658 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:56:32.217658 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:56:32.217658 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:32.217658 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 323/653] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Aug 23 07:56:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:32.217658 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d59d86-b2bd-4f68-9d42-cf8ca38f363d None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:32.218684 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d163c9-613a-4341-aa6b-3b66d6ba4c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:32.219566 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d163c9-613a-4341-aa6b-3b66d6ba4c1f None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:32.220323 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d163c9-613a-4341-aa6b-3b66d6ba4c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:32.221748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:32.222862 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d163c9-613a-4341-aa6b-3b66d6ba4c1f None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:32.223897 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d163c9-613a-4341-aa6b-3b66d6ba4c1f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:32.224413 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d163c9-613a-4341-aa6b-3b66d6ba4c1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:32.226031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d163c9-613a-4341-aa6b-3b66d6ba4c1f None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:32.251973 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 331/654] 10.222.0.57 () {56 vars in 1139 bytes} [Tue Aug 23 07:56:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:32.252779 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d163c9-613a-4341-aa6b-3b66d6ba4c1f None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:32.330076 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d59d86-b2bd-4f68-9d42-cf8ca38f363d None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:32.356164 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d163c9-613a-4341-aa6b-3b66d6ba4c1f None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:32.367560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:32.378164 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751384a-8a34-434f-b44c-558051589fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:32.378164 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751384a-8a34-434f-b44c-558051589fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:32.378164 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751384a-8a34-434f-b44c-558051589fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:32.378164 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751384a-8a34-434f-b44c-558051589fa8 None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:32.378692 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751384a-8a34-434f-b44c-558051589fa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:32.378692 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751384a-8a34-434f-b44c-558051589fa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:32.378692 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751384a-8a34-434f-b44c-558051589fa8 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:32.397495 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 324/655] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:32.397495 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751384a-8a34-434f-b44c-558051589fa8 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:32.399703 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efc365-6bcd-4f2c-8cb0-5d18458a0174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:32.400527 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efc365-6bcd-4f2c-8cb0-5d18458a0174 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:32.400983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efc365-6bcd-4f2c-8cb0-5d18458a0174 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:32.401423 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efc365-6bcd-4f2c-8cb0-5d18458a0174 None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:32.402332 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efc365-6bcd-4f2c-8cb0-5d18458a0174 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:32.402777 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efc365-6bcd-4f2c-8cb0-5d18458a0174 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:32.404558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efc365-6bcd-4f2c-8cb0-5d18458a0174 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:32.425639 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 332/656] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Aug 23 07:56:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:32.426835 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efc365-6bcd-4f2c-8cb0-5d18458a0174 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:32.484401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:32.536948 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efc365-6bcd-4f2c-8cb0-5d18458a0174 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:32.540008 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751384a-8a34-434f-b44c-558051589fa8 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:32.572753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106bb422-c579-4f69-a419-493615714033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:32.574404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bb422-c579-4f69-a419-493615714033 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:32.574688 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bb422-c579-4f69-a419-493615714033 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:32.574957 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bb422-c579-4f69-a419-493615714033 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:32.578183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f90b29-65dc-4c08-81cd-72241a79f2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:32.579037 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f90b29-65dc-4c08-81cd-72241a79f2e1 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:32.579518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f90b29-65dc-4c08-81cd-72241a79f2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:32.580005 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f90b29-65dc-4c08-81cd-72241a79f2e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:32.582527 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106bb422-c579-4f69-a419-493615714033 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:32.583952 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106bb422-c579-4f69-a419-493615714033 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:32.595757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-106bb422-c579-4f69-a419-493615714033 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 07:56:32.595757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:32.595757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:32.595757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:32.595757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:32.595757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:32.595757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:32.595757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:32.595757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:32.595757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:32.595757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:32.595757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:32.595757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:56:32.595757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:56:32.595757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:56:32.595757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:56:32.596743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:32.596743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:32.596743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:56:32.596743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:32.596743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:56:32.596743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:32.596743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:32.596743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:32.596743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:32.596743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:32.596743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:32.596743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:32.596743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:32.596743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:32.596743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:32.596743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:32.596743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:32.596743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:32.597687 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:32.597687 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:32.597687 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:56:32.597687 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:56:32.597687 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:56:32.597687 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:56:32.597687 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:56:32.597687 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:56:32.597687 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 07:56:32.597687 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:32.601695 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 333/657] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:56:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:32.602383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106bb422-c579-4f69-a419-493615714033 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:32.650950 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:32.672651 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f90b29-65dc-4c08-81cd-72241a79f2e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:32.674240 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f90b29-65dc-4c08-81cd-72241a79f2e1 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:32.734742 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106bb422-c579-4f69-a419-493615714033 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:32.756323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:32.772544 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55701c8a-e029-4be3-aae2-1ed87ddbdc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:32.773315 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55701c8a-e029-4be3-aae2-1ed87ddbdc66 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:32.773664 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55701c8a-e029-4be3-aae2-1ed87ddbdc66 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:32.774050 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55701c8a-e029-4be3-aae2-1ed87ddbdc66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:32.806162 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 325/658] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:56:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:56:32.807973 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f90b29-65dc-4c08-81cd-72241a79f2e1 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:32.861858 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55701c8a-e029-4be3-aae2-1ed87ddbdc66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:32.864415 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55701c8a-e029-4be3-aae2-1ed87ddbdc66 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:32.900741 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:32.920059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f90b29-65dc-4c08-81cd-72241a79f2e1 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:32.956033 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c1b6a-49e4-4ada-9229-a75a318e7be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:32.956635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c1b6a-49e4-4ada-9229-a75a318e7be4 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:32.956912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c1b6a-49e4-4ada-9229-a75a318e7be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:32.957185 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c1b6a-49e4-4ada-9229-a75a318e7be4 None admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:32.957895 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c1b6a-49e4-4ada-9229-a75a318e7be4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:32.958197 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c1b6a-49e4-4ada-9229-a75a318e7be4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:32.959647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c1b6a-49e4-4ada-9229-a75a318e7be4 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:32.982326 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 334/659] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:56:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:56:32.982326 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55701c8a-e029-4be3-aae2-1ed87ddbdc66 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:32.982598 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 326/660] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Aug 23 07:56:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:32.982598 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d2cd7-9402-43e8-bc63-49e9babcd345 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:32.982598 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d2cd7-9402-43e8-bc63-49e9babcd345 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:32.982598 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d2cd7-9402-43e8-bc63-49e9babcd345 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:32.982598 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 327/661] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:32.985876 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d2cd7-9402-43e8-bc63-49e9babcd345 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:33.011820 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:33.088461 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55701c8a-e029-4be3-aae2-1ed87ddbdc66 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:33.095984 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d2cd7-9402-43e8-bc63-49e9babcd345 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:33.115270 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:33.123351 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc91f96-eada-468f-9224-888494bc5f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:33.123990 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc91f96-eada-468f-9224-888494bc5f87 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:33.124313 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc91f96-eada-468f-9224-888494bc5f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:33.124589 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc91f96-eada-468f-9224-888494bc5f87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:33.134010 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a8131-e4fc-4b38-838a-774af67a49a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:33.134590 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc91f96-eada-468f-9224-888494bc5f87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:33.135178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a8131-e4fc-4b38-838a-774af67a49a8 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:33.136255 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a8131-e4fc-4b38-838a-774af67a49a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:33.136668 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc91f96-eada-468f-9224-888494bc5f87 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:33.136920 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a8131-e4fc-4b38-838a-774af67a49a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:33.148505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a8131-e4fc-4b38-838a-774af67a49a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:33.149963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a8131-e4fc-4b38-838a-774af67a49a8 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:33.153806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-8bc91f96-eada-468f-9224-888494bc5f87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:33.153806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:33.153806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:33.153806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:33.153806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:33.153806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:33.153806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:33.153806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:33.153806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:33.153806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:33.153806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:33.153806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:33.153806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:33.153806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:33.153806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:33.153806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:33.154792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:33.154792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:33.154792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:33.154792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:33.154792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:33.154792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:33.154792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:33.154792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:33.154792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:33.154792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:33.154792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:33.154792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:33.154792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:33.154792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:33.154792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:33.154792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:33.154792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:33.155768 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:33.155768 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:33.155768 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:33.157213 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 335/662] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:33.158750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a98b5-6094-4abe-921d-fa86c41a4978 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:33.159034 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a98b5-6094-4abe-921d-fa86c41a4978 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:33.159308 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a98b5-6094-4abe-921d-fa86c41a4978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:33.170448 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-eb8a8131-e4fc-4b38-838a-774af67a49a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:33.170448 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:33.170448 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:33.170448 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:33.170448 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:33.170448 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:33.170448 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:33.170448 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:33.170448 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:33.170448 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:33.170448 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:33.170448 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:33.170448 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:33.170448 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:33.170448 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:33.170448 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:33.171411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:33.171411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:33.171411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:33.171411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:33.171411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:33.171411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:33.171411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:33.171411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:33.171411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:33.171411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:33.171411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:33.171411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:33.171411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:33.171411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:33.171411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:33.171411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:33.171411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:33.172314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:33.172314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:33.172314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:33.176157 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 328/663] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:33.176995 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a8131-e4fc-4b38-838a-774af67a49a8 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:33.178521 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-ec1a98b5-6094-4abe-921d-fa86c41a4978 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:33.179768 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-ec1a98b5-6094-4abe-921d-fa86c41a4978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:33.258322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 336/664] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:33.258322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a98b5-6094-4abe-921d-fa86c41a4978 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:33.267126 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:33.297841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a8131-e4fc-4b38-838a-774af67a49a8 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:33.336154 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0c34c-1422-4bfa-b00a-9ccccda65cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:33.336833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0c34c-1422-4bfa-b00a-9ccccda65cbb None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:33.337113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0c34c-1422-4bfa-b00a-9ccccda65cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:33.337386 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0c34c-1422-4bfa-b00a-9ccccda65cbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:33.363084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a98b5-6094-4abe-921d-fa86c41a4978 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:33.376751 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:33.401072 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e47654-fc3b-4c2f-af76-cd06ca8b6964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:33.401855 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e47654-fc3b-4c2f-af76-cd06ca8b6964 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:33.402136 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e47654-fc3b-4c2f-af76-cd06ca8b6964 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:33.402470 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e47654-fc3b-4c2f-af76-cd06ca8b6964 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:33.403080 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e47654-fc3b-4c2f-af76-cd06ca8b6964 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:33.403379 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e47654-fc3b-4c2f-af76-cd06ca8b6964 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:33.404801 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e47654-fc3b-4c2f-af76-cd06ca8b6964 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:33.413806 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0c34c-1422-4bfa-b00a-9ccccda65cbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:33.415478 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0c34c-1422-4bfa-b00a-9ccccda65cbb None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:33.416295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 337/665] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:33.417615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e47654-fc3b-4c2f-af76-cd06ca8b6964 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:33.503020 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:33.527199 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e47654-fc3b-4c2f-af76-cd06ca8b6964 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:33.527716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 329/666] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:56:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:56:33.528969 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba460275-f632-4c90-b457-99b526038eed None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:33.529259 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba460275-f632-4c90-b457-99b526038eed None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:33.529535 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba460275-f632-4c90-b457-99b526038eed None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:33.531461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 330/667] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:33.532720 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba460275-f632-4c90-b457-99b526038eed None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:33.565954 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e63c31-b7c0-44dc-bee1-e3858f4ca293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:33.566594 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e63c31-b7c0-44dc-bee1-e3858f4ca293 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:33.566869 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e63c31-b7c0-44dc-bee1-e3858f4ca293 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:33.567146 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e63c31-b7c0-44dc-bee1-e3858f4ca293 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:33.567764 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e63c31-b7c0-44dc-bee1-e3858f4ca293 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:33.568060 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e63c31-b7c0-44dc-bee1-e3858f4ca293 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:33.569422 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e63c31-b7c0-44dc-bee1-e3858f4ca293 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:33.582210 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 338/668] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:33.583030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e63c31-b7c0-44dc-bee1-e3858f4ca293 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:33.612211 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:33.631848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba460275-f632-4c90-b457-99b526038eed None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:33.679817 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6ea37-2353-4581-830c-711a7be19199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:33.680370 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6ea37-2353-4581-830c-711a7be19199 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:33.680649 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6ea37-2353-4581-830c-711a7be19199 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:33.680925 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6ea37-2353-4581-830c-711a7be19199 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:33.685097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e63c31-b7c0-44dc-bee1-e3858f4ca293 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:33.688594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6ea37-2353-4581-830c-711a7be19199 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:33.690040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6ea37-2353-4581-830c-711a7be19199 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:33.701965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-cff6ea37-2353-4581-830c-711a7be19199 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:33.701965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:33.701965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:33.701965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:33.701965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:33.701965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:33.701965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:33.701965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:33.701965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:33.701965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:33.701965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:33.701965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:33.701965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:56:33.701965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:56:33.701965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:56:33.703019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:56:33.703019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:33.703019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:33.703019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:33.703019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:33.703019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:33.703019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:33.703019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:33.703019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:33.703019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:33.703019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:33.703019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:33.703019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:33.703019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:33.703019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:33.703019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:33.703019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:33.703926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:56:33.703926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:56:33.703926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:56:33.703926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:56:33.703926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:56:33.703926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:56:33.703926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:33.703926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:33.703926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 331/669] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:33.704418 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6ea37-2353-4581-830c-711a7be19199 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:33.725839 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b19ccf-30b0-47db-8160-a3b9c3aad457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:33.726595 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b19ccf-30b0-47db-8160-a3b9c3aad457 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:33.726878 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b19ccf-30b0-47db-8160-a3b9c3aad457 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:33.727147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b19ccf-30b0-47db-8160-a3b9c3aad457 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:33.737105 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:33.737616 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b19ccf-30b0-47db-8160-a3b9c3aad457 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:33.739107 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b19ccf-30b0-47db-8160-a3b9c3aad457 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:33.755081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-35b19ccf-30b0-47db-8160-a3b9c3aad457 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:33.755081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:33.755081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:33.755081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:33.755081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:33.755081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:33.755081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:33.755081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:33.755081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:33.755081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:33.755081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:33.755081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:33.755081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:33.755081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:33.755081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:33.755081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:33.756256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:33.756256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:33.756256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:33.756256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:33.756256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:33.756256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:33.756256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:33.756256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:33.756256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:33.756256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:33.756256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:33.756256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:33.756256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:33.756256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:33.756256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:33.756256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:33.756256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:33.757321 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:33.757321 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:33.757321 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:33.757321 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 339/670] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:33.757321 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd05a7d-b119-48b5-b6c8-6e48f80673a5 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:33.757901 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd05a7d-b119-48b5-b6c8-6e48f80673a5 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:33.757901 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd05a7d-b119-48b5-b6c8-6e48f80673a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:33.776635 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-8bd05a7d-b119-48b5-b6c8-6e48f80673a5 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:33.777817 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-8bd05a7d-b119-48b5-b6c8-6e48f80673a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:33.805573 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6ea37-2353-4581-830c-711a7be19199 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:33.843710 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e4059-6433-4537-ac14-9d5b1a0b7dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:33.844342 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e4059-6433-4537-ac14-9d5b1a0b7dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:33.844624 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e4059-6433-4537-ac14-9d5b1a0b7dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:33.844901 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e4059-6433-4537-ac14-9d5b1a0b7dd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:33.844988 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 340/671] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:33.845943 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd05a7d-b119-48b5-b6c8-6e48f80673a5 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:33.861983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:33.869372 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e4059-6433-4537-ac14-9d5b1a0b7dd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:33.876915 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e4059-6433-4537-ac14-9d5b1a0b7dd6 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:33.898982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-f31e4059-6433-4537-ac14-9d5b1a0b7dd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:33.898982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:33.898982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:33.898982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:33.898982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:33.898982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:33.898982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:33.898982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:33.898982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:33.898982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:33.898982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:33.898982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:33.898982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:33.898982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:33.898982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:33.898982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:33.899965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:33.899965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:33.899965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:33.899965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:33.899965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:33.899965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:33.899965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:33.899965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:33.899965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:33.899965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:33.899965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:33.899965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:33.899965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:33.899965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:33.899965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:33.899965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:33.899965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:33.906457 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:33.906457 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:33.906457 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:33.906457 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 332/672] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:33.906457 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e4059-6433-4537-ac14-9d5b1a0b7dd6 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:33.968970 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd05a7d-b119-48b5-b6c8-6e48f80673a5 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:34.016476 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:34.021602 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d101f-2553-43b7-a33c-2d4e3c5a79f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:34.022422 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d101f-2553-43b7-a33c-2d4e3c5a79f2 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:34.022706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d101f-2553-43b7-a33c-2d4e3c5a79f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:34.023038 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d101f-2553-43b7-a33c-2d4e3c5a79f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:34.033609 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d101f-2553-43b7-a33c-2d4e3c5a79f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:34.035491 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d101f-2553-43b7-a33c-2d4e3c5a79f2 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:34.036408 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e4059-6433-4537-ac14-9d5b1a0b7dd6 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:34.051360 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-df6d101f-2553-43b7-a33c-2d4e3c5a79f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:34.051360 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:34.051360 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:34.051360 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:34.051360 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:34.051360 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:34.051360 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:34.051360 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:34.051360 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:34.051360 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:34.051360 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:34.051360 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:34.051360 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:56:34.051360 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:56:34.051360 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:56:34.052337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:56:34.052337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:34.052337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:34.052337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:34.052337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:34.052337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:34.052337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:34.052337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:34.052337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:34.052337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:34.052337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:34.052337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:34.052337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:34.052337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:34.052337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:34.052337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:34.052337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:34.053215 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:56:34.053215 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:56:34.053215 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:56:34.053215 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:56:34.053215 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:56:34.053215 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:56:34.053215 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:34.053215 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:34.053630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 341/673] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:34.054395 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d101f-2553-43b7-a33c-2d4e3c5a79f2 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:34.083835 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3f0ec-2ca3-4866-b12f-40b988ac1de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:34.084581 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3f0ec-2ca3-4866-b12f-40b988ac1de0 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:34.084862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3f0ec-2ca3-4866-b12f-40b988ac1de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:34.085133 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3f0ec-2ca3-4866-b12f-40b988ac1de0 None admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:34.085987 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3f0ec-2ca3-4866-b12f-40b988ac1de0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:34.086645 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3f0ec-2ca3-4866-b12f-40b988ac1de0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:34.088400 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3f0ec-2ca3-4866-b12f-40b988ac1de0 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:34.108643 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 333/674] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:56:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:34.109550 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3f0ec-2ca3-4866-b12f-40b988ac1de0 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:34.139623 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:34.173817 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d101f-2553-43b7-a33c-2d4e3c5a79f2 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:34.212889 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3576e4c-9e89-4ba5-abf8-b6db51eddcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:34.234397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3576e4c-9e89-4ba5-abf8-b6db51eddcb1 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:34.234397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3576e4c-9e89-4ba5-abf8-b6db51eddcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:34.234397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3576e4c-9e89-4ba5-abf8-b6db51eddcb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:34.234677 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3f0ec-2ca3-4866-b12f-40b988ac1de0 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:34.234770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3576e4c-9e89-4ba5-abf8-b6db51eddcb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:34.234770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3576e4c-9e89-4ba5-abf8-b6db51eddcb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:34.234770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3576e4c-9e89-4ba5-abf8-b6db51eddcb1 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:34.234770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 342/675] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:34.234770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3576e4c-9e89-4ba5-abf8-b6db51eddcb1 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:34.254039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca4470-4609-42a8-a554-6c07564ff311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:34.254690 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca4470-4609-42a8-a554-6c07564ff311 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:34.255081 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca4470-4609-42a8-a554-6c07564ff311 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:34.255247 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca4470-4609-42a8-a554-6c07564ff311 None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:34.255919 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca4470-4609-42a8-a554-6c07564ff311 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:34.256240 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca4470-4609-42a8-a554-6c07564ff311 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:34.257612 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca4470-4609-42a8-a554-6c07564ff311 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:34.271303 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 334/676] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:34.272147 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca4470-4609-42a8-a554-6c07564ff311 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:34.280623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:34.342663 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3576e4c-9e89-4ba5-abf8-b6db51eddcb1 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:34.371208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:34.372329 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca4470-4609-42a8-a554-6c07564ff311 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:34.376987 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f7d22-21f7-4a85-a930-af0ca5e9cbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:34.377603 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f7d22-21f7-4a85-a930-af0ca5e9cbd3 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:34.377967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f7d22-21f7-4a85-a930-af0ca5e9cbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:34.378170 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f7d22-21f7-4a85-a930-af0ca5e9cbd3 None admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:34.378902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f7d22-21f7-4a85-a930-af0ca5e9cbd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:34.379212 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f7d22-21f7-4a85-a930-af0ca5e9cbd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:34.380720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f7d22-21f7-4a85-a930-af0ca5e9cbd3 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:34.394020 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 343/677] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:56:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:34.394946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f7d22-21f7-4a85-a930-af0ca5e9cbd3 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:34.408603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce77e16-514d-44f1-868d-908539ee6e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:34.409205 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce77e16-514d-44f1-868d-908539ee6e0e None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:34.409485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce77e16-514d-44f1-868d-908539ee6e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:34.409759 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce77e16-514d-44f1-868d-908539ee6e0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:34.410580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce77e16-514d-44f1-868d-908539ee6e0e None admin] RBAC: Adding query filter params (role.id=e005fb4b59104519a433fc31da70f47e, scope.project.id=a80ab70ab6b9415c98017d05512c33eb, user.id=4239cee14f954e95b4a6b0af2e8799b9) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:34.410889 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce77e16-514d-44f1-868d-908539ee6e0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:34.412358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce77e16-514d-44f1-868d-908539ee6e0e None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:34.430568 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 335/678] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:56:34 2022] GET /identity/v3/role_assignments?user.id=4239cee14f954e95b4a6b0af2e8799b9&scope.project.id=a80ab70ab6b9415c98017d05512c33eb&role.id=e005fb4b59104519a433fc31da70f47e => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:34.430568 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce77e16-514d-44f1-868d-908539ee6e0e None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:34.498232 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:34.510437 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f7d22-21f7-4a85-a930-af0ca5e9cbd3 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:34.538439 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce77e16-514d-44f1-868d-908539ee6e0e None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:34.552290 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048a5fa-fed6-4c82-8295-b8b41d265e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:34.553194 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048a5fa-fed6-4c82-8295-b8b41d265e41 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:34.553973 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048a5fa-fed6-4c82-8295-b8b41d265e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:34.554256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048a5fa-fed6-4c82-8295-b8b41d265e41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:34.566977 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048a5fa-fed6-4c82-8295-b8b41d265e41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:34.571704 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-e048a5fa-fed6-4c82-8295-b8b41d265e41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:34.571704 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:34.571704 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:34.571704 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:34.571704 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:34.571704 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:34.571704 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:34.571704 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:34.571704 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:34.571704 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:34.571704 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:34.571704 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:34.571704 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:34.571704 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:34.571704 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:34.571704 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:34.573401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:34.573401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:34.573401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:34.573401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:34.573401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:34.573401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:34.573401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:34.573401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:34.573401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:34.573401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:34.573401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:34.573401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:34.573401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:34.573401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:34.573401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:34.573401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:34.574798 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:34.574798 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:34.574798 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:34.574798 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:34.574798 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:34.574798 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:34.574798 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:34.574798 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:34.574798 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:34.574798 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:34.574798 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:34.574798 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:34.578772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 344/679] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 23 07:56:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:34.579650 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048a5fa-fed6-4c82-8295-b8b41d265e41 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:34.580287 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b992a4-e5da-4ec8-808f-b48c797e3c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:34.581226 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b992a4-e5da-4ec8-808f-b48c797e3c40 None admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:34.581226 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b992a4-e5da-4ec8-808f-b48c797e3c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:34.581520 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b992a4-e5da-4ec8-808f-b48c797e3c40 None admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:34.582131 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b992a4-e5da-4ec8-808f-b48c797e3c40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:34.584056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b992a4-e5da-4ec8-808f-b48c797e3c40 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:34.633829 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:34.671645 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 336/680] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 23 07:56:34 2022] POST /identity/v3/users => generated 254 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:56:34.671645 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b992a4-e5da-4ec8-808f-b48c797e3c40 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:34.695529 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048a5fa-fed6-4c82-8295-b8b41d265e41 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:34.743994 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e41d0c-11e5-41fa-ad15-4a748a6a9ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:34.744960 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e41d0c-11e5-41fa-ad15-4a748a6a9ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:34.745224 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e41d0c-11e5-41fa-ad15-4a748a6a9ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:34.745514 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e41d0c-11e5-41fa-ad15-4a748a6a9ae7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:34.755632 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e41d0c-11e5-41fa-ad15-4a748a6a9ae7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:34.757043 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e41d0c-11e5-41fa-ad15-4a748a6a9ae7 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:34.772717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-59e41d0c-11e5-41fa-ad15-4a748a6a9ae7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:34.772717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:34.772717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:34.772717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:34.772717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:34.772717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:34.772717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:34.772717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:34.772717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:34.772717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:34.772717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:34.772717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:34.772717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:56:34.772717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:56:34.772717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:56:34.773720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:56:34.773720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:34.773720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:34.773720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:34.773720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:34.773720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:34.773720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:34.773720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:34.773720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:34.773720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:34.773720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:34.773720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:34.773720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:34.773720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:34.773720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:34.773720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:34.773720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:34.774652 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:56:34.774652 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:56:34.774652 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:56:34.774652 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:56:34.774652 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:56:34.774652 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:56:34.774652 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:34.774652 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:34.779264 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 345/681] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:34.780789 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e41d0c-11e5-41fa-ad15-4a748a6a9ae7 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:34.817402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b992a4-e5da-4ec8-808f-b48c797e3c40 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:34.857892 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:34.867185 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4a907-1205-4bb5-82ce-2c432df957ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:34.867803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4a907-1205-4bb5-82ce-2c432df957ba None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:34.868094 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4a907-1205-4bb5-82ce-2c432df957ba None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:34.868444 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4a907-1205-4bb5-82ce-2c432df957ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:34.869196 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4a907-1205-4bb5-82ce-2c432df957ba None admin] RBAC: Adding query filter params (role.id=e005fb4b59104519a433fc31da70f47e, scope.project.id=a80ab70ab6b9415c98017d05512c33eb, user.id=b5c55e5c1cea47f29d378ea457384a31) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:34.869508 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4a907-1205-4bb5-82ce-2c432df957ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:34.871400 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4a907-1205-4bb5-82ce-2c432df957ba None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:34.880233 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 337/682] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:56:34 2022] GET /identity/v3/role_assignments?user.id=b5c55e5c1cea47f29d378ea457384a31&scope.project.id=a80ab70ab6b9415c98017d05512c33eb&role.id=e005fb4b59104519a433fc31da70f47e => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:34.881396 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4a907-1205-4bb5-82ce-2c432df957ba None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:34.937338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e41d0c-11e5-41fa-ad15-4a748a6a9ae7 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:34.964843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:35.015627 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab8dad-23c4-4d36-b532-22bfa31a3786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:35.016512 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab8dad-23c4-4d36-b532-22bfa31a3786 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:35.016958 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab8dad-23c4-4d36-b532-22bfa31a3786 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:35.017384 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab8dad-23c4-4d36-b532-22bfa31a3786 None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:35.018679 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaab8dad-23c4-4d36-b532-22bfa31a3786 None admin] RBAC: Adding query filter params (name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:35.019973 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaab8dad-23c4-4d36-b532-22bfa31a3786 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:35.022533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaab8dad-23c4-4d36-b532-22bfa31a3786 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:35.036803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4a907-1205-4bb5-82ce-2c432df957ba None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:35.040650 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 346/683] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 23 07:56:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:35.051570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab8dad-23c4-4d36-b532-22bfa31a3786 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:35.078963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bf60d-0c45-4e2f-a081-528d617385cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:35.080494 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bf60d-0c45-4e2f-a081-528d617385cc None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:35.080725 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bf60d-0c45-4e2f-a081-528d617385cc None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:35.080998 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bf60d-0c45-4e2f-a081-528d617385cc None admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:35.081681 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00bf60d-0c45-4e2f-a081-528d617385cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:35.081982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00bf60d-0c45-4e2f-a081-528d617385cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:35.083441 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00bf60d-0c45-4e2f-a081-528d617385cc None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:35.097442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 338/684] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:56:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:35.103472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bf60d-0c45-4e2f-a081-528d617385cc None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:35.160378 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:35.180118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab8dad-23c4-4d36-b532-22bfa31a3786 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:35.214688 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bf60d-0c45-4e2f-a081-528d617385cc None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:35.217820 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a807693-7726-4928-9656-95ebdc465f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:35.218712 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a807693-7726-4928-9656-95ebdc465f70 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:35.219181 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a807693-7726-4928-9656-95ebdc465f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:35.219610 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a807693-7726-4928-9656-95ebdc465f70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:35.232240 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a807693-7726-4928-9656-95ebdc465f70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:35.233690 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a807693-7726-4928-9656-95ebdc465f70 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:35.250362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-9a807693-7726-4928-9656-95ebdc465f70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:35.250362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:35.250362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:35.250362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:35.250362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:35.250362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:35.250362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:35.250362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:35.250362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:35.250362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:35.250362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:35.250362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:35.250362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:35.250362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:35.250362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:35.250362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:35.251370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:35.251370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:35.251370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:35.251370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:35.251370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:35.251370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:35.251370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:35.251370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:35.251370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:35.251370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:35.251370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:35.251370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:35.251370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:35.251370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:35.251370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:35.251370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:35.251370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:35.252293 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:35.252293 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:35.252293 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:35.252293 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 347/685] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:35.257002 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc9a76-abd9-4c2b-8450-d632e092a1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:35.257303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a807693-7726-4928-9656-95ebdc465f70 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:35.257919 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc9a76-abd9-4c2b-8450-d632e092a1ab None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:35.258310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc9a76-abd9-4c2b-8450-d632e092a1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:35.258713 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc9a76-abd9-4c2b-8450-d632e092a1ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:35.259529 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc9a76-abd9-4c2b-8450-d632e092a1ab None admin] RBAC: Adding query filter params (role.id=e005fb4b59104519a433fc31da70f47e, scope.project.id=a80ab70ab6b9415c98017d05512c33eb, user.id=8c3e2f6c4d8f4798a5fa271bb0b0154b) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:35.259933 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc9a76-abd9-4c2b-8450-d632e092a1ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:35.261516 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc9a76-abd9-4c2b-8450-d632e092a1ab None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:35.269746 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 339/686] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:56:35 2022] GET /identity/v3/role_assignments?user.id=8c3e2f6c4d8f4798a5fa271bb0b0154b&scope.project.id=a80ab70ab6b9415c98017d05512c33eb&role.id=e005fb4b59104519a433fc31da70f47e => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:35.295571 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:35.382769 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a807693-7726-4928-9656-95ebdc465f70 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:35.426553 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ae48c-e198-46ca-a427-cf74156cc220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:35.427309 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ae48c-e198-46ca-a427-cf74156cc220 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:35.427627 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ae48c-e198-46ca-a427-cf74156cc220 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:35.427984 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ae48c-e198-46ca-a427-cf74156cc220 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:35.428655 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ae48c-e198-46ca-a427-cf74156cc220 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:35.428957 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ae48c-e198-46ca-a427-cf74156cc220 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:35.430856 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ae48c-e198-46ca-a427-cf74156cc220 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:35.448518 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 348/687] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:56:35.453438 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc9a76-abd9-4c2b-8450-d632e092a1ab None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:35.562007 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc9a76-abd9-4c2b-8450-d632e092a1ab None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:35.576569 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:35.597863 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c6d62-ca7c-4069-b37c-1158207fe7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:35.598795 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c6d62-ca7c-4069-b37c-1158207fe7b0 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:35.599226 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c6d62-ca7c-4069-b37c-1158207fe7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:35.599662 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c6d62-ca7c-4069-b37c-1158207fe7b0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:35.608651 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c6d62-ca7c-4069-b37c-1158207fe7b0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:35.610416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c6d62-ca7c-4069-b37c-1158207fe7b0 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:35.623260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-251c6d62-ca7c-4069-b37c-1158207fe7b0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 07:56:35.623260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:35.623260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:35.623260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:35.623260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:35.623260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:35.623260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:35.623260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:35.623260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:35.623260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:35.623260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:35.623260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:35.623260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:56:35.623260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:56:35.623260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:56:35.623260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:56:35.624461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:35.624461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:35.624461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:56:35.624461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:35.624461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:56:35.624461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:35.624461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:35.624461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:35.624461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:35.624461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:35.624461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:35.624461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:35.624461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:35.624461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:35.624461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:35.624461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:35.624461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:35.624461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:35.625632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:35.625632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:35.625632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:56:35.625632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:56:35.625632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:56:35.625632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:56:35.625632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:56:35.625632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:56:35.625632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 07:56:35.625632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:35.631678 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 340/688] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:56:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:35.633801 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ae48c-e198-46ca-a427-cf74156cc220 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:35.776511 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:35.795915 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ae48c-e198-46ca-a427-cf74156cc220 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:35.852501 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18b0b0-62f3-4d65-be91-206d66ab1aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:35.853497 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18b0b0-62f3-4d65-be91-206d66ab1aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:35.854044 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18b0b0-62f3-4d65-be91-206d66ab1aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:35.854541 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18b0b0-62f3-4d65-be91-206d66ab1aa6 None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:35.855482 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18b0b0-62f3-4d65-be91-206d66ab1aa6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:35.856005 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18b0b0-62f3-4d65-be91-206d66ab1aa6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:35.857665 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18b0b0-62f3-4d65-be91-206d66ab1aa6 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:35.883401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 349/689] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Aug 23 07:56:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:35.891384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c6d62-ca7c-4069-b37c-1158207fe7b0 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:36.171621 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c6d62-ca7c-4069-b37c-1158207fe7b0 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:36.206933 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8559b-0560-43f1-9ebd-454b6494276e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:36.207554 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8559b-0560-43f1-9ebd-454b6494276e None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:36.207832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8559b-0560-43f1-9ebd-454b6494276e None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:36.208104 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8559b-0560-43f1-9ebd-454b6494276e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:36.255329 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:36.278693 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8559b-0560-43f1-9ebd-454b6494276e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:36.280211 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8559b-0560-43f1-9ebd-454b6494276e None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:36.390438 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 341/690] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:56:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:56:36.394846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18b0b0-62f3-4d65-be91-206d66ab1aa6 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:36.572151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18b0b0-62f3-4d65-be91-206d66ab1aa6 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:36.620088 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c871ff0-c633-4597-a792-f5224d1fb68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:36.621357 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c871ff0-c633-4597-a792-f5224d1fb68d None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:36.621647 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c871ff0-c633-4597-a792-f5224d1fb68d None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:36.621929 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c871ff0-c633-4597-a792-f5224d1fb68d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:36.635902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c871ff0-c633-4597-a792-f5224d1fb68d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:36.637715 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c871ff0-c633-4597-a792-f5224d1fb68d None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:36.649764 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:36.672383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-4c871ff0-c633-4597-a792-f5224d1fb68d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:36.672383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:36.672383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:36.672383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:36.672383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:36.672383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:36.672383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:36.672383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:36.672383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:36.672383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:36.672383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:36.672383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:36.672383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:36.672383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:36.672383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:36.672383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:36.673405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:36.673405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:36.673405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:36.673405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:36.673405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:36.673405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:36.673405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:36.673405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:36.673405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:36.673405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:36.673405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:36.673405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:36.673405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:36.673405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:36.673405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:36.673405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:36.673405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:36.674341 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:36.674341 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:36.674341 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:36.675049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 350/691] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:36.679659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8559b-0560-43f1-9ebd-454b6494276e None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:36.771232 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa4461-09b7-4191-a6a0-c87627e8cefa None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:36.771858 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa4461-09b7-4191-a6a0-c87627e8cefa None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:36.772359 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa4461-09b7-4191-a6a0-c87627e8cefa None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:36.774142 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 351/692] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:36.778646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:36.780250 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c95404-d057-4568-9629-e6a8b9a6eabc None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:36.781078 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c95404-d057-4568-9629-e6a8b9a6eabc None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:36.781574 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c95404-d057-4568-9629-e6a8b9a6eabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:36.802679 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8559b-0560-43f1-9ebd-454b6494276e None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:36.831391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-61c95404-d057-4568-9629-e6a8b9a6eabc None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:36.833005 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-61c95404-d057-4568-9629-e6a8b9a6eabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:36.838248 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7ee34-c3b6-4886-af2b-3d5df7de3763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:36.839643 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7ee34-c3b6-4886-af2b-3d5df7de3763 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:36.839938 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7ee34-c3b6-4886-af2b-3d5df7de3763 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:36.840220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7ee34-c3b6-4886-af2b-3d5df7de3763 None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:36.850329 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7ee34-c3b6-4886-af2b-3d5df7de3763 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:36.850329 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7ee34-c3b6-4886-af2b-3d5df7de3763 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:36.850329 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7ee34-c3b6-4886-af2b-3d5df7de3763 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:36.859836 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 342/693] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:36.861455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7ee34-c3b6-4886-af2b-3d5df7de3763 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:36.953244 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 352/694] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:56:36.954548 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee4564-0dd9-405d-8bee-026db545282d None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:36.954835 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee4564-0dd9-405d-8bee-026db545282d None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:36.955106 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee4564-0dd9-405d-8bee-026db545282d None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:36.960580 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 353/695] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:36.967381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80565f28-c7b5-483e-a7ce-875b0c511277 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:36.967670 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80565f28-c7b5-483e-a7ce-875b0c511277 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:36.967933 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80565f28-c7b5-483e-a7ce-875b0c511277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:36.968981 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7ee34-c3b6-4886-af2b-3d5df7de3763 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:37.003133 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-80565f28-c7b5-483e-a7ce-875b0c511277 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:37.004637 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-80565f28-c7b5-483e-a7ce-875b0c511277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:37.004981 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067121b-bdbc-403d-8af8-289d3646f577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:37.005678 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067121b-bdbc-403d-8af8-289d3646f577 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:37.005965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067121b-bdbc-403d-8af8-289d3646f577 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:37.006240 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067121b-bdbc-403d-8af8-289d3646f577 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:37.009032 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:37.014768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067121b-bdbc-403d-8af8-289d3646f577 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:37.016289 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067121b-bdbc-403d-8af8-289d3646f577 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:37.031711 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-5067121b-bdbc-403d-8af8-289d3646f577 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:37.031711 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:37.031711 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:37.031711 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:37.031711 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:37.031711 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:37.031711 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:37.031711 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:37.031711 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:37.031711 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:37.031711 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:37.031711 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:37.031711 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:56:37.031711 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:56:37.031711 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:56:37.032647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:56:37.032647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:37.032647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:37.032647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:37.032647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:37.032647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:37.032647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:37.032647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:37.032647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:37.032647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:37.032647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:37.032647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:37.032647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:37.032647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:37.032647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:37.032647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:37.032647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:37.033526 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:56:37.033526 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:56:37.033526 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:56:37.033526 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:56:37.033526 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:56:37.033526 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:56:37.033526 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:37.033526 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:37.037698 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 343/696] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:37.039012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067121b-bdbc-403d-8af8-289d3646f577 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:37.148052 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067121b-bdbc-403d-8af8-289d3646f577 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:37.158534 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 354/697] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:37.202223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db28b3-caa3-46d9-b570-51dba9f0f908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:37.202938 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db28b3-caa3-46d9-b570-51dba9f0f908 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:37.203215 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db28b3-caa3-46d9-b570-51dba9f0f908 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:37.203488 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db28b3-caa3-46d9-b570-51dba9f0f908 None admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:37.204181 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db28b3-caa3-46d9-b570-51dba9f0f908 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:37.204487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db28b3-caa3-46d9-b570-51dba9f0f908 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:37.205921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db28b3-caa3-46d9-b570-51dba9f0f908 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:37.225817 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 344/698] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:56:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:37.232839 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80565f28-c7b5-483e-a7ce-875b0c511277 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:37.258761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db28b3-caa3-46d9-b570-51dba9f0f908 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:37.306701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:37.355668 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80565f28-c7b5-483e-a7ce-875b0c511277 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:37.394856 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22243530-c048-47d7-858d-fd7b5f22a339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:37.396310 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22243530-c048-47d7-858d-fd7b5f22a339 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:37.396777 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22243530-c048-47d7-858d-fd7b5f22a339 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:37.397208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22243530-c048-47d7-858d-fd7b5f22a339 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:37.398150 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22243530-c048-47d7-858d-fd7b5f22a339 None admin] RBAC: Adding query filter params (role.id=e005fb4b59104519a433fc31da70f47e, scope.project.id=a80ab70ab6b9415c98017d05512c33eb, user.id=4718cad0c0b9461d9c4152d7ea4b385d) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:37.398641 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22243530-c048-47d7-858d-fd7b5f22a339 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:37.400494 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22243530-c048-47d7-858d-fd7b5f22a339 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:37.402223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:37.419886 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 355/699] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:56:37 2022] GET /identity/v3/role_assignments?user.id=4718cad0c0b9461d9c4152d7ea4b385d&scope.project.id=a80ab70ab6b9415c98017d05512c33eb&role.id=e005fb4b59104519a433fc31da70f47e => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:37.453410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22243530-c048-47d7-858d-fd7b5f22a339 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:37.493382 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db28b3-caa3-46d9-b570-51dba9f0f908 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:37.553861 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583a716-b3a6-4e86-81db-93ed50faa978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:37.554558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583a716-b3a6-4e86-81db-93ed50faa978 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:37.554844 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583a716-b3a6-4e86-81db-93ed50faa978 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:37.555117 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583a716-b3a6-4e86-81db-93ed50faa978 None admin] PATH_INFO: `/v3/services/network` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:37.555709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583a716-b3a6-4e86-81db-93ed50faa978 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:37.557177 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583a716-b3a6-4e86-81db-93ed50faa978 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:37.578260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-6583a716-b3a6-4e86-81db-93ed50faa978 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 07:56:37.578260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:37.578260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:56:37.578260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:56:37.578260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:56:37.578260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:56:37.578260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:56:37.578260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:56:37.578260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 07:56:37.578260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:37.578260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:56:37.578260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:37.578260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:37.578260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:37.578260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:37.578260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:37.578260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:37.579384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:37.579384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:37.579384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:37.579384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:37.579384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:37.579384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:37.579384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:56:37.579384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:56:37.579384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:56:37.579384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:56:37.579384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:37.579384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:37.579384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:37.579384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:37.579384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:37.579384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:37.580242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:37.580242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:37.580242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:37.580242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:37.580242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:37.580242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:37.580242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:37.580242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:37.580242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:37.580242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:37.580242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:56:37.580242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:56:37.580242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 07:56:37.580242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:37.580242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 345/700] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:37 2022] GET /identity/v3/services/network => generated 88 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:37.585510 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583a716-b3a6-4e86-81db-93ed50faa978 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:37.603482 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22243530-c048-47d7-858d-fd7b5f22a339 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:37.645654 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:37.649466 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617fa99-de75-483d-b6de-c8c7148f8de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:37.650057 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617fa99-de75-483d-b6de-c8c7148f8de0 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:37.650057 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617fa99-de75-483d-b6de-c8c7148f8de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:37.650398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617fa99-de75-483d-b6de-c8c7148f8de0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:37.662562 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617fa99-de75-483d-b6de-c8c7148f8de0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:37.668681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-d617fa99-de75-483d-b6de-c8c7148f8de0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:37.668681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:37.668681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:37.668681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:37.668681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:37.668681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:37.668681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:37.668681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:37.668681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:37.668681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:37.668681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:37.668681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:37.668681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:37.668681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:37.668681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:37.668681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:37.669626 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:37.669626 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:37.669626 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:37.669626 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:37.669626 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:37.669626 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:37.669626 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:37.669626 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:37.669626 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:37.669626 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:37.669626 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:37.669626 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:37.669626 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:37.669626 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:37.669626 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:37.669626 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:37.671424 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:37.671424 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:37.671424 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:37.671424 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:37.671424 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:37.671424 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:37.671424 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:37.671424 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:37.671424 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:37.671424 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:37.671424 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:37.671424 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:37.671424 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 356/701] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 23 07:56:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:37.677354 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617fa99-de75-483d-b6de-c8c7148f8de0 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:37.764105 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583a716-b3a6-4e86-81db-93ed50faa978 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:37.793991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:37.814893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1116a0d-445a-4082-83cd-836b0ecbb8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:37.815808 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1116a0d-445a-4082-83cd-836b0ecbb8ea None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:37.816189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1116a0d-445a-4082-83cd-836b0ecbb8ea None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:37.816475 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1116a0d-445a-4082-83cd-836b0ecbb8ea None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:37.817112 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1116a0d-445a-4082-83cd-836b0ecbb8ea None admin] RBAC: Adding query filter params (name=network) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:37.817416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1116a0d-445a-4082-83cd-836b0ecbb8ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:37.819367 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1116a0d-445a-4082-83cd-836b0ecbb8ea None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:37.827104 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 346/702] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 23 07:56:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:37.828859 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ef883-eb54-4409-a09e-c96076cf7918 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:37.829168 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ef883-eb54-4409-a09e-c96076cf7918 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:37.829702 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ef883-eb54-4409-a09e-c96076cf7918 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:37.831269 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 347/703] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:37.831447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617fa99-de75-483d-b6de-c8c7148f8de0 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:37.834608 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ef883-eb54-4409-a09e-c96076cf7918 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:37.869128 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de864ea-8200-4d15-9e57-adb06885e791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:37.870497 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de864ea-8200-4d15-9e57-adb06885e791 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:37.870777 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de864ea-8200-4d15-9e57-adb06885e791 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:37.871125 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de864ea-8200-4d15-9e57-adb06885e791 None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:37.871800 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de864ea-8200-4d15-9e57-adb06885e791 None admin] RBAC: Adding query filter params (name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:37.872114 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de864ea-8200-4d15-9e57-adb06885e791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:37.873598 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de864ea-8200-4d15-9e57-adb06885e791 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:37.883797 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 357/704] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 23 07:56:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:56:37.890450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfdac1-0010-4e43-b52d-5e71b356ba9b None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:37.895041 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfdac1-0010-4e43-b52d-5e71b356ba9b None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:37.895041 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfdac1-0010-4e43-b52d-5e71b356ba9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:37.914470 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-bdbfdac1-0010-4e43-b52d-5e71b356ba9b None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:37.916809 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-bdbfdac1-0010-4e43-b52d-5e71b356ba9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:37.959233 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ef883-eb54-4409-a09e-c96076cf7918 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:37.966635 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:37.997185 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe7805-6bec-40ec-90cb-e8e3809fbd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:37.997786 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe7805-6bec-40ec-90cb-e8e3809fbd03 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:37.998075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe7805-6bec-40ec-90cb-e8e3809fbd03 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:37.998373 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe7805-6bec-40ec-90cb-e8e3809fbd03 None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:37.999000 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe7805-6bec-40ec-90cb-e8e3809fbd03 None admin] RBAC: Adding query filter params (type=network) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:37.999297 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe7805-6bec-40ec-90cb-e8e3809fbd03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:38.000666 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe7805-6bec-40ec-90cb-e8e3809fbd03 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:38.006833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 348/705] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 23 07:56:37 2022] GET /identity/v3/services?type=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:56:38.007693 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe7805-6bec-40ec-90cb-e8e3809fbd03 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:38.015280 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 358/706] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:38.065965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:38.145700 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe7805-6bec-40ec-90cb-e8e3809fbd03 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:38.182501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65be36-b3d1-4b5a-8d66-5ba262df6a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:38.183053 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65be36-b3d1-4b5a-8d66-5ba262df6a89 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:38.183332 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65be36-b3d1-4b5a-8d66-5ba262df6a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:38.183608 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65be36-b3d1-4b5a-8d66-5ba262df6a89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:38.194558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65be36-b3d1-4b5a-8d66-5ba262df6a89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:38.196024 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65be36-b3d1-4b5a-8d66-5ba262df6a89 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:38.211585 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-fc65be36-b3d1-4b5a-8d66-5ba262df6a89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:38.211585 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:38.211585 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:38.211585 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:38.211585 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:38.211585 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:38.211585 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:38.211585 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:38.211585 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:38.211585 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:38.211585 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:38.211585 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:38.211585 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:38.211585 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:38.211585 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:38.211585 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:38.212558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:38.212558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:38.212558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:38.212558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:38.212558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:38.212558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:38.212558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:38.212558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:38.212558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:38.212558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:38.212558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:38.212558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:38.212558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:38.212558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:38.212558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:38.212558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:38.212558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:38.213628 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:38.213628 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:38.213628 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:38.213628 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 349/707] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:38.218881 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbfdac1-0010-4e43-b52d-5e71b356ba9b None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:38.233354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9504ff-25ff-415b-a6e5-6680fc6b1545 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:38.233640 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9504ff-25ff-415b-a6e5-6680fc6b1545 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:38.233901 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9504ff-25ff-415b-a6e5-6680fc6b1545 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:38.235499 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 350/708] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:38.243441 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3782a-211d-4654-9901-330a932f2d16 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:38.243721 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3782a-211d-4654-9901-330a932f2d16 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:38.244051 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3782a-211d-4654-9901-330a932f2d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:38.264746 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-82c3782a-211d-4654-9901-330a932f2d16 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:38.265998 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-82c3782a-211d-4654-9901-330a932f2d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:38.335769 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbfdac1-0010-4e43-b52d-5e71b356ba9b None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:38.355657 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 351/709] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:56:38.356498 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3782a-211d-4654-9901-330a932f2d16 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:38.374392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab9c31-ed7f-426a-b54e-e0b63a9ba289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:38.375361 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab9c31-ed7f-426a-b54e-e0b63a9ba289 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:38.375865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab9c31-ed7f-426a-b54e-e0b63a9ba289 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:38.376385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab9c31-ed7f-426a-b54e-e0b63a9ba289 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:38.377231 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab9c31-ed7f-426a-b54e-e0b63a9ba289 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:38.377738 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab9c31-ed7f-426a-b54e-e0b63a9ba289 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:38.379377 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab9c31-ed7f-426a-b54e-e0b63a9ba289 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:38.387112 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:38.393873 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 359/710] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:38.399843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab9c31-ed7f-426a-b54e-e0b63a9ba289 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:38.481937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:38.497077 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3782a-211d-4654-9901-330a932f2d16 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:38.556295 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77caff79-5a10-488b-841a-be2bc2d5d982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:38.558176 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77caff79-5a10-488b-841a-be2bc2d5d982 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:38.558698 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77caff79-5a10-488b-841a-be2bc2d5d982 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:38.559178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77caff79-5a10-488b-841a-be2bc2d5d982 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:38.570673 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77caff79-5a10-488b-841a-be2bc2d5d982 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:38.576155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-77caff79-5a10-488b-841a-be2bc2d5d982 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:56:38.576155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:38.576155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:38.576155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:38.576155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:38.576155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:38.576155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:38.576155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:38.576155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:38.576155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:38.576155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:38.576155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:38.576155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:38.576155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:38.576155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:38.576155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:38.577084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:38.577084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:38.577084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:38.577084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:38.577084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:38.577084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:38.577084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:38.577084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:38.577084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:38.577084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:38.577084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:38.577084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:38.577084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:38.577084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:38.577084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:38.577084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:38.577949 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:38.577949 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:38.577949 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:38.577949 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:38.577949 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:38.577949 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:38.577949 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:38.577949 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:38.577949 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:38.577949 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:38.577949 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:56:38.577949 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:38.580767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 352/711] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:56:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:38.587547 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77caff79-5a10-488b-841a-be2bc2d5d982 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:38.665064 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab9c31-ed7f-426a-b54e-e0b63a9ba289 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:38.711331 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86534243-678d-42e9-a8a5-d43d1427715c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:38.712412 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86534243-678d-42e9-a8a5-d43d1427715c None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:38.712895 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86534243-678d-42e9-a8a5-d43d1427715c None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:38.714415 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86534243-678d-42e9-a8a5-d43d1427715c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:38.725376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86534243-678d-42e9-a8a5-d43d1427715c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:38.727242 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86534243-678d-42e9-a8a5-d43d1427715c None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:38.728465 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:38.743009 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77caff79-5a10-488b-841a-be2bc2d5d982 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:38.746447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-86534243-678d-42e9-a8a5-d43d1427715c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 07:56:38.746447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:38.746447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:38.746447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:38.746447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:38.746447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:38.746447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:38.746447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:38.746447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:38.746447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:38.746447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:38.746447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:38.746447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:56:38.746447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:56:38.746447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:56:38.746447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:56:38.747398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:38.747398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:38.747398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:56:38.747398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:38.747398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:56:38.747398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:38.747398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:38.747398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:38.747398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:38.747398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:38.747398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:38.747398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:38.747398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:38.747398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:38.747398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:38.747398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:38.747398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:38.747398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:38.748332 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:38.748332 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:38.748332 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:56:38.748332 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:56:38.748332 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:56:38.748332 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:56:38.748332 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:56:38.748332 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:56:38.748332 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 07:56:38.748332 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:38.751869 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 360/712] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 23 07:56:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:38.756782 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86534243-678d-42e9-a8a5-d43d1427715c None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:38.797575 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63270cf-699a-491e-97ce-f2e2df7accb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:38.798224 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63270cf-699a-491e-97ce-f2e2df7accb8 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:38.798861 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63270cf-699a-491e-97ce-f2e2df7accb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:38.799150 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63270cf-699a-491e-97ce-f2e2df7accb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:38.800047 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63270cf-699a-491e-97ce-f2e2df7accb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:38.800493 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63270cf-699a-491e-97ce-f2e2df7accb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:38.802047 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63270cf-699a-491e-97ce-f2e2df7accb8 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:38.816762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 353/713] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:56:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:38.817599 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63270cf-699a-491e-97ce-f2e2df7accb8 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:38.876100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:38.886399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86534243-678d-42e9-a8a5-d43d1427715c None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:38.921197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7a169-ac17-4016-8870-cfdb0aef0d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:38.921828 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7a169-ac17-4016-8870-cfdb0aef0d58 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:38.922106 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7a169-ac17-4016-8870-cfdb0aef0d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:38.922576 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7a169-ac17-4016-8870-cfdb0aef0d58 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:38.922962 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7a169-ac17-4016-8870-cfdb0aef0d58 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:38.924393 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7a169-ac17-4016-8870-cfdb0aef0d58 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:38.935845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-e9f7a169-ac17-4016-8870-cfdb0aef0d58 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 07:56:38.935845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:38.935845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:56:38.935845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:56:38.935845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:56:38.935845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:56:38.935845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:56:38.935845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:56:38.935845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 07:56:38.935845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:38.935845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:56:38.935845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:38.935845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:38.935845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:38.935845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:38.935845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:38.935845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:38.936876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:38.936876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:38.936876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:38.936876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:38.936876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:38.936876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:38.936876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:56:38.936876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:56:38.936876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:56:38.936876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:56:38.936876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:38.936876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:38.936876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:38.936876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:38.936876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:38.936876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:38.937813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:38.937813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:38.937813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:38.937813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:38.937813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:38.937813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:38.937813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:38.937813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:38.937813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:38.937813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:38.937813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:56:38.937813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:56:38.937813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 07:56:38.937813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:38.937813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 361/714] 10.222.0.57 () {56 vars in 1129 bytes} [Tue Aug 23 07:56:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:38.938709 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7a169-ac17-4016-8870-cfdb0aef0d58 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:38.943377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63270cf-699a-491e-97ce-f2e2df7accb8 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:38.981450 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e812a-9372-451b-9841-4e9bc518c542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:38.982461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e812a-9372-451b-9841-4e9bc518c542 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:38.982954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e812a-9372-451b-9841-4e9bc518c542 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:38.983473 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e812a-9372-451b-9841-4e9bc518c542 None admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:38.984576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e812a-9372-451b-9841-4e9bc518c542 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:38.985157 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e812a-9372-451b-9841-4e9bc518c542 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:38.986825 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e812a-9372-451b-9841-4e9bc518c542 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:39.010893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 354/715] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Aug 23 07:56:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:39.012494 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e812a-9372-451b-9841-4e9bc518c542 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:39.023948 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:39.038411 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7a169-ac17-4016-8870-cfdb0aef0d58 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:39.073527 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f2793-d73e-4331-a94d-544f6efeeebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:39.074417 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f2793-d73e-4331-a94d-544f6efeeebe None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:39.074499 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f2793-d73e-4331-a94d-544f6efeeebe None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:39.074816 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f2793-d73e-4331-a94d-544f6efeeebe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:39.084795 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f2793-d73e-4331-a94d-544f6efeeebe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:39.086255 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f2793-d73e-4331-a94d-544f6efeeebe None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:39.101805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-2c6f2793-d73e-4331-a94d-544f6efeeebe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:39.101805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:39.101805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:39.101805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:39.101805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:39.101805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:39.101805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:39.101805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:39.101805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:39.101805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:39.101805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:39.101805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:39.101805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:39.101805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:39.101805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:39.101805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:39.102883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:39.102883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:39.102883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:39.102883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:39.102883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:39.102883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:39.102883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:39.102883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:39.102883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:39.102883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:39.102883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:39.102883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:39.102883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:39.102883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:39.102883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:39.102883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:39.102883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:39.104362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:39.104362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:39.104362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:39.108486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 362/716] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:39.109513 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f2793-d73e-4331-a94d-544f6efeeebe None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:39.120552 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:39.130301 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e812a-9372-451b-9841-4e9bc518c542 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:39.170438 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebc607-cf2a-41a4-926e-aac20cdf2186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:39.171650 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebc607-cf2a-41a4-926e-aac20cdf2186 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:39.172413 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebc607-cf2a-41a4-926e-aac20cdf2186 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:39.173304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebc607-cf2a-41a4-926e-aac20cdf2186 None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:39.174443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daebc607-cf2a-41a4-926e-aac20cdf2186 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:39.175053 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daebc607-cf2a-41a4-926e-aac20cdf2186 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:39.176928 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daebc607-cf2a-41a4-926e-aac20cdf2186 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:39.184133 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 355/717] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Aug 23 07:56:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:39.185249 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebc607-cf2a-41a4-926e-aac20cdf2186 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:39.214617 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f2793-d73e-4331-a94d-544f6efeeebe None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:39.252142 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523472a-31d9-4cda-a834-2f90bb3b90cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:39.252748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523472a-31d9-4cda-a834-2f90bb3b90cc None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:39.253026 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523472a-31d9-4cda-a834-2f90bb3b90cc None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:39.253297 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523472a-31d9-4cda-a834-2f90bb3b90cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:39.277732 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:39.311476 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebc607-cf2a-41a4-926e-aac20cdf2186 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:39.344579 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523472a-31d9-4cda-a834-2f90bb3b90cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:39.346745 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523472a-31d9-4cda-a834-2f90bb3b90cc None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:39.349430 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ecb534-fffa-41b1-bd1a-52af476d9957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:39.350378 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecb534-fffa-41b1-bd1a-52af476d9957 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:39.350886 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecb534-fffa-41b1-bd1a-52af476d9957 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:39.351353 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecb534-fffa-41b1-bd1a-52af476d9957 None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:39.352202 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ecb534-fffa-41b1-bd1a-52af476d9957 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:39.352710 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ecb534-fffa-41b1-bd1a-52af476d9957 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:39.354748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ecb534-fffa-41b1-bd1a-52af476d9957 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:39.358961 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:39.375151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 356/718] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:39.376422 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ecb534-fffa-41b1-bd1a-52af476d9957 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:39.486644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 363/719] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:56:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:56:39.487937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523472a-31d9-4cda-a834-2f90bb3b90cc None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:39.491267 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ecb534-fffa-41b1-bd1a-52af476d9957 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:39.526732 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:39.532967 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740d255-fadf-42a4-96ec-2fca91914458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:39.533860 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740d255-fadf-42a4-96ec-2fca91914458 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:39.534498 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740d255-fadf-42a4-96ec-2fca91914458 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:39.534971 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740d255-fadf-42a4-96ec-2fca91914458 None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:39.535804 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740d255-fadf-42a4-96ec-2fca91914458 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:39.536305 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740d255-fadf-42a4-96ec-2fca91914458 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:39.537946 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740d255-fadf-42a4-96ec-2fca91914458 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:39.543223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 357/720] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Aug 23 07:56:39 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:39.545176 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740d255-fadf-42a4-96ec-2fca91914458 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:39.615753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523472a-31d9-4cda-a834-2f90bb3b90cc None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:39.627875 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:39.684916 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c28ea-b925-4a24-9fa2-c0b7e3b56314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:39.685572 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c28ea-b925-4a24-9fa2-c0b7e3b56314 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:39.685850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c28ea-b925-4a24-9fa2-c0b7e3b56314 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:39.686120 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c28ea-b925-4a24-9fa2-c0b7e3b56314 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:39.704356 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c28ea-b925-4a24-9fa2-c0b7e3b56314 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:39.709496 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c28ea-b925-4a24-9fa2-c0b7e3b56314 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:39.723860 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740d255-fadf-42a4-96ec-2fca91914458 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:39.733944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-016c28ea-b925-4a24-9fa2-c0b7e3b56314 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:56:39.733944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:39.733944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:39.733944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:39.733944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:39.733944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:39.733944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:39.733944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:39.733944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:39.733944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:39.733944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:39.733944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:39.733944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:56:39.733944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:56:39.733944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:56:39.733944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:56:39.734981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:39.734981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:39.734981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:56:39.734981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:39.734981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:56:39.734981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:39.734981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:39.734981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:39.734981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:39.734981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:39.734981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:39.734981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:39.734981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:39.734981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:39.734981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:39.734981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:39.734981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:39.734981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:39.735924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:39.735924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:39.735924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:56:39.735924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:56:39.735924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:56:39.735924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:56:39.735924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:56:39.735924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:56:39.735924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:56:39.735924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:39.735924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 364/721] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Aug 23 07:56:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:39.743333 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c28ea-b925-4a24-9fa2-c0b7e3b56314 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:39.766569 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b314794-6cdc-4767-89c1-e6b413ce9ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:39.767279 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b314794-6cdc-4767-89c1-e6b413ce9ebb None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:39.767557 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b314794-6cdc-4767-89c1-e6b413ce9ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:39.767832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b314794-6cdc-4767-89c1-e6b413ce9ebb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:39.782648 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b314794-6cdc-4767-89c1-e6b413ce9ebb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:39.784658 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b314794-6cdc-4767-89c1-e6b413ce9ebb None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:39.807840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-2b314794-6cdc-4767-89c1-e6b413ce9ebb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:39.807840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:39.807840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:39.807840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:39.807840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:39.807840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:39.807840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:39.807840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:39.807840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:39.807840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:39.807840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:39.807840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:39.807840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:39.807840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:39.807840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:39.807840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:39.808857 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:39.808857 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:39.808857 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:39.808857 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:39.808857 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:39.808857 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:39.808857 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:39.808857 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:39.808857 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:39.808857 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:39.808857 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:39.808857 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:39.808857 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:39.808857 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:39.808857 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:39.808857 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:39.808857 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:39.809804 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:39.809804 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:39.809804 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:39.811106 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 358/722] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:39.815841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b314794-6cdc-4767-89c1-e6b413ce9ebb None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:39.868001 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c28ea-b925-4a24-9fa2-c0b7e3b56314 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:39.871480 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:39.910159 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86ac7a-2c1b-4c4d-b36c-7fb07b69b6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:39.910890 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86ac7a-2c1b-4c4d-b36c-7fb07b69b6f9 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:39.911122 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86ac7a-2c1b-4c4d-b36c-7fb07b69b6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:39.911399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86ac7a-2c1b-4c4d-b36c-7fb07b69b6f9 None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:39.912135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86ac7a-2c1b-4c4d-b36c-7fb07b69b6f9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:39.912440 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86ac7a-2c1b-4c4d-b36c-7fb07b69b6f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:39.914351 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86ac7a-2c1b-4c4d-b36c-7fb07b69b6f9 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:39.941040 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 365/723] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Aug 23 07:56:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:39.941040 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e74bea-5c65-430c-a3c0-934faf84fd42 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:39.941040 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e74bea-5c65-430c-a3c0-934faf84fd42 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:39.941040 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e74bea-5c65-430c-a3c0-934faf84fd42 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:39.941040 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 366/724] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:39.942081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e74bea-5c65-430c-a3c0-934faf84fd42 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:39.950883 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b314794-6cdc-4767-89c1-e6b413ce9ebb None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:39.978822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:39.995295 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f705481-c6e3-4241-9bab-3194844bac3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:39.996886 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f705481-c6e3-4241-9bab-3194844bac3c None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:39.997377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f705481-c6e3-4241-9bab-3194844bac3c None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:39.997871 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f705481-c6e3-4241-9bab-3194844bac3c None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:39.998871 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f705481-c6e3-4241-9bab-3194844bac3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:39.999760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f705481-c6e3-4241-9bab-3194844bac3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:40.001854 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f705481-c6e3-4241-9bab-3194844bac3c None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:40.019206 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 359/725] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:40.021179 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea43891-5975-45a4-b3cd-31525ee2d806 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:40.021720 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea43891-5975-45a4-b3cd-31525ee2d806 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:40.022225 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea43891-5975-45a4-b3cd-31525ee2d806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:40.045886 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-fea43891-5975-45a4-b3cd-31525ee2d806 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:40.048144 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-fea43891-5975-45a4-b3cd-31525ee2d806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:40.066356 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e74bea-5c65-430c-a3c0-934faf84fd42 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:40.113721 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9a15f-916a-400e-854c-07b899521b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:40.114931 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9a15f-916a-400e-854c-07b899521b9e None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:40.115419 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9a15f-916a-400e-854c-07b899521b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:40.115896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9a15f-916a-400e-854c-07b899521b9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:40.130973 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 360/726] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:40.131953 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea43891-5975-45a4-b3cd-31525ee2d806 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:40.173204 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:40.195169 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9a15f-916a-400e-854c-07b899521b9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:40.197001 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9a15f-916a-400e-854c-07b899521b9e None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:40.227764 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:40.234950 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea43891-5975-45a4-b3cd-31525ee2d806 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:40.269527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47168a-0554-437f-a917-4742f1e6fc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:40.270164 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47168a-0554-437f-a917-4742f1e6fc76 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:40.270477 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47168a-0554-437f-a917-4742f1e6fc76 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:40.270753 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47168a-0554-437f-a917-4742f1e6fc76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:40.278135 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47168a-0554-437f-a917-4742f1e6fc76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:40.279619 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47168a-0554-437f-a917-4742f1e6fc76 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:40.290972 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-9d47168a-0554-437f-a917-4742f1e6fc76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:40.290972 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:40.290972 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:40.290972 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:40.290972 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:40.290972 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:40.290972 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:40.290972 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:40.290972 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:40.290972 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:40.290972 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:40.290972 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:40.290972 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:56:40.290972 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:56:40.290972 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:56:40.292376 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:56:40.292376 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:40.292376 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:40.292376 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:40.292376 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:40.292376 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:40.292376 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:40.292376 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:40.292376 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:40.292376 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:40.292376 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:40.292376 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:40.292376 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:40.292376 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:40.292376 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:40.292376 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:40.292376 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:40.293288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:56:40.293288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:56:40.293288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:56:40.293288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:56:40.293288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:56:40.293288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:56:40.293288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:40.293288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:40.297163 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 361/727] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:40.298709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47168a-0554-437f-a917-4742f1e6fc76 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:40.313192 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 367/728] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:56:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:56:40.319037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9a15f-916a-400e-854c-07b899521b9e None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:40.399589 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:40.403494 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47168a-0554-437f-a917-4742f1e6fc76 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:40.427301 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9a15f-916a-400e-854c-07b899521b9e None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:40.438417 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02793803-790b-49b1-8467-77bc5110886c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:40.439143 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02793803-790b-49b1-8467-77bc5110886c None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:40.439333 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02793803-790b-49b1-8467-77bc5110886c None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:40.439565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02793803-790b-49b1-8467-77bc5110886c None admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:40.440258 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02793803-790b-49b1-8467-77bc5110886c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:40.440563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02793803-790b-49b1-8467-77bc5110886c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:40.441989 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02793803-790b-49b1-8467-77bc5110886c None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:40.459881 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 362/729] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:56:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:40.461357 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61d97e-bf5d-4c1c-a115-0617e7536c4c None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:40.461645 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61d97e-bf5d-4c1c-a115-0617e7536c4c None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:40.461922 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61d97e-bf5d-4c1c-a115-0617e7536c4c None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:40.463665 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 363/730] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:40.463787 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:40.465282 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61d97e-bf5d-4c1c-a115-0617e7536c4c None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:40.471254 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd62a0-d190-4c2d-a7dd-e4c6bafcfc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:40.472189 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd62a0-d190-4c2d-a7dd-e4c6bafcfc92 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:40.472710 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd62a0-d190-4c2d-a7dd-e4c6bafcfc92 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:40.473186 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd62a0-d190-4c2d-a7dd-e4c6bafcfc92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:40.485298 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd62a0-d190-4c2d-a7dd-e4c6bafcfc92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:40.487312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd62a0-d190-4c2d-a7dd-e4c6bafcfc92 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:40.504399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-00cd62a0-d190-4c2d-a7dd-e4c6bafcfc92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:40.504399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:40.504399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:40.504399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:40.504399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:40.504399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:40.504399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:40.504399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:40.504399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:40.504399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:40.504399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:40.504399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:40.504399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:40.504399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:40.504399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:40.504399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:40.505396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:40.505396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:40.505396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:40.505396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:40.505396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:40.505396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:40.505396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:40.505396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:40.505396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:40.505396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:40.505396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:40.505396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:40.505396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:40.505396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:40.505396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:40.505396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:40.505396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:40.506299 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:40.506299 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:40.506299 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:40.509363 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 368/731] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:40.514833 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82fc4d-5001-4588-9e38-acc13f81b5b0 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:40.514833 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82fc4d-5001-4588-9e38-acc13f81b5b0 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:40.514833 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82fc4d-5001-4588-9e38-acc13f81b5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:40.533419 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-1f82fc4d-5001-4588-9e38-acc13f81b5b0 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:40.534646 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-1f82fc4d-5001-4588-9e38-acc13f81b5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:40.574520 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61d97e-bf5d-4c1c-a115-0617e7536c4c None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:40.610367 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 369/732] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:56:40.610367 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82fc4d-5001-4588-9e38-acc13f81b5b0 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:40.614412 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807d4be-23fa-435e-a7a2-f9ab8d558ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:40.615030 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807d4be-23fa-435e-a7a2-f9ab8d558ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:40.615407 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807d4be-23fa-435e-a7a2-f9ab8d558ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:40.615693 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807d4be-23fa-435e-a7a2-f9ab8d558ae2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:40.616417 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807d4be-23fa-435e-a7a2-f9ab8d558ae2 None admin] RBAC: Adding query filter params (role.id=e005fb4b59104519a433fc31da70f47e, scope.project.id=a80ab70ab6b9415c98017d05512c33eb, user.id=970300b51d504a2bbc48158855f02f34) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:40.616725 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807d4be-23fa-435e-a7a2-f9ab8d558ae2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:40.618147 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807d4be-23fa-435e-a7a2-f9ab8d558ae2 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:40.633061 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 364/733] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:56:40 2022] GET /identity/v3/role_assignments?user.id=970300b51d504a2bbc48158855f02f34&scope.project.id=a80ab70ab6b9415c98017d05512c33eb&role.id=e005fb4b59104519a433fc31da70f47e => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:40.634058 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807d4be-23fa-435e-a7a2-f9ab8d558ae2 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:40.682871 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:40.762894 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807d4be-23fa-435e-a7a2-f9ab8d558ae2 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:40.802389 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7de11-ad88-4783-a2c4-84ab43c8b052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:40.803282 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7de11-ad88-4783-a2c4-84ab43c8b052 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:40.803715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7de11-ad88-4783-a2c4-84ab43c8b052 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:40.804192 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7de11-ad88-4783-a2c4-84ab43c8b052 None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:40.804974 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7de11-ad88-4783-a2c4-84ab43c8b052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:40.805462 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7de11-ad88-4783-a2c4-84ab43c8b052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:40.807080 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7de11-ad88-4783-a2c4-84ab43c8b052 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:40.819251 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82fc4d-5001-4588-9e38-acc13f81b5b0 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:40.820782 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 365/734] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:40.826588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7de11-ad88-4783-a2c4-84ab43c8b052 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:40.854644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:40.883143 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826f0c0-e3a1-44dc-829a-5666e33c3d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:40.883814 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826f0c0-e3a1-44dc-829a-5666e33c3d5b None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:40.884100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826f0c0-e3a1-44dc-829a-5666e33c3d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:40.884379 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826f0c0-e3a1-44dc-829a-5666e33c3d5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:40.907451 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826f0c0-e3a1-44dc-829a-5666e33c3d5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:40.912906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-1826f0c0-e3a1-44dc-829a-5666e33c3d5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:56:40.912906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:40.912906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:40.912906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:40.912906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:40.912906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:40.912906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:40.912906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:40.912906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:40.912906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:40.912906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:40.912906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:40.912906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:40.912906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:40.912906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:40.912906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:40.914451 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:40.914451 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:40.914451 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:40.914451 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:40.914451 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:40.914451 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:40.914451 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:40.914451 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:40.914451 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:40.914451 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:40.914451 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:40.914451 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:40.914451 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:40.914451 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:40.914451 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:40.914451 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:40.915558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:40.915558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:40.915558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:40.915558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:40.915558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:40.915558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:40.915558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:40.915558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:40.915558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:40.915558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:40.915558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:56:40.915558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:40.915558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 370/735] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:56:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:40.919508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826f0c0-e3a1-44dc-829a-5666e33c3d5b None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:40.929317 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:40.947782 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7de11-ad88-4783-a2c4-84ab43c8b052 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:40.984643 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45af524-d28b-4d0d-b366-0ff2bab29cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:40.985280 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45af524-d28b-4d0d-b366-0ff2bab29cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:40.985555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45af524-d28b-4d0d-b366-0ff2bab29cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:40.985823 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45af524-d28b-4d0d-b366-0ff2bab29cf7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:40.995868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45af524-d28b-4d0d-b366-0ff2bab29cf7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:40.997745 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45af524-d28b-4d0d-b366-0ff2bab29cf7 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:41.010566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-d45af524-d28b-4d0d-b366-0ff2bab29cf7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:41.010566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:41.010566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:41.010566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:41.010566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:41.010566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:41.010566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:41.010566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:41.010566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:41.010566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:41.010566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:41.010566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:41.010566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:56:41.010566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:56:41.010566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:56:41.011466 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:56:41.011466 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:41.011466 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:41.011466 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:41.011466 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:41.011466 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:41.011466 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:41.011466 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:41.011466 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:41.011466 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:41.011466 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:41.011466 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:41.011466 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:41.011466 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:41.011466 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:41.011466 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:41.011466 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:41.012371 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:56:41.012371 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:56:41.012371 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:56:41.012371 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:56:41.012371 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:56:41.012371 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:56:41.012371 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:41.012371 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:41.019362 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 366/736] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:41.020310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45af524-d28b-4d0d-b366-0ff2bab29cf7 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:41.048540 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826f0c0-e3a1-44dc-829a-5666e33c3d5b None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:41.095649 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd3780-a7ac-4242-84a1-64d5311f9d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:41.096724 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd3780-a7ac-4242-84a1-64d5311f9d5f None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:41.097169 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd3780-a7ac-4242-84a1-64d5311f9d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:41.098487 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd3780-a7ac-4242-84a1-64d5311f9d5f None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:41.099299 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd3780-a7ac-4242-84a1-64d5311f9d5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:41.099765 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd3780-a7ac-4242-84a1-64d5311f9d5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:41.101292 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd3780-a7ac-4242-84a1-64d5311f9d5f None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:41.113192 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 371/737] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:56:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:56:41.114308 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd3780-a7ac-4242-84a1-64d5311f9d5f None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:41.139113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45af524-d28b-4d0d-b366-0ff2bab29cf7 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:41.161480 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:41.177772 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d57cb-e79e-47a0-9f52-75905a31e69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:41.178598 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d57cb-e79e-47a0-9f52-75905a31e69a None admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:41.178982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d57cb-e79e-47a0-9f52-75905a31e69a None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:41.179357 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d57cb-e79e-47a0-9f52-75905a31e69a None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:41.180098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d57cb-e79e-47a0-9f52-75905a31e69a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:41.181624 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d57cb-e79e-47a0-9f52-75905a31e69a None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:41.243470 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd3780-a7ac-4242-84a1-64d5311f9d5f None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:41.270491 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 367/738] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 23 07:56:41 2022] POST /identity/v3/services => generated 240 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:56:41.270491 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d57cb-e79e-47a0-9f52-75905a31e69a None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:41.279811 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:41.314769 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d2388-7985-43bd-aa49-d07509bc97af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:41.315982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d2388-7985-43bd-aa49-d07509bc97af None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:41.316441 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d2388-7985-43bd-aa49-d07509bc97af None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:41.316861 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d2388-7985-43bd-aa49-d07509bc97af None admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:41.317854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d2388-7985-43bd-aa49-d07509bc97af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:41.318390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d2388-7985-43bd-aa49-d07509bc97af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:41.319998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d2388-7985-43bd-aa49-d07509bc97af None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:41.336520 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 372/739] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:56:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:41.344128 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d2388-7985-43bd-aa49-d07509bc97af None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:41.477956 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:41.484073 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d57cb-e79e-47a0-9f52-75905a31e69a None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:41.496223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d2388-7985-43bd-aa49-d07509bc97af None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:41.531057 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccca69b-dfd7-41ec-b10e-b84aa2b7f70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:41.532027 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccca69b-dfd7-41ec-b10e-b84aa2b7f70c None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:41.532313 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccca69b-dfd7-41ec-b10e-b84aa2b7f70c None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:41.532595 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccca69b-dfd7-41ec-b10e-b84aa2b7f70c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:41.536658 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ca066-e2f7-4755-8c03-6a050f394ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:41.537486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ca066-e2f7-4755-8c03-6a050f394ca2 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:41.537957 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ca066-e2f7-4755-8c03-6a050f394ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:41.538441 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ca066-e2f7-4755-8c03-6a050f394ca2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:41.539368 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ca066-e2f7-4755-8c03-6a050f394ca2 None admin] RBAC: Adding query filter params (role.id=e905040849d04aadbb8da8b0d216c92c, scope.project.id=a80ab70ab6b9415c98017d05512c33eb, user.id=b5c55e5c1cea47f29d378ea457384a31) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:41.539872 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ca066-e2f7-4755-8c03-6a050f394ca2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:41.542333 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ca066-e2f7-4755-8c03-6a050f394ca2 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:41.546463 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccca69b-dfd7-41ec-b10e-b84aa2b7f70c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:41.548249 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccca69b-dfd7-41ec-b10e-b84aa2b7f70c None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:41.549390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 373/740] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:56:41 2022] GET /identity/v3/role_assignments?user.id=b5c55e5c1cea47f29d378ea457384a31&scope.project.id=a80ab70ab6b9415c98017d05512c33eb&role.id=e905040849d04aadbb8da8b0d216c92c => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:41.563482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-cccca69b-dfd7-41ec-b10e-b84aa2b7f70c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:41.563482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:41.563482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:41.563482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:41.563482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:41.563482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:41.563482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:41.563482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:41.563482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:41.563482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:41.563482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:41.563482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:41.563482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:41.563482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:41.563482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:41.563482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:41.564505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:41.564505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:41.564505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:41.564505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:41.564505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:41.564505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:41.564505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:41.564505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:41.564505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:41.564505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:41.564505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:41.564505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:41.564505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:41.564505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:41.564505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:41.564505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:41.564505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:41.565425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:41.565425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:41.565425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:41.565425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 368/741] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:41.570785 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ca066-e2f7-4755-8c03-6a050f394ca2 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:41.700042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ca066-e2f7-4755-8c03-6a050f394ca2 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:41.740584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d83a38-a37c-4b33-b1cd-cbe16fd1703b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:41.741120 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d83a38-a37c-4b33-b1cd-cbe16fd1703b None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:41.741401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d83a38-a37c-4b33-b1cd-cbe16fd1703b None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:41.741675 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d83a38-a37c-4b33-b1cd-cbe16fd1703b None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:41.742346 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d83a38-a37c-4b33-b1cd-cbe16fd1703b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:41.742633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d83a38-a37c-4b33-b1cd-cbe16fd1703b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:41.744011 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d83a38-a37c-4b33-b1cd-cbe16fd1703b None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:41.756935 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 374/742] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:41.763430 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccca69b-dfd7-41ec-b10e-b84aa2b7f70c None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:41.830891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:41.877035 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccca69b-dfd7-41ec-b10e-b84aa2b7f70c None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:41.878865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b87016-3b21-4fb3-a8c4-e871e42bfbad None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:41.879368 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b87016-3b21-4fb3-a8c4-e871e42bfbad None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:41.879877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b87016-3b21-4fb3-a8c4-e871e42bfbad None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:41.881947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 375/743] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:56:41.888818 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31487d7-95c7-4c15-9097-e9119320b07c None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:41.889796 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31487d7-95c7-4c15-9097-e9119320b07c None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:41.890477 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31487d7-95c7-4c15-9097-e9119320b07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:41.913133 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-a31487d7-95c7-4c15-9097-e9119320b07c None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:41.916030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-a31487d7-95c7-4c15-9097-e9119320b07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:41.925897 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:41.926757 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e2bfb-6ce7-4afe-b08a-b422465fc18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:41.927397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e2bfb-6ce7-4afe-b08a-b422465fc18a None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:41.927679 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e2bfb-6ce7-4afe-b08a-b422465fc18a None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:41.927951 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e2bfb-6ce7-4afe-b08a-b422465fc18a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:41.943012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e2bfb-6ce7-4afe-b08a-b422465fc18a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:41.946912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e2bfb-6ce7-4afe-b08a-b422465fc18a None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:41.966819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-4c8e2bfb-6ce7-4afe-b08a-b422465fc18a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 07:56:41.966819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:41.966819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:41.966819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:41.966819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:41.966819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:41.966819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:41.966819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:41.966819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:41.966819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:41.966819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:41.966819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:41.966819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:56:41.966819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:56:41.966819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:56:41.966819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:56:41.967801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:41.967801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:41.967801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:56:41.967801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:41.967801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:56:41.967801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:41.967801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:41.967801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:41.967801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:41.967801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:41.967801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:41.967801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:41.967801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:41.967801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:41.967801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:41.967801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:41.967801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:41.967801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:41.968746 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:41.968746 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:41.968746 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:56:41.968746 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:56:41.968746 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:56:41.968746 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:56:41.968746 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:56:41.968746 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:56:41.968746 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 07:56:41.968746 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:41.976721 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 369/744] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:56:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:41.984144 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e2bfb-6ce7-4afe-b08a-b422465fc18a None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:42.039921 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 376/745] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:41 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:56:42.126172 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e2bfb-6ce7-4afe-b08a-b422465fc18a None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:42.145976 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:42.178365 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d7682-e64c-43be-8718-0e4c7f313c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:42.178995 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d7682-e64c-43be-8718-0e4c7f313c87 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:42.179285 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d7682-e64c-43be-8718-0e4c7f313c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:42.179567 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d7682-e64c-43be-8718-0e4c7f313c87 None admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:42.180311 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d7682-e64c-43be-8718-0e4c7f313c87 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:42.180621 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d7682-e64c-43be-8718-0e4c7f313c87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:42.183206 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d7682-e64c-43be-8718-0e4c7f313c87 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:42.205551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 370/746] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Aug 23 07:56:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:42.211401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31487d7-95c7-4c15-9097-e9119320b07c None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:42.337185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31487d7-95c7-4c15-9097-e9119320b07c None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:42.377756 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5be02-5eab-46bf-9173-68d0fc67d1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:42.378397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5be02-5eab-46bf-9173-68d0fc67d1c1 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:42.378681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5be02-5eab-46bf-9173-68d0fc67d1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:42.378953 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5be02-5eab-46bf-9173-68d0fc67d1c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:42.396668 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:42.464347 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d7682-e64c-43be-8718-0e4c7f313c87 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:42.475587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5be02-5eab-46bf-9173-68d0fc67d1c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:42.477318 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5be02-5eab-46bf-9173-68d0fc67d1c1 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:42.584364 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d7682-e64c-43be-8718-0e4c7f313c87 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:42.597095 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 377/747] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:56:42 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:56:42.598620 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5be02-5eab-46bf-9173-68d0fc67d1c1 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:42.642669 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:42.676015 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6375214-b0f9-4e51-b563-d941d4f56c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:42.676645 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6375214-b0f9-4e51-b563-d941d4f56c31 None admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:42.676930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6375214-b0f9-4e51-b563-d941d4f56c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:42.677208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6375214-b0f9-4e51-b563-d941d4f56c31 None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:42.678106 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6375214-b0f9-4e51-b563-d941d4f56c31 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:42.679280 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6375214-b0f9-4e51-b563-d941d4f56c31 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:42.704794 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5be02-5eab-46bf-9173-68d0fc67d1c1 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:42.745787 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002560f-38f1-43c8-9b5c-e20698c04cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:42.746467 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002560f-38f1-43c8-9b5c-e20698c04cab None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:42.746793 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002560f-38f1-43c8-9b5c-e20698c04cab None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:42.747118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002560f-38f1-43c8-9b5c-e20698c04cab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:42.758736 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002560f-38f1-43c8-9b5c-e20698c04cab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:42.760474 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002560f-38f1-43c8-9b5c-e20698c04cab None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:42.769859 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 371/748] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 23 07:56:42 2022] POST /identity/v3/services => generated 251 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 07:56:42.778551 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-4002560f-38f1-43c8-9b5c-e20698c04cab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:42.778551 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:42.778551 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:42.778551 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:42.778551 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:42.778551 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:42.778551 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:42.778551 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:42.778551 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:42.778551 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:42.778551 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:42.778551 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:42.778551 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:42.778551 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:42.778551 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:42.778551 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:42.779558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:42.779558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:42.779558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:42.779558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:42.779558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:42.779558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:42.779558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:42.779558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:42.779558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:42.779558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:42.779558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:42.779558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:42.779558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:42.779558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:42.779558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:42.779558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:42.779558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:42.780670 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:42.780670 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:42.780670 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:42.780670 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 378/749] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:42.787500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6375214-b0f9-4e51-b563-d941d4f56c31 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:42.859545 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:42.949890 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ecdcf-f0c6-495c-b990-0273f1fc5f40 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:42.950902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ecdcf-f0c6-495c-b990-0273f1fc5f40 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:42.951380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ecdcf-f0c6-495c-b990-0273f1fc5f40 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:42.956837 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 379/750] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:42.958558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d274c-96c5-4359-963e-653c227aa4c9 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:42.959074 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d274c-96c5-4359-963e-653c227aa4c9 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:42.959625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d274c-96c5-4359-963e-653c227aa4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:42.967165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6375214-b0f9-4e51-b563-d941d4f56c31 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:42.984735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-271d274c-96c5-4359-963e-653c227aa4c9 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:42.986454 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-271d274c-96c5-4359-963e-653c227aa4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:43.014004 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b4da9-7749-4154-8fc6-56bdad5276ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:43.014664 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b4da9-7749-4154-8fc6-56bdad5276ab None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:43.014952 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b4da9-7749-4154-8fc6-56bdad5276ab None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:43.015232 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b4da9-7749-4154-8fc6-56bdad5276ab None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:43.015884 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b4da9-7749-4154-8fc6-56bdad5276ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:43.016220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b4da9-7749-4154-8fc6-56bdad5276ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:43.018464 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b4da9-7749-4154-8fc6-56bdad5276ab None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:43.033921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 372/751] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:43.039632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b4da9-7749-4154-8fc6-56bdad5276ab None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:43.073554 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 380/752] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:56:43.142893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:43.157484 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b4da9-7749-4154-8fc6-56bdad5276ab None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:43.199249 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c74316-dba2-449e-aad5-6391aafbdd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:43.200142 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c74316-dba2-449e-aad5-6391aafbdd6e None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:43.200604 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c74316-dba2-449e-aad5-6391aafbdd6e None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:43.201031 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c74316-dba2-449e-aad5-6391aafbdd6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:43.208339 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c74316-dba2-449e-aad5-6391aafbdd6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:43.209965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c74316-dba2-449e-aad5-6391aafbdd6e None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:43.224521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-d2c74316-dba2-449e-aad5-6391aafbdd6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:43.224521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:43.224521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:43.224521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:43.224521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:43.224521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:43.224521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:43.224521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:43.224521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:43.224521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:43.224521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:43.224521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:43.224521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:56:43.224521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:56:43.224521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:56:43.225614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:56:43.225614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:43.225614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:43.225614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:43.225614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:43.225614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:43.225614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:43.225614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:43.225614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:43.225614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:43.225614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:43.225614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:43.225614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:43.225614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:43.225614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:43.225614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:43.225614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:43.226758 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:56:43.226758 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:56:43.226758 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:56:43.226758 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:56:43.226758 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:56:43.226758 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:56:43.226758 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:43.226758 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:43.233983 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 373/753] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:43.235298 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d274c-96c5-4359-963e-653c227aa4c9 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:43.272745 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:43.373663 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d274c-96c5-4359-963e-653c227aa4c9 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:43.413191 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0a556-b2f8-4ecc-a339-df08ca5c58b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:43.413768 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0a556-b2f8-4ecc-a339-df08ca5c58b3 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:43.414050 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0a556-b2f8-4ecc-a339-df08ca5c58b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:43.414346 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0a556-b2f8-4ecc-a339-df08ca5c58b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:43.415039 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0a556-b2f8-4ecc-a339-df08ca5c58b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:43.415353 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0a556-b2f8-4ecc-a339-df08ca5c58b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:43.416840 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0a556-b2f8-4ecc-a339-df08ca5c58b3 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:43.428806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 381/754] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:56:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:43.439599 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c74316-dba2-449e-aad5-6391aafbdd6e None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:43.445968 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0a556-b2f8-4ecc-a339-df08ca5c58b3 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:43.571178 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:43.609104 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0a556-b2f8-4ecc-a339-df08ca5c58b3 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:43.652335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c74316-dba2-449e-aad5-6391aafbdd6e None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:43.670702 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bc951-efbb-47e0-979a-b438a771b7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:43.671253 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bc951-efbb-47e0-979a-b438a771b7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:43.671533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bc951-efbb-47e0-979a-b438a771b7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:43.671808 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bc951-efbb-47e0-979a-b438a771b7f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:43.694087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bc951-efbb-47e0-979a-b438a771b7f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:43.703392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-db4bc951-efbb-47e0-979a-b438a771b7f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:43.703392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:43.703392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:43.703392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:43.703392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:43.703392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:43.703392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:43.703392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:43.703392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:43.703392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:43.703392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:43.703392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:43.703392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:43.703392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:43.703392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:43.703392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:43.704352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:43.704352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:43.704352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:43.704352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:43.704352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:43.704352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:43.704352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:43.704352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:43.704352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:43.704352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:43.704352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:43.704352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:43.704352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:43.704352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:43.704352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:43.704352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:43.705216 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:43.705216 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:43.705216 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:43.705216 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:43.705216 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:43.705216 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:43.705216 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:43.705216 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:43.705216 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:43.705216 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:43.705216 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:43.705216 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:43.705859 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 382/755] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 23 07:56:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:43.711724 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d603b3-6a9a-4ff0-96b4-2cf613364e92 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:43.712071 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d603b3-6a9a-4ff0-96b4-2cf613364e92 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:43.712354 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d603b3-6a9a-4ff0-96b4-2cf613364e92 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:43.714915 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 383/756] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:43.715628 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d603b3-6a9a-4ff0-96b4-2cf613364e92 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:43.717563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55aa94c-b211-4959-8cc8-75c8d7a339bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:43.718173 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55aa94c-b211-4959-8cc8-75c8d7a339bf None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:43.718477 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55aa94c-b211-4959-8cc8-75c8d7a339bf None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:43.718751 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55aa94c-b211-4959-8cc8-75c8d7a339bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:43.719470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55aa94c-b211-4959-8cc8-75c8d7a339bf None admin] RBAC: Adding query filter params (role.id=e905040849d04aadbb8da8b0d216c92c, scope.project.id=a80ab70ab6b9415c98017d05512c33eb, user.id=4718cad0c0b9461d9c4152d7ea4b385d) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:43.719775 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55aa94c-b211-4959-8cc8-75c8d7a339bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:43.721205 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55aa94c-b211-4959-8cc8-75c8d7a339bf None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:43.727418 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 374/757] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:56:43 2022] GET /identity/v3/role_assignments?user.id=4718cad0c0b9461d9c4152d7ea4b385d&scope.project.id=a80ab70ab6b9415c98017d05512c33eb&role.id=e905040849d04aadbb8da8b0d216c92c => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:43.728646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9becc3d-46dc-454c-8bb8-dd3467cf7de2 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:43.728935 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9becc3d-46dc-454c-8bb8-dd3467cf7de2 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:43.729214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9becc3d-46dc-454c-8bb8-dd3467cf7de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:43.764365 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-a9becc3d-46dc-454c-8bb8-dd3467cf7de2 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:43.765617 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a9becc3d-46dc-454c-8bb8-dd3467cf7de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:43.780746 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:43.906833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 375/758] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:56:43.923883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d603b3-6a9a-4ff0-96b4-2cf613364e92 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:43.960491 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4f71f-d3df-4e25-a54d-e66e930ff4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:43.961138 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4f71f-d3df-4e25-a54d-e66e930ff4ef None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:43.961364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4f71f-d3df-4e25-a54d-e66e930ff4ef None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:43.961686 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4f71f-d3df-4e25-a54d-e66e930ff4ef None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:43.962370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4f71f-d3df-4e25-a54d-e66e930ff4ef None admin] RBAC: Adding query filter params (name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:43.962674 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4f71f-d3df-4e25-a54d-e66e930ff4ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:43.964231 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4f71f-d3df-4e25-a54d-e66e930ff4ef None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:43.973379 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 384/759] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 23 07:56:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:43.983646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9becc3d-46dc-454c-8bb8-dd3467cf7de2 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:44.091265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9becc3d-46dc-454c-8bb8-dd3467cf7de2 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:44.133309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4050d62-9f56-4bdc-ae6d-677f4aa9b815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:44.133943 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4050d62-9f56-4bdc-ae6d-677f4aa9b815 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:44.134221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4050d62-9f56-4bdc-ae6d-677f4aa9b815 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:44.134515 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4050d62-9f56-4bdc-ae6d-677f4aa9b815 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:44.145772 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4050d62-9f56-4bdc-ae6d-677f4aa9b815 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:44.147401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4050d62-9f56-4bdc-ae6d-677f4aa9b815 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:44.148951 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d777b8-d700-44b5-be2c-22642aa57de9 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:44.149234 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d777b8-d700-44b5-be2c-22642aa57de9 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:44.149503 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d777b8-d700-44b5-be2c-22642aa57de9 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:44.151373 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 385/760] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:56:44.153409 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:44.160500 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d1ab8-e42f-4bfe-98a9-a5a1515b8f4a None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:44.160500 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d1ab8-e42f-4bfe-98a9-a5a1515b8f4a None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:44.160500 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d1ab8-e42f-4bfe-98a9-a5a1515b8f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:44.169032 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-a4050d62-9f56-4bdc-ae6d-677f4aa9b815 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:44.169032 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:44.169032 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:44.169032 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:44.169032 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:44.169032 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:44.169032 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:44.169032 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:44.169032 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:44.169032 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:44.169032 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:44.169032 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:44.169032 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:44.169032 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:44.169032 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:44.169032 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:44.175049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:44.175049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:44.175049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:44.175049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:44.175049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:44.175049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:44.175049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:44.175049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:44.175049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:44.175049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:44.175049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:44.175049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:44.175049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:44.175049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:44.175049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:44.175049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:44.175049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:44.175938 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:44.175938 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:44.175938 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:44.175938 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 376/761] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:44.178269 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:44.179607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4050d62-9f56-4bdc-ae6d-677f4aa9b815 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:44.194244 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-2f4d1ab8-e42f-4bfe-98a9-a5a1515b8f4a None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:44.195478 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-2f4d1ab8-e42f-4bfe-98a9-a5a1515b8f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:44.289134 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 386/762] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:56:44.290061 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d1ab8-e42f-4bfe-98a9-a5a1515b8f4a None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:44.331426 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4050d62-9f56-4bdc-ae6d-677f4aa9b815 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:44.408202 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec8303-8a96-49da-b8ea-6ac3e0e7a873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:44.408817 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec8303-8a96-49da-b8ea-6ac3e0e7a873 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:44.409094 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec8303-8a96-49da-b8ea-6ac3e0e7a873 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:44.409363 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec8303-8a96-49da-b8ea-6ac3e0e7a873 None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:44.409999 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec8303-8a96-49da-b8ea-6ac3e0e7a873 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:44.410315 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec8303-8a96-49da-b8ea-6ac3e0e7a873 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:44.411705 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec8303-8a96-49da-b8ea-6ac3e0e7a873 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:44.427226 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d1ab8-e42f-4bfe-98a9-a5a1515b8f4a None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:44.432820 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 377/763] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:44.438131 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec8303-8a96-49da-b8ea-6ac3e0e7a873 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:44.471328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76703d54-0247-49cf-af6f-458e711322ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:44.473424 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76703d54-0247-49cf-af6f-458e711322ea None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:44.474112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76703d54-0247-49cf-af6f-458e711322ea None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:44.475250 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76703d54-0247-49cf-af6f-458e711322ea None admin] PATH_INFO: `/v3/services/network` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:44.476286 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76703d54-0247-49cf-af6f-458e711322ea None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:44.481063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76703d54-0247-49cf-af6f-458e711322ea None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:44.492963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-76703d54-0247-49cf-af6f-458e711322ea None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 07:56:44.492963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:44.492963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:56:44.492963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:56:44.492963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:56:44.492963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:56:44.492963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:56:44.492963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:56:44.492963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 07:56:44.492963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:44.492963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:56:44.492963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:44.492963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:44.492963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:44.492963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:44.492963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:44.492963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:44.493969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:44.493969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:44.493969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:44.493969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:44.493969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:44.493969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:44.493969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:56:44.493969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:56:44.493969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:56:44.493969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:56:44.493969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:44.493969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:44.493969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:44.493969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:44.493969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:44.493969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:44.495037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:44.495037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:44.495037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:44.495037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:44.495037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:44.495037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:44.495037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:44.495037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:44.495037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:44.495037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:44.495037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:56:44.495037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:56:44.495037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 07:56:44.495037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:44.502221 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 387/764] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:44 2022] GET /identity/v3/services/network => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:44.502559 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:44.507338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76703d54-0247-49cf-af6f-458e711322ea None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:44.552712 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:44.620795 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec8303-8a96-49da-b8ea-6ac3e0e7a873 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:44.658326 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76703d54-0247-49cf-af6f-458e711322ea None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:44.671167 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffc176-32c8-4fd5-a2f4-a7186818c8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:44.671870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffc176-32c8-4fd5-a2f4-a7186818c8f1 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:44.672158 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffc176-32c8-4fd5-a2f4-a7186818c8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:44.672437 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffc176-32c8-4fd5-a2f4-a7186818c8f1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:44.680385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffc176-32c8-4fd5-a2f4-a7186818c8f1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:44.682954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffc176-32c8-4fd5-a2f4-a7186818c8f1 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:44.693980 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f395ee7-8737-4554-b943-f357422204b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:44.694625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f395ee7-8737-4554-b943-f357422204b6 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:44.694736 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-8dffc176-32c8-4fd5-a2f4-a7186818c8f1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 07:56:44.694736 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:44.694736 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:44.694736 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:44.694736 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:44.694736 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:44.694736 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:44.694736 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:44.694736 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:44.694736 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:44.694736 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:44.694736 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:44.694736 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:56:44.694736 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:56:44.694736 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:56:44.694736 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:56:44.695638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:44.695638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:44.695638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:56:44.695638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:44.695638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:56:44.695638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:44.695638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:44.695638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:44.695638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:44.695638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:44.695638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:44.695638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:44.695638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:44.695638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:44.695638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:44.695638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:44.695638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:44.695638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:44.696569 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:44.696569 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:44.696569 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:56:44.696569 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:56:44.696569 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:56:44.696569 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:56:44.696569 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:56:44.696569 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:56:44.696569 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 07:56:44.696569 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:44.698150 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f395ee7-8737-4554-b943-f357422204b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:44.698150 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f395ee7-8737-4554-b943-f357422204b6 None admin] PATH_INFO: `/v3/services` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:44.698150 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f395ee7-8737-4554-b943-f357422204b6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:44.698150 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f395ee7-8737-4554-b943-f357422204b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:44.699053 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 378/765] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 23 07:56:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:44.699053 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffc176-32c8-4fd5-a2f4-a7186818c8f1 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:44.699346 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f395ee7-8737-4554-b943-f357422204b6 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:44.704805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 388/766] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 23 07:56:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:44.705611 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f395ee7-8737-4554-b943-f357422204b6 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:44.782447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:44.811469 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffc176-32c8-4fd5-a2f4-a7186818c8f1 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:44.829459 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:44.833067 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f395ee7-8737-4554-b943-f357422204b6 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:44.852461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b084481-2c81-481a-bc81-4b78cab816c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:44.853067 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b084481-2c81-481a-bc81-4b78cab816c6 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:44.854233 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b084481-2c81-481a-bc81-4b78cab816c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:44.854882 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b084481-2c81-481a-bc81-4b78cab816c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:44.866774 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b084481-2c81-481a-bc81-4b78cab816c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:44.872102 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-2b084481-2c81-481a-bc81-4b78cab816c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:56:44.872102 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:44.872102 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:44.872102 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:44.872102 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:44.872102 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:44.872102 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:44.872102 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:44.872102 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:44.872102 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:44.872102 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:44.872102 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:44.872102 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:44.872102 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:44.872102 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:44.872102 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:44.873189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:44.873189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:44.873189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:44.873189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:44.873189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:44.873189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:44.873189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:44.873189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:44.873189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:44.873189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:44.873189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:44.873189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:44.873189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:44.873189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:44.873189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:44.873189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:44.874178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:44.874178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:44.874178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:44.874178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:44.874178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:44.874178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:44.874178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:44.874178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:44.874178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:44.874178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:44.874178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:56:44.874178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:44.874178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 379/767] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:56:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:44.874908 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b084481-2c81-481a-bc81-4b78cab816c6 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:44.881395 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507fa5a-4ac6-4ea4-ba28-8ba9f1c476e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:44.882232 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507fa5a-4ac6-4ea4-ba28-8ba9f1c476e9 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:44.882674 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507fa5a-4ac6-4ea4-ba28-8ba9f1c476e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:44.883107 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507fa5a-4ac6-4ea4-ba28-8ba9f1c476e9 None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:44.883974 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507fa5a-4ac6-4ea4-ba28-8ba9f1c476e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:44.884440 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507fa5a-4ac6-4ea4-ba28-8ba9f1c476e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:44.886753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507fa5a-4ac6-4ea4-ba28-8ba9f1c476e9 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:44.909041 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 389/768] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Aug 23 07:56:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:44.909955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507fa5a-4ac6-4ea4-ba28-8ba9f1c476e9 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:44.992980 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b084481-2c81-481a-bc81-4b78cab816c6 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:45.037114 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab12647-bdfd-4117-9351-0d8094011089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:45.037724 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab12647-bdfd-4117-9351-0d8094011089 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:45.038007 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab12647-bdfd-4117-9351-0d8094011089 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:45.038277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab12647-bdfd-4117-9351-0d8094011089 None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:45.038922 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab12647-bdfd-4117-9351-0d8094011089 None admin] RBAC: Adding query filter params (type=network) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:45.039226 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab12647-bdfd-4117-9351-0d8094011089 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:45.040603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab12647-bdfd-4117-9351-0d8094011089 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:45.047564 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 380/769] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 23 07:56:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:45.047715 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507fa5a-4ac6-4ea4-ba28-8ba9f1c476e9 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:45.049326 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab12647-bdfd-4117-9351-0d8094011089 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:45.076981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:45.093461 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c8147-96ee-48a9-a52a-92b7982cddbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:45.094268 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c8147-96ee-48a9-a52a-92b7982cddbe None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:45.094577 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c8147-96ee-48a9-a52a-92b7982cddbe None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:45.094911 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c8147-96ee-48a9-a52a-92b7982cddbe None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:45.095607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c8147-96ee-48a9-a52a-92b7982cddbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:45.096818 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c8147-96ee-48a9-a52a-92b7982cddbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:45.097521 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c8147-96ee-48a9-a52a-92b7982cddbe None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:45.103040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:45.109879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 390/770] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:56:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:45.111109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c8147-96ee-48a9-a52a-92b7982cddbe None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:45.177331 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab12647-bdfd-4117-9351-0d8094011089 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:45.215927 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c78b25-89b2-475e-b1a6-3e265666a690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:45.216939 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c78b25-89b2-475e-b1a6-3e265666a690 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:45.217407 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c78b25-89b2-475e-b1a6-3e265666a690 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:45.217862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c78b25-89b2-475e-b1a6-3e265666a690 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:45.228065 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c8147-96ee-48a9-a52a-92b7982cddbe None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:45.229835 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c78b25-89b2-475e-b1a6-3e265666a690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:45.231633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c78b25-89b2-475e-b1a6-3e265666a690 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:45.248100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-69c78b25-89b2-475e-b1a6-3e265666a690 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:45.248100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:45.248100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:45.248100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:45.248100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:45.248100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:45.248100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:45.248100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:45.248100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:45.248100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:45.248100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:45.248100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:45.248100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:45.248100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:45.248100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:45.248100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:45.249256 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:45.249256 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:45.249256 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:45.249256 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:45.249256 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:45.249256 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:45.249256 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:45.249256 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:45.249256 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:45.249256 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:45.249256 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:45.249256 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:45.249256 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:45.249256 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:45.249256 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:45.249256 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:45.249256 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:45.250408 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:45.250408 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:45.250408 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:45.251122 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 381/771] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:45.254355 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c78b25-89b2-475e-b1a6-3e265666a690 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:45.266920 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba3fe2-3c0a-4960-aa56-83bb2191f1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:45.267843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba3fe2-3c0a-4960-aa56-83bb2191f1fb None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:45.268188 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba3fe2-3c0a-4960-aa56-83bb2191f1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:45.268525 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba3fe2-3c0a-4960-aa56-83bb2191f1fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:45.269842 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba3fe2-3c0a-4960-aa56-83bb2191f1fb None admin] RBAC: Adding query filter params (interface=public, service_id=5adaa8790133446c80a1f5de8351a103, region_id=RegionOne) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:45.270441 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba3fe2-3c0a-4960-aa56-83bb2191f1fb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:45.272087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba3fe2-3c0a-4960-aa56-83bb2191f1fb None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:45.281982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 391/772] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Aug 23 07:56:45 2022] GET /identity/v3/endpoints?service_id=5adaa8790133446c80a1f5de8351a103&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:45.283763 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a5373-01bb-427b-a979-b23950e3d3fd None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:45.286314 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a5373-01bb-427b-a979-b23950e3d3fd None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:45.286314 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a5373-01bb-427b-a979-b23950e3d3fd None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:45.286314 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 392/773] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:45.287004 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a5373-01bb-427b-a979-b23950e3d3fd None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:45.348657 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:45.349669 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:45.360672 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c78b25-89b2-475e-b1a6-3e265666a690 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:45.395377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d274b8-bdd4-4eb0-9ef6-af3083a48a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:45.396011 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d274b8-bdd4-4eb0-9ef6-af3083a48a83 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:45.396293 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d274b8-bdd4-4eb0-9ef6-af3083a48a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:45.396568 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d274b8-bdd4-4eb0-9ef6-af3083a48a83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:45.405115 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a5373-01bb-427b-a979-b23950e3d3fd None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:45.408750 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d274b8-bdd4-4eb0-9ef6-af3083a48a83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:45.412935 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d274b8-bdd4-4eb0-9ef6-af3083a48a83 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:45.427898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-a6d274b8-bdd4-4eb0-9ef6-af3083a48a83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:45.427898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:45.427898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:45.427898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:45.427898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:45.427898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:45.427898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:45.427898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:45.427898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:45.427898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:45.427898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:45.427898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:45.427898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:45.427898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:45.427898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:45.427898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:45.428864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:45.428864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:45.428864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:45.428864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:45.428864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:45.428864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:45.428864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:45.428864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:45.428864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:45.428864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:45.428864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:45.428864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:45.428864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:45.428864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:45.428864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:45.428864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:45.428864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:45.429771 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:45.429771 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:45.429771 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:45.434221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 382/774] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:45.435491 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926832e-cb03-476f-8e80-38a144a7f663 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:45.435772 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926832e-cb03-476f-8e80-38a144a7f663 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:45.436045 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926832e-cb03-476f-8e80-38a144a7f663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:45.445147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99de6f4-7789-467b-bdbe-c0dc11a15665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:45.445785 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99de6f4-7789-467b-bdbe-c0dc11a15665 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:45.446071 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99de6f4-7789-467b-bdbe-c0dc11a15665 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:45.446369 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99de6f4-7789-467b-bdbe-c0dc11a15665 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:45.447006 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99de6f4-7789-467b-bdbe-c0dc11a15665 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:45.447873 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99de6f4-7789-467b-bdbe-c0dc11a15665 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:45.449565 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99de6f4-7789-467b-bdbe-c0dc11a15665 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:45.454664 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-e926832e-cb03-476f-8e80-38a144a7f663 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:45.455848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-e926832e-cb03-476f-8e80-38a144a7f663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:45.461582 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 393/775] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:45.462475 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99de6f4-7789-467b-bdbe-c0dc11a15665 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:45.534367 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 383/776] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:56:45.534367 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926832e-cb03-476f-8e80-38a144a7f663 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:45.584064 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99de6f4-7789-467b-bdbe-c0dc11a15665 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:45.601310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:45.603706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:45.627159 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8467f-2802-4d8b-a048-fb8c3e525411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:45.628048 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8467f-2802-4d8b-a048-fb8c3e525411 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:45.628334 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8467f-2802-4d8b-a048-fb8c3e525411 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:45.628612 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8467f-2802-4d8b-a048-fb8c3e525411 None admin] PATH_INFO: `/v3/services` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:45.629583 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8467f-2802-4d8b-a048-fb8c3e525411 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:45.631633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8467f-2802-4d8b-a048-fb8c3e525411 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:45.632987 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926832e-cb03-476f-8e80-38a144a7f663 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:45.642470 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 394/777] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Aug 23 07:56:45 2022] GET /identity/v3/services => generated 772 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:45.643493 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8467f-2802-4d8b-a048-fb8c3e525411 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:45.705332 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea396901-ddea-48be-8085-7ec3f388ecb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:45.706052 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea396901-ddea-48be-8085-7ec3f388ecb8 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:45.706428 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea396901-ddea-48be-8085-7ec3f388ecb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:45.706971 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea396901-ddea-48be-8085-7ec3f388ecb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:45.707731 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea396901-ddea-48be-8085-7ec3f388ecb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:45.708106 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea396901-ddea-48be-8085-7ec3f388ecb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:45.711753 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea396901-ddea-48be-8085-7ec3f388ecb8 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:45.740320 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 384/778] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:45.746452 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea396901-ddea-48be-8085-7ec3f388ecb8 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:45.862136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea396901-ddea-48be-8085-7ec3f388ecb8 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:45.865482 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8467f-2802-4d8b-a048-fb8c3e525411 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:45.902377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:45.905664 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f062ea1-e120-416c-83ad-b7e0caa270d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:45.906574 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f062ea1-e120-416c-83ad-b7e0caa270d3 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:45.907045 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f062ea1-e120-416c-83ad-b7e0caa270d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:45.907498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f062ea1-e120-416c-83ad-b7e0caa270d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:45.907601 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91967f53-9a34-4b63-89d2-ea4918233727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:45.908295 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91967f53-9a34-4b63-89d2-ea4918233727 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:45.908633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91967f53-9a34-4b63-89d2-ea4918233727 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:45.908968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91967f53-9a34-4b63-89d2-ea4918233727 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:45.915611 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f062ea1-e120-416c-83ad-b7e0caa270d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:45.918221 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f062ea1-e120-416c-83ad-b7e0caa270d3 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:45.919009 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91967f53-9a34-4b63-89d2-ea4918233727 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:45.920948 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91967f53-9a34-4b63-89d2-ea4918233727 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:45.932025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-2f062ea1-e120-416c-83ad-b7e0caa270d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:45.932025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:45.932025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:45.932025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:45.932025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:45.932025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:45.932025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:45.932025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:45.932025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:45.932025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:45.932025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:45.932025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:45.932025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:56:45.932025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:56:45.932025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:56:45.932965 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:56:45.932965 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:45.932965 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:45.932965 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:45.932965 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:45.932965 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:45.932965 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:45.932965 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:45.932965 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:45.932965 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:45.932965 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:45.932965 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:45.932965 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:45.932965 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:45.932965 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:45.932965 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:45.932965 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:45.933877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:56:45.933877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:56:45.933877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:56:45.933877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:56:45.933877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:56:45.933877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:56:45.933877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:45.933877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:45.934325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-91967f53-9a34-4b63-89d2-ea4918233727 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:56:45.934325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:45.934325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:45.934325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:45.934325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:45.934325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:45.934325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:45.934325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:45.934325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:45.934325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:45.934325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:45.934325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:45.934325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:56:45.934325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:56:45.934325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:56:45.934325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:56:45.935218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:45.935218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:45.935218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:56:45.935218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:45.935218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:56:45.935218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:45.935218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:45.935218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:45.935218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:45.935218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:45.935218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:45.935218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:45.935218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:45.935218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:45.935218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:45.935218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:45.935218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:45.935218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:45.936192 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:45.936192 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:45.936192 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:56:45.936192 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:56:45.936192 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:56:45.936192 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:56:45.936192 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:56:45.936192 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:56:45.936192 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:56:45.936192 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:45.936192 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 385/779] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Aug 23 07:56:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:45.937524 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91967f53-9a34-4b63-89d2-ea4918233727 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:45.939178 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 395/780] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:45.942945 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f062ea1-e120-416c-83ad-b7e0caa270d3 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:45.978168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:46.054092 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91967f53-9a34-4b63-89d2-ea4918233727 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:46.054642 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f062ea1-e120-416c-83ad-b7e0caa270d3 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:46.092532 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7e0de-9caf-455f-90fe-2837893479c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:46.093143 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5127c7c-a605-4154-838a-ca1ffb69041b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:46.093267 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7e0de-9caf-455f-90fe-2837893479c7 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:46.093436 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7e0de-9caf-455f-90fe-2837893479c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:46.093713 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7e0de-9caf-455f-90fe-2837893479c7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:46.093979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5127c7c-a605-4154-838a-ca1ffb69041b None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:46.094314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7e0de-9caf-455f-90fe-2837893479c7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:46.094416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5127c7c-a605-4154-838a-ca1ffb69041b None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:46.094722 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5127c7c-a605-4154-838a-ca1ffb69041b None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:46.095507 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5127c7c-a605-4154-838a-ca1ffb69041b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:46.095711 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7e0de-9caf-455f-90fe-2837893479c7 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:46.095942 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5127c7c-a605-4154-838a-ca1ffb69041b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:46.097522 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5127c7c-a605-4154-838a-ca1ffb69041b None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:46.104607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-16d7e0de-9caf-455f-90fe-2837893479c7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 07:56:46.104607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:46.104607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:56:46.104607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:56:46.104607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:56:46.104607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:56:46.104607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:56:46.104607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:56:46.104607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 07:56:46.104607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:46.104607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:56:46.104607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:46.104607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:46.104607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:46.104607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:46.104607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:46.104607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:46.105600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:46.105600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:46.105600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:46.105600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:46.105600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:46.105600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:46.105600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:56:46.105600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:56:46.105600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:56:46.105600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:56:46.105600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:46.105600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:46.105600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:46.105600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:46.105600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:46.105600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:46.106476 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:46.106476 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:46.106476 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:46.106476 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:46.106476 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:46.106476 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:46.106476 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:46.106476 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:46.106476 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:46.106476 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:46.106476 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:56:46.106476 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:56:46.106476 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 07:56:46.106476 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:46.106476 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 386/781] 10.222.0.57 () {56 vars in 1129 bytes} [Tue Aug 23 07:56:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:46.107268 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7e0de-9caf-455f-90fe-2837893479c7 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:46.123192 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 396/782] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Aug 23 07:56:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:46.124786 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354a131-77b4-4375-a626-6634b1833f0a None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:46.125073 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354a131-77b4-4375-a626-6634b1833f0a None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:46.125348 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354a131-77b4-4375-a626-6634b1833f0a None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:46.130321 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 397/783] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:46.130321 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354a131-77b4-4375-a626-6634b1833f0a None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:46.172931 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:46.219700 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7e0de-9caf-455f-90fe-2837893479c7 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:46.231568 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:46.245756 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354a131-77b4-4375-a626-6634b1833f0a None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:46.257419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9472329-3668-4dfc-9458-6a912201f5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:46.258028 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9472329-3668-4dfc-9458-6a912201f5a8 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:46.258327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9472329-3668-4dfc-9458-6a912201f5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:46.258603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9472329-3668-4dfc-9458-6a912201f5a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:46.259292 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9472329-3668-4dfc-9458-6a912201f5a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:46.259589 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9472329-3668-4dfc-9458-6a912201f5a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:46.261026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9472329-3668-4dfc-9458-6a912201f5a8 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:46.274063 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 387/784] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:56:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:46.275216 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9472329-3668-4dfc-9458-6a912201f5a8 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:46.290785 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d192c7-f8a9-4524-a43c-e8ab717c59bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:46.292715 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d192c7-f8a9-4524-a43c-e8ab717c59bd None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:46.293095 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d192c7-f8a9-4524-a43c-e8ab717c59bd None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:46.293752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d192c7-f8a9-4524-a43c-e8ab717c59bd None admin] PATH_INFO: `/v3/services` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:46.294766 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d192c7-f8a9-4524-a43c-e8ab717c59bd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:46.295174 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d192c7-f8a9-4524-a43c-e8ab717c59bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:46.297042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d192c7-f8a9-4524-a43c-e8ab717c59bd None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:46.307771 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 398/785] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Aug 23 07:56:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:46.307771 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022959d-d95f-4621-8e9e-f990463dbc0f None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:46.307771 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022959d-d95f-4621-8e9e-f990463dbc0f None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:46.307771 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022959d-d95f-4621-8e9e-f990463dbc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:46.330272 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-8022959d-d95f-4621-8e9e-f990463dbc0f None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:46.332023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-8022959d-d95f-4621-8e9e-f990463dbc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:46.380569 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9472329-3668-4dfc-9458-6a912201f5a8 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:46.398092 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:46.414404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 399/786] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:56:46.415300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022959d-d95f-4621-8e9e-f990463dbc0f None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:46.429964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba59ea-d80a-4d99-afb9-456c7b6fc92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:46.431392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba59ea-d80a-4d99-afb9-456c7b6fc92b None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:46.432023 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba59ea-d80a-4d99-afb9-456c7b6fc92b None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:46.432476 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba59ea-d80a-4d99-afb9-456c7b6fc92b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:46.445436 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba59ea-d80a-4d99-afb9-456c7b6fc92b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:46.447951 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba59ea-d80a-4d99-afb9-456c7b6fc92b None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:46.467514 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-36ba59ea-d80a-4d99-afb9-456c7b6fc92b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:46.467514 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:46.467514 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:46.467514 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:46.467514 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:46.467514 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:46.467514 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:46.467514 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:46.467514 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:46.467514 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:46.467514 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:46.467514 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:46.467514 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:46.467514 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:46.467514 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:46.467514 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:46.468597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:46.468597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:46.468597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:46.468597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:46.468597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:46.468597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:46.468597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:46.468597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:46.468597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:46.468597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:46.468597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:46.468597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:46.468597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:46.468597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:46.468597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:46.468597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:46.468597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:46.469497 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:46.469497 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:46.469497 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:46.476276 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 388/787] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:46.476276 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba59ea-d80a-4d99-afb9-456c7b6fc92b None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:46.512769 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:46.529635 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022959d-d95f-4621-8e9e-f990463dbc0f None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:46.564840 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbac17-7e1f-4718-8e9d-15dbb1e36941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:46.565836 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbac17-7e1f-4718-8e9d-15dbb1e36941 None admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:46.566353 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbac17-7e1f-4718-8e9d-15dbb1e36941 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:46.566827 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbac17-7e1f-4718-8e9d-15dbb1e36941 None admin] PATH_INFO: `/v3/projects/a80ab70ab6b9415c98017d05512c33eb/users/970300b51d504a2bbc48158855f02f34/roles/e005fb4b59104519a433fc31da70f47e` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:46.580368 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba59ea-d80a-4d99-afb9-456c7b6fc92b None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:46.582935 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dbac17-7e1f-4718-8e9d-15dbb1e36941 None admin] RBAC: Authorizing `identity:create_grant(project_id=a80ab70ab6b9415c98017d05512c33eb, user_id=970300b51d504a2bbc48158855f02f34, role_id=e005fb4b59104519a433fc31da70f47e)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:46.584594 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dbac17-7e1f-4718-8e9d-15dbb1e36941 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:46.615828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21ec21-9bd2-469b-9d1e-2149bcdf5420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:46.616452 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21ec21-9bd2-469b-9d1e-2149bcdf5420 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:46.616726 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21ec21-9bd2-469b-9d1e-2149bcdf5420 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:46.617000 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21ec21-9bd2-469b-9d1e-2149bcdf5420 None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:46.617623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21ec21-9bd2-469b-9d1e-2149bcdf5420 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:46.617932 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21ec21-9bd2-469b-9d1e-2149bcdf5420 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:46.619949 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21ec21-9bd2-469b-9d1e-2149bcdf5420 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:46.629787 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 389/788] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Aug 23 07:56:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:46.629787 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21ec21-9bd2-469b-9d1e-2149bcdf5420 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:46.669554 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 400/789] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 23 07:56:46 2022] PUT /identity/v3/projects/a80ab70ab6b9415c98017d05512c33eb/users/970300b51d504a2bbc48158855f02f34/roles/e005fb4b59104519a433fc31da70f47e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:56:46.671471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbac17-7e1f-4718-8e9d-15dbb1e36941 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:46.685101 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:46.772343 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21ec21-9bd2-469b-9d1e-2149bcdf5420 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:46.794758 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbac17-7e1f-4718-8e9d-15dbb1e36941 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:46.811923 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51050558-7854-405c-8bbc-6fbf0ba1617a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:46.812572 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51050558-7854-405c-8bbc-6fbf0ba1617a None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:46.812855 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51050558-7854-405c-8bbc-6fbf0ba1617a None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:46.813132 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51050558-7854-405c-8bbc-6fbf0ba1617a None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:46.814136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51050558-7854-405c-8bbc-6fbf0ba1617a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:46.814136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51050558-7854-405c-8bbc-6fbf0ba1617a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:46.815715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51050558-7854-405c-8bbc-6fbf0ba1617a None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:46.830878 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 390/790] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:46.834373 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51050558-7854-405c-8bbc-6fbf0ba1617a None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:46.839488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:46.845911 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29e67f-425a-4981-8722-2c6fff53182e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:46.846694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29e67f-425a-4981-8722-2c6fff53182e None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:46.847068 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29e67f-425a-4981-8722-2c6fff53182e None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:46.847451 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29e67f-425a-4981-8722-2c6fff53182e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:46.848287 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29e67f-425a-4981-8722-2c6fff53182e None admin] RBAC: Adding query filter params (interface=public, service_id=9fd64c62f88f4c51ba6c29d87310020f, region_id=RegionOne) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:46.848692 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29e67f-425a-4981-8722-2c6fff53182e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:46.850154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29e67f-425a-4981-8722-2c6fff53182e None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:46.856577 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 401/791] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Aug 23 07:56:46 2022] GET /identity/v3/endpoints?service_id=9fd64c62f88f4c51ba6c29d87310020f&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:46.857730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29e67f-425a-4981-8722-2c6fff53182e None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:46.935534 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:46.945080 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51050558-7854-405c-8bbc-6fbf0ba1617a None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:46.988180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c490b3c-f5db-485b-b000-e3c2d2483ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:46.989720 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c490b3c-f5db-485b-b000-e3c2d2483ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:46.990197 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c490b3c-f5db-485b-b000-e3c2d2483ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:46.990890 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c490b3c-f5db-485b-b000-e3c2d2483ad9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:46.996151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29e67f-425a-4981-8722-2c6fff53182e None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:47.006003 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c490b3c-f5db-485b-b000-e3c2d2483ad9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:47.013394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-3c490b3c-f5db-485b-b000-e3c2d2483ad9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:56:47.013394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:47.013394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:47.013394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:47.013394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:47.013394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:47.013394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:47.013394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:47.013394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:47.013394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:47.013394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:47.013394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:47.013394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:47.013394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:47.013394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:47.013394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:47.014525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:47.014525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:47.014525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:47.014525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:47.014525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:47.014525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:47.014525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:47.014525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:47.014525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:47.014525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:47.014525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:47.014525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:47.014525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:47.014525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:47.014525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:47.014525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:47.015560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:47.015560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:47.015560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:47.015560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:47.015560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:47.015560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:47.015560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:47.015560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:47.015560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:47.015560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:47.015560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:56:47.015560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:47.018188 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 391/792] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:56:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:47.023522 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c490b3c-f5db-485b-b000-e3c2d2483ad9 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:47.040183 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fc8a4-173d-435f-8bd6-05e6c6cc1103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:47.040950 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fc8a4-173d-435f-8bd6-05e6c6cc1103 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:47.041336 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fc8a4-173d-435f-8bd6-05e6c6cc1103 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:47.041898 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fc8a4-173d-435f-8bd6-05e6c6cc1103 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:47.049345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5fc8a4-173d-435f-8bd6-05e6c6cc1103 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:47.050960 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5fc8a4-173d-435f-8bd6-05e6c6cc1103 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:47.063612 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-2c5fc8a4-173d-435f-8bd6-05e6c6cc1103 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:47.063612 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:47.063612 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:47.063612 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:47.063612 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:47.063612 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:47.063612 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:47.063612 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:47.063612 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:47.063612 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:47.063612 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:47.063612 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:47.063612 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:56:47.063612 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:56:47.063612 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:56:47.065157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:56:47.065157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:47.065157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:47.065157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:47.065157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:47.065157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:47.065157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:47.065157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:47.065157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:47.065157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:47.065157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:47.065157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:47.065157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:47.065157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:47.065157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:47.065157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:47.065157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:47.066253 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:56:47.066253 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:56:47.066253 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:56:47.066253 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:56:47.066253 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:56:47.066253 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:56:47.066253 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:47.066253 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:47.067566 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 402/793] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:47.068518 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fc8a4-173d-435f-8bd6-05e6c6cc1103 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:47.129445 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:47.164377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c490b3c-f5db-485b-b000-e3c2d2483ad9 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:47.174902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fc8a4-173d-435f-8bd6-05e6c6cc1103 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:47.219298 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72dc00-4438-4a1d-8a7f-f4d61c8437ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:47.219916 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72dc00-4438-4a1d-8a7f-f4d61c8437ee None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:47.220462 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72dc00-4438-4a1d-8a7f-f4d61c8437ee None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:47.220462 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72dc00-4438-4a1d-8a7f-f4d61c8437ee None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:47.221635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb72dc00-4438-4a1d-8a7f-f4d61c8437ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:47.223047 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb72dc00-4438-4a1d-8a7f-f4d61c8437ee None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:47.223182 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9bc61-72aa-4150-8129-6842d3e5e250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:47.224257 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9bc61-72aa-4150-8129-6842d3e5e250 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:47.224685 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9bc61-72aa-4150-8129-6842d3e5e250 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:47.225529 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9bc61-72aa-4150-8129-6842d3e5e250 None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:47.226667 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9bc61-72aa-4150-8129-6842d3e5e250 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:47.227118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9bc61-72aa-4150-8129-6842d3e5e250 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:47.229227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9bc61-72aa-4150-8129-6842d3e5e250 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:47.233430 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 392/794] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Aug 23 07:56:47 2022] GET /identity/v3/services => generated 772 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:47.234569 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72dc00-4438-4a1d-8a7f-f4d61c8437ee None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:47.252210 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 403/795] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:56:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:47.261057 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9bc61-72aa-4150-8129-6842d3e5e250 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:47.276882 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:47.392194 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72dc00-4438-4a1d-8a7f-f4d61c8437ee None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:47.437137 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a5d47-a24b-45cf-a602-c4e77eeede20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:47.437768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a5d47-a24b-45cf-a602-c4e77eeede20 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:47.438050 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a5d47-a24b-45cf-a602-c4e77eeede20 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:47.438351 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a5d47-a24b-45cf-a602-c4e77eeede20 None admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:47.439060 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a5d47-a24b-45cf-a602-c4e77eeede20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:47.439369 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a5d47-a24b-45cf-a602-c4e77eeede20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:47.440982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a5d47-a24b-45cf-a602-c4e77eeede20 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:47.456236 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 393/796] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:56:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:47.462164 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a5d47-a24b-45cf-a602-c4e77eeede20 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:47.556998 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:47.572624 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9bc61-72aa-4150-8129-6842d3e5e250 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:47.584088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a5d47-a24b-45cf-a602-c4e77eeede20 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:47.591865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:47.610867 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962696f9-346f-46d1-a629-acabf97ab657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:47.611504 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962696f9-346f-46d1-a629-acabf97ab657 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:47.611784 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962696f9-346f-46d1-a629-acabf97ab657 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:47.612087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962696f9-346f-46d1-a629-acabf97ab657 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:47.630310 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962696f9-346f-46d1-a629-acabf97ab657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:47.630310 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962696f9-346f-46d1-a629-acabf97ab657 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:47.632447 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2c40f-3628-4774-8567-a4ed733e5862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:47.633351 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2c40f-3628-4774-8567-a4ed733e5862 None admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:47.633837 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2c40f-3628-4774-8567-a4ed733e5862 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:47.634359 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2c40f-3628-4774-8567-a4ed733e5862 None admin] PATH_INFO: `/v3/projects/a80ab70ab6b9415c98017d05512c33eb/users/b5c55e5c1cea47f29d378ea457384a31/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:47.644151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-962696f9-346f-46d1-a629-acabf97ab657 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:47.644151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:47.644151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:47.644151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:47.644151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:47.644151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:47.644151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:47.644151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:47.644151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:47.644151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:47.644151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:47.644151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:47.644151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:47.644151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:47.644151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:47.644151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:47.645101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:47.645101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:47.645101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:47.645101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:47.645101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:47.645101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:47.645101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:47.645101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:47.645101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:47.645101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:47.645101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:47.645101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:47.645101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:47.645101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:47.645101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:47.645101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:47.645101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:47.645993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:47.645993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:47.645993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:47.646164 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2c40f-3628-4774-8567-a4ed733e5862 None admin] RBAC: Authorizing `identity:create_grant(project_id=a80ab70ab6b9415c98017d05512c33eb, user_id=b5c55e5c1cea47f29d378ea457384a31, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:47.650113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2c40f-3628-4774-8567-a4ed733e5862 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:47.652135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 404/797] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:47.656291 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962696f9-346f-46d1-a629-acabf97ab657 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:47.721851 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 394/798] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 23 07:56:47 2022] PUT /identity/v3/projects/a80ab70ab6b9415c98017d05512c33eb/users/b5c55e5c1cea47f29d378ea457384a31/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 07:56:47.723544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995d57f-f47a-44b6-be38-65bb5d89ec24 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:47.724019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995d57f-f47a-44b6-be38-65bb5d89ec24 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:47.724511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995d57f-f47a-44b6-be38-65bb5d89ec24 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:47.725965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 395/799] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:47.737611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b48ca-3bcc-407c-aaca-911655ec0b1a None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:47.738231 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b48ca-3bcc-407c-aaca-911655ec0b1a None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:47.738716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b48ca-3bcc-407c-aaca-911655ec0b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:47.761453 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-397b48ca-3bcc-407c-aaca-911655ec0b1a None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:47.763643 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-397b48ca-3bcc-407c-aaca-911655ec0b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:47.851624 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962696f9-346f-46d1-a629-acabf97ab657 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:47.886761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 396/800] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:56:47.903379 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902455a-d882-45b4-b4b7-2ed486764cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:47.904020 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902455a-d882-45b4-b4b7-2ed486764cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:47.904303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902455a-d882-45b4-b4b7-2ed486764cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:47.904578 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902455a-d882-45b4-b4b7-2ed486764cb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:47.905241 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902455a-d882-45b4-b4b7-2ed486764cb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:47.905548 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902455a-d882-45b4-b4b7-2ed486764cb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:47.907084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902455a-d882-45b4-b4b7-2ed486764cb3 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:47.921276 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 405/801] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:56:47.926880 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b48ca-3bcc-407c-aaca-911655ec0b1a None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:48.006443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:48.056546 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b48ca-3bcc-407c-aaca-911655ec0b1a None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:48.108475 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbedc03-603c-4523-b499-28352a2ea7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:48.109073 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbedc03-603c-4523-b499-28352a2ea7b4 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:48.109399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbedc03-603c-4523-b499-28352a2ea7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:48.109671 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbedc03-603c-4523-b499-28352a2ea7b4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:48.120105 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbedc03-603c-4523-b499-28352a2ea7b4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:48.121514 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbedc03-603c-4523-b499-28352a2ea7b4 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:48.135610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-1bbedc03-603c-4523-b499-28352a2ea7b4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 07:56:48.135610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:48.135610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:48.135610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:48.135610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:48.135610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:48.135610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:48.135610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:48.135610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:48.135610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:48.135610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:48.135610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:48.135610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:56:48.135610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:56:48.135610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:56:48.135610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:56:48.136580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:48.136580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:48.136580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:56:48.136580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:48.136580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:56:48.136580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:48.136580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:48.136580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:48.136580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:48.136580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:48.136580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:48.136580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:48.136580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:48.136580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:48.136580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:48.136580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:48.136580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:48.136580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:48.137521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:48.137521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:48.137521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:56:48.137521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:56:48.137521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:56:48.137521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:56:48.137521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:56:48.137521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:56:48.137521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 07:56:48.137521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:48.137521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 397/802] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:56:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:48.142355 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902455a-d882-45b4-b4b7-2ed486764cb3 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:48.178890 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:48.227032 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbedc03-603c-4523-b499-28352a2ea7b4 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:48.251134 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902455a-d882-45b4-b4b7-2ed486764cb3 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:48.298882 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84402e77-fcae-451e-8d03-0e043a25e715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:48.299495 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84402e77-fcae-451e-8d03-0e043a25e715 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:48.299776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84402e77-fcae-451e-8d03-0e043a25e715 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:48.300086 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84402e77-fcae-451e-8d03-0e043a25e715 None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:48.300814 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84402e77-fcae-451e-8d03-0e043a25e715 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:48.301116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84402e77-fcae-451e-8d03-0e043a25e715 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:48.309328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84402e77-fcae-451e-8d03-0e043a25e715 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:48.330437 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 406/803] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Aug 23 07:56:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:48.343391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84402e77-fcae-451e-8d03-0e043a25e715 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:48.381019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbedc03-603c-4523-b499-28352a2ea7b4 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:48.431244 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:48.442889 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13df11b-0292-492a-b87f-78def7e5602e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:48.443523 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13df11b-0292-492a-b87f-78def7e5602e None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:48.443804 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13df11b-0292-492a-b87f-78def7e5602e None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:48.444079 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13df11b-0292-492a-b87f-78def7e5602e None admin] PATH_INFO: `/v3/services/network` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:48.444662 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13df11b-0292-492a-b87f-78def7e5602e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:48.446055 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13df11b-0292-492a-b87f-78def7e5602e None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:48.458796 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:48.468071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-b13df11b-0292-492a-b87f-78def7e5602e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 07:56:48.468071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:48.468071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:56:48.468071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:56:48.468071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:56:48.468071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:56:48.468071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:56:48.468071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:56:48.468071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 07:56:48.468071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:48.468071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:56:48.468071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:48.468071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:48.468071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:48.468071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:48.468071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:48.468071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:48.469088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:48.469088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:48.469088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:48.469088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:48.469088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:48.469088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:48.469088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:56:48.469088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:56:48.469088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:56:48.469088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:56:48.469088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:48.469088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:48.469088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:48.469088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:48.469088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:48.469088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:48.469940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:48.469940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:48.469940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:48.469940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:48.469940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:48.469940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:48.469940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:48.469940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:48.469940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:48.469940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:48.469940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:56:48.469940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:56:48.469940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 07:56:48.469940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:48.472798 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84402e77-fcae-451e-8d03-0e043a25e715 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:48.478961 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 398/804] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:48 2022] GET /identity/v3/services/network => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:48.485834 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13df11b-0292-492a-b87f-78def7e5602e None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:48.507833 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482db0c-53b1-44c0-a771-4910e2878a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:48.508474 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482db0c-53b1-44c0-a771-4910e2878a30 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:48.508755 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482db0c-53b1-44c0-a771-4910e2878a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:48.509031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482db0c-53b1-44c0-a771-4910e2878a30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:48.520659 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482db0c-53b1-44c0-a771-4910e2878a30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:48.522179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482db0c-53b1-44c0-a771-4910e2878a30 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:48.539208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-4482db0c-53b1-44c0-a771-4910e2878a30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:48.539208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:48.539208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:48.539208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:48.539208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:48.539208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:48.539208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:48.539208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:48.539208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:48.539208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:48.539208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:48.539208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:48.539208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:48.539208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:48.539208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:48.539208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:48.540211 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:48.540211 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:48.540211 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:48.540211 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:48.540211 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:48.540211 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:48.540211 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:48.540211 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:48.540211 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:48.540211 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:48.540211 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:48.540211 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:48.540211 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:48.540211 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:48.540211 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:48.540211 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:48.540211 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:48.541206 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:48.541206 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:48.541206 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:48.541206 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 407/805] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:48.559986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482db0c-53b1-44c0-a771-4910e2878a30 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:48.641327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13df11b-0292-492a-b87f-78def7e5602e None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:48.696892 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482db0c-53b1-44c0-a771-4910e2878a30 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:48.719929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec33b2c-0387-4ac0-890b-827eaa5688b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:48.720617 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec33b2c-0387-4ac0-890b-827eaa5688b0 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:48.720898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec33b2c-0387-4ac0-890b-827eaa5688b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:48.721164 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec33b2c-0387-4ac0-890b-827eaa5688b0 None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:48.721844 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec33b2c-0387-4ac0-890b-827eaa5688b0 None admin] RBAC: Adding query filter params (name=network) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:48.722148 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec33b2c-0387-4ac0-890b-827eaa5688b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:48.723613 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec33b2c-0387-4ac0-890b-827eaa5688b0 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:48.737361 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 399/806] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 23 07:56:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:56:48.739812 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d1021-4080-428b-b3ae-1cf9ef8aca7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:48.740425 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d1021-4080-428b-b3ae-1cf9ef8aca7e None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:48.740702 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d1021-4080-428b-b3ae-1cf9ef8aca7e None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:48.741031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d1021-4080-428b-b3ae-1cf9ef8aca7e None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:48.741668 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d1021-4080-428b-b3ae-1cf9ef8aca7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:48.741965 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d1021-4080-428b-b3ae-1cf9ef8aca7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:48.743534 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d1021-4080-428b-b3ae-1cf9ef8aca7e None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:48.744669 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec33b2c-0387-4ac0-890b-827eaa5688b0 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:48.770825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:48.777448 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 408/807] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:56:48.786125 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d1021-4080-428b-b3ae-1cf9ef8aca7e None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:48.827949 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:48.906792 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec33b2c-0387-4ac0-890b-827eaa5688b0 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:48.945790 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d1021-4080-428b-b3ae-1cf9ef8aca7e None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:48.985541 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f4d6c-da67-48eb-b6e6-4170bbfb3e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:48.986737 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f4d6c-da67-48eb-b6e6-4170bbfb3e5b None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:48.987019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f4d6c-da67-48eb-b6e6-4170bbfb3e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:48.987294 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f4d6c-da67-48eb-b6e6-4170bbfb3e5b None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:48.987924 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f4d6c-da67-48eb-b6e6-4170bbfb3e5b None admin] RBAC: Adding query filter params (type=network) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:48.988227 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f4d6c-da67-48eb-b6e6-4170bbfb3e5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:48.989612 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f4d6c-da67-48eb-b6e6-4170bbfb3e5b None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:48.991254 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1df81-ed00-4bc5-baae-ca34428170e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:48.991935 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1df81-ed00-4bc5-baae-ca34428170e9 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:48.992205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1df81-ed00-4bc5-baae-ca34428170e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:48.992470 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1df81-ed00-4bc5-baae-ca34428170e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:49.003780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1df81-ed00-4bc5-baae-ca34428170e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:49.005235 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1df81-ed00-4bc5-baae-ca34428170e9 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:49.005658 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 400/808] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 23 07:56:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:56:49.007971 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f4d6c-da67-48eb-b6e6-4170bbfb3e5b None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:49.022801 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-19b1df81-ed00-4bc5-baae-ca34428170e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:49.022801 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:49.022801 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:49.022801 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:49.022801 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:49.022801 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:49.022801 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:49.022801 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:49.022801 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:49.022801 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:49.022801 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:49.022801 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:49.022801 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:56:49.022801 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:56:49.022801 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:56:49.023730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:56:49.023730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:49.023730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:49.023730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:49.023730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:49.023730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:49.023730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:49.023730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:49.023730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:49.023730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:49.023730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:49.023730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:49.023730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:49.023730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:49.023730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:49.023730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:49.023730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:49.024653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:56:49.024653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:56:49.024653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:56:49.024653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:56:49.024653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:56:49.024653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:56:49.024653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:49.024653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:49.024653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 409/809] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:49.029979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077f7e3-c3f3-4c88-90bf-033bd773d70b None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:49.030269 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077f7e3-c3f3-4c88-90bf-033bd773d70b None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:49.030594 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077f7e3-c3f3-4c88-90bf-033bd773d70b None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:49.032191 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 410/810] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:56:49.032896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077f7e3-c3f3-4c88-90bf-033bd773d70b None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:49.114822 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f4d6c-da67-48eb-b6e6-4170bbfb3e5b None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:49.118538 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:49.132504 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:49.155824 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96840549-74ea-4156-8046-a1fcd7518fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:49.156579 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96840549-74ea-4156-8046-a1fcd7518fe8 None admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:49.156982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96840549-74ea-4156-8046-a1fcd7518fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:49.157274 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96840549-74ea-4156-8046-a1fcd7518fe8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:49.158016 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96840549-74ea-4156-8046-a1fcd7518fe8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:49.159570 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96840549-74ea-4156-8046-a1fcd7518fe8 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:49.171701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077f7e3-c3f3-4c88-90bf-033bd773d70b None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:49.204607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a6007-711e-4f6a-9009-768bb1dfe043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:49.205209 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a6007-711e-4f6a-9009-768bb1dfe043 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:49.205483 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a6007-711e-4f6a-9009-768bb1dfe043 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:49.205751 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a6007-711e-4f6a-9009-768bb1dfe043 None admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:49.210500 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a6007-711e-4f6a-9009-768bb1dfe043 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:49.210500 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a6007-711e-4f6a-9009-768bb1dfe043 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:49.210500 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a6007-711e-4f6a-9009-768bb1dfe043 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:49.222100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 411/811] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:56:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:49.223335 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c4653-b23d-462c-8eda-da6d7ca9a5f3 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:49.223617 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c4653-b23d-462c-8eda-da6d7ca9a5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:49.223889 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c4653-b23d-462c-8eda-da6d7ca9a5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:49.243442 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-e37c4653-b23d-462c-8eda-da6d7ca9a5f3 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:49.244851 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-e37c4653-b23d-462c-8eda-da6d7ca9a5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:49.272413 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 401/812] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 07:56:49 2022] POST /identity/v3/endpoints => generated 337 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 07:56:49.274016 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96840549-74ea-4156-8046-a1fcd7518fe8 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:49.392145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 412/813] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:49 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:56:49.407072 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96840549-74ea-4156-8046-a1fcd7518fe8 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:49.449478 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf59a2c-6708-499b-98e6-c6ad4c601d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:49.450562 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf59a2c-6708-499b-98e6-c6ad4c601d30 None admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:49.451086 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf59a2c-6708-499b-98e6-c6ad4c601d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:49.451587 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf59a2c-6708-499b-98e6-c6ad4c601d30 None admin] PATH_INFO: `/v3/projects/a80ab70ab6b9415c98017d05512c33eb/users/4718cad0c0b9461d9c4152d7ea4b385d/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:49.453954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf59a2c-6708-499b-98e6-c6ad4c601d30 None admin] RBAC: Authorizing `identity:create_grant(project_id=a80ab70ab6b9415c98017d05512c33eb, user_id=4718cad0c0b9461d9c4152d7ea4b385d, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:49.455744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf59a2c-6708-499b-98e6-c6ad4c601d30 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:49.515113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 402/814] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 23 07:56:49 2022] PUT /identity/v3/projects/a80ab70ab6b9415c98017d05512c33eb/users/4718cad0c0b9461d9c4152d7ea4b385d/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:56:49.711932 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c4653-b23d-462c-8eda-da6d7ca9a5f3 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:49.761007 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:49.780950 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e398d-3afd-43a0-acd6-cbcb22834331 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:49.781243 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e398d-3afd-43a0-acd6-cbcb22834331 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:49.781522 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e398d-3afd-43a0-acd6-cbcb22834331 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:49.783185 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 403/815] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:49.793411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e036c-82d5-4068-9454-f48c95a2d44a None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:49.793831 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e036c-82d5-4068-9454-f48c95a2d44a None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:49.794879 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e036c-82d5-4068-9454-f48c95a2d44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:49.817570 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-da1e036c-82d5-4068-9454-f48c95a2d44a None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:49.818816 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-da1e036c-82d5-4068-9454-f48c95a2d44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:49.823437 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c4653-b23d-462c-8eda-da6d7ca9a5f3 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:49.857196 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:49.860367 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f93893-3904-4a65-80a6-623af57f97a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:49.861238 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f93893-3904-4a65-80a6-623af57f97a4 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:49.861703 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f93893-3904-4a65-80a6-623af57f97a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:49.862146 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f93893-3904-4a65-80a6-623af57f97a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:49.873570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f93893-3904-4a65-80a6-623af57f97a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:49.879302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-75f93893-3904-4a65-80a6-623af57f97a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:49.879302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:49.879302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:49.879302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:49.879302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:49.879302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:49.879302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:49.879302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:49.879302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:49.879302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:49.879302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:49.879302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:49.879302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:49.879302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:49.879302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:49.879302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:49.880266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:49.880266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:49.880266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:49.880266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:49.880266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:49.880266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:49.880266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:49.880266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:49.880266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:49.880266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:49.880266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:49.880266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:49.880266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:49.880266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:49.880266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:49.880266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:49.881154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:49.881154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:49.881154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:49.881154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:49.881154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:49.881154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:49.881154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:49.881154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:49.881154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:49.881154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:49.881154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:56:49.881154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:49.888545 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 413/816] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 23 07:56:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:49.890508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f93893-3904-4a65-80a6-623af57f97a4 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:49.896069 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 404/817] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:49 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:56:50.001928 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f93893-3904-4a65-80a6-623af57f97a4 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:50.009372 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:50.037127 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bc614-03ee-4baa-bba1-52f4c65ef469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:50.038098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bc614-03ee-4baa-bba1-52f4c65ef469 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:50.038601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bc614-03ee-4baa-bba1-52f4c65ef469 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:50.039069 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bc614-03ee-4baa-bba1-52f4c65ef469 None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:50.039934 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bc614-03ee-4baa-bba1-52f4c65ef469 None admin] RBAC: Adding query filter params (name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:50.040463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bc614-03ee-4baa-bba1-52f4c65ef469 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:50.042759 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bc614-03ee-4baa-bba1-52f4c65ef469 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:50.056162 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 414/818] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 23 07:56:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:56:50.057867 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e036c-82d5-4068-9454-f48c95a2d44a None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:50.141499 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cff499-c67f-475a-8a5f-65cbb95058f7 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:50.141854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cff499-c67f-475a-8a5f-65cbb95058f7 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:50.142057 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cff499-c67f-475a-8a5f-65cbb95058f7 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:50.143693 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 415/819] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:50.148618 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9c784-19b6-4985-a72e-f0c3cb70c8d7 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:50.148911 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9c784-19b6-4985-a72e-f0c3cb70c8d7 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:50.149197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9c784-19b6-4985-a72e-f0c3cb70c8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:50.172187 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e036c-82d5-4068-9454-f48c95a2d44a None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:50.173422 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-a2c9c784-19b6-4985-a72e-f0c3cb70c8d7 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:50.175598 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-a2c9c784-19b6-4985-a72e-f0c3cb70c8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:50.211506 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882ade5-4f1a-4550-b455-272210c00fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:50.212308 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882ade5-4f1a-4550-b455-272210c00fac None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:50.213990 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882ade5-4f1a-4550-b455-272210c00fac None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:50.214314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882ade5-4f1a-4550-b455-272210c00fac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:50.225200 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9882ade5-4f1a-4550-b455-272210c00fac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:50.227057 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9882ade5-4f1a-4550-b455-272210c00fac None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:50.242991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-9882ade5-4f1a-4550-b455-272210c00fac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:50.242991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:50.242991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:50.242991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:50.242991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:50.242991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:50.242991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:50.242991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:50.242991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:50.242991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:50.242991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:50.242991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:50.242991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:50.242991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:50.242991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:50.242991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:50.244487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:50.244487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:50.244487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:50.244487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:50.244487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:50.244487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:50.244487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:50.244487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:50.244487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:50.244487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:50.244487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:50.244487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:50.244487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:50.244487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:50.244487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:50.244487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:50.244487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:50.245411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:50.245411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:50.245411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:50.245411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 405/820] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:50.245411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882ade5-4f1a-4550-b455-272210c00fac None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:50.257700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 416/821] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:56:50.258927 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9c784-19b6-4985-a72e-f0c3cb70c8d7 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:50.265581 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:50.364120 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882ade5-4f1a-4550-b455-272210c00fac None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:50.374658 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:50.378840 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9c784-19b6-4985-a72e-f0c3cb70c8d7 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:50.403415 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c9d44-19e0-40c5-9820-f826cd42eca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:50.404056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c9d44-19e0-40c5-9820-f826cd42eca6 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:50.404342 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c9d44-19e0-40c5-9820-f826cd42eca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:50.404908 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c9d44-19e0-40c5-9820-f826cd42eca6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:50.405292 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c9d44-19e0-40c5-9820-f826cd42eca6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:50.406722 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c9d44-19e0-40c5-9820-f826cd42eca6 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:50.417708 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31950b90-256e-4fed-9d63-784601636930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:50.418165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-739c9d44-19e0-40c5-9820-f826cd42eca6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 07:56:50.418165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:50.418165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:56:50.418165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:56:50.418165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:56:50.418165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:56:50.418165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:56:50.418165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:56:50.418165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 07:56:50.418165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:50.418165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:56:50.418165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:50.418165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:50.418165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:50.418165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:50.418165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:50.418165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:50.419183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:50.419183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:50.419183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:50.419183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:50.419183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:50.419183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:50.419183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:56:50.419183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:56:50.419183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:56:50.419183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:56:50.419183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:50.419183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:50.419183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:50.419183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:50.419183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:50.419183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:50.420021 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:50.420021 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:50.420021 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:50.420021 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:50.420021 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:50.420021 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:50.420021 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:50.420021 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:50.420021 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:50.420021 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:50.420021 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:56:50.420021 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:56:50.420021 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 07:56:50.420021 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:50.421719 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31950b90-256e-4fed-9d63-784601636930 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:50.422253 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31950b90-256e-4fed-9d63-784601636930 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:50.422748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31950b90-256e-4fed-9d63-784601636930 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:50.423589 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31950b90-256e-4fed-9d63-784601636930 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:50.424186 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 406/822] 10.222.0.57 () {56 vars in 1129 bytes} [Tue Aug 23 07:56:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:50.424595 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31950b90-256e-4fed-9d63-784601636930 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:50.425014 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c9d44-19e0-40c5-9820-f826cd42eca6 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:50.426439 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31950b90-256e-4fed-9d63-784601636930 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:50.440100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 417/823] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:50.445157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31950b90-256e-4fed-9d63-784601636930 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:50.515906 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:50.537094 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c9d44-19e0-40c5-9820-f826cd42eca6 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:50.555320 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31950b90-256e-4fed-9d63-784601636930 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:50.574858 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc4511-e95f-4d30-b93c-b1d6b9b3e5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:50.575475 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc4511-e95f-4d30-b93c-b1d6b9b3e5a9 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:50.575753 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc4511-e95f-4d30-b93c-b1d6b9b3e5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:50.576025 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc4511-e95f-4d30-b93c-b1d6b9b3e5a9 None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:50.576655 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc4511-e95f-4d30-b93c-b1d6b9b3e5a9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:50.576957 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc4511-e95f-4d30-b93c-b1d6b9b3e5a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:50.578473 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc4511-e95f-4d30-b93c-b1d6b9b3e5a9 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:50.583525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 407/824] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Aug 23 07:56:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:50.584124 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc4511-e95f-4d30-b93c-b1d6b9b3e5a9 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:50.596741 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33afb8e-aa91-4839-8ba5-17881ee0b9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:50.597379 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33afb8e-aa91-4839-8ba5-17881ee0b9c7 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:50.597660 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33afb8e-aa91-4839-8ba5-17881ee0b9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:50.597987 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33afb8e-aa91-4839-8ba5-17881ee0b9c7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:50.607198 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33afb8e-aa91-4839-8ba5-17881ee0b9c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:50.608641 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33afb8e-aa91-4839-8ba5-17881ee0b9c7 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:50.619999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-b33afb8e-aa91-4839-8ba5-17881ee0b9c7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 07:56:50.619999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:50.619999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:50.619999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:50.619999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:50.619999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:50.619999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:50.619999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:50.619999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:50.619999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:50.619999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:50.619999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:50.619999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:56:50.619999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:56:50.619999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:56:50.619999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:56:50.620967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:50.620967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:50.620967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:56:50.620967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:50.620967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:56:50.620967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:50.620967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:50.620967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:50.620967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:50.620967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:50.620967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:50.620967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:50.620967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:50.620967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:50.620967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:50.620967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:50.620967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:50.620967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:50.621912 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:50.621912 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:50.621912 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:56:50.621912 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:56:50.621912 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:56:50.621912 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:56:50.621912 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:56:50.621912 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:56:50.621912 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 07:56:50.621912 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:50.621912 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 418/825] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 23 07:56:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:50.621912 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33afb8e-aa91-4839-8ba5-17881ee0b9c7 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:50.641882 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:50.713267 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc4511-e95f-4d30-b93c-b1d6b9b3e5a9 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:50.728620 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33afb8e-aa91-4839-8ba5-17881ee0b9c7 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:50.753375 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d63488-9c93-4723-8a54-7af34b9eb7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:50.754030 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d63488-9c93-4723-8a54-7af34b9eb7d8 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:50.754330 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d63488-9c93-4723-8a54-7af34b9eb7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:50.754610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d63488-9c93-4723-8a54-7af34b9eb7d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:50.765098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d63488-9c93-4723-8a54-7af34b9eb7d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:50.765323 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896640a-c962-4153-9770-2fa88f07b1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:50.766134 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896640a-c962-4153-9770-2fa88f07b1b2 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:50.766597 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896640a-c962-4153-9770-2fa88f07b1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:50.767044 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896640a-c962-4153-9770-2fa88f07b1b2 None admin] PATH_INFO: `/v3/services` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:50.767811 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896640a-c962-4153-9770-2fa88f07b1b2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:50.768258 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896640a-c962-4153-9770-2fa88f07b1b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:50.769884 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896640a-c962-4153-9770-2fa88f07b1b2 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:50.770189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-88d63488-9c93-4723-8a54-7af34b9eb7d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:56:50.770189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:50.770189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:50.770189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:50.770189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:50.770189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:50.770189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:50.770189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:50.770189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:50.770189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:50.770189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:50.770189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:50.770189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:50.770189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:50.770189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:50.770189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:50.771298 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:50.771298 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:50.771298 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:50.771298 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:50.771298 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:50.771298 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:50.771298 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:50.771298 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:50.771298 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:50.771298 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:50.771298 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:50.771298 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:50.771298 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:50.771298 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:50.771298 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:50.771298 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:50.777590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:50.777590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:50.777590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:50.777590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:50.777590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:50.777590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:50.777590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:50.777590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:50.777590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:50.777590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:50.777590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:56:50.777590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:50.777590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 408/826] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:56:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:50.777590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d63488-9c93-4723-8a54-7af34b9eb7d8 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:50.779879 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:50.786599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 419/827] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Aug 23 07:56:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:50.786599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896640a-c962-4153-9770-2fa88f07b1b2 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:50.867050 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:50.882639 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d63488-9c93-4723-8a54-7af34b9eb7d8 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:50.885179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896640a-c962-4153-9770-2fa88f07b1b2 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:50.919334 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60695a-be4b-4e07-9d53-838e56324818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:50.919982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60695a-be4b-4e07-9d53-838e56324818 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:50.920210 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60695a-be4b-4e07-9d53-838e56324818 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:50.920481 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60695a-be4b-4e07-9d53-838e56324818 None admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:50.920583 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0f6c6-0b6a-4fae-844b-abe1825a43bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:50.921185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0f6c6-0b6a-4fae-844b-abe1825a43bb None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:50.921284 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60695a-be4b-4e07-9d53-838e56324818 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:50.921464 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0f6c6-0b6a-4fae-844b-abe1825a43bb None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:50.921570 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60695a-be4b-4e07-9d53-838e56324818 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:50.921735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0f6c6-0b6a-4fae-844b-abe1825a43bb None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:50.922424 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0f6c6-0b6a-4fae-844b-abe1825a43bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:50.922731 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0f6c6-0b6a-4fae-844b-abe1825a43bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:50.922928 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60695a-be4b-4e07-9d53-838e56324818 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:50.924091 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0f6c6-0b6a-4fae-844b-abe1825a43bb None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:50.933380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 420/828] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:56:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:50.933921 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0f6c6-0b6a-4fae-844b-abe1825a43bb None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:50.946145 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 409/829] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Aug 23 07:56:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:50.947213 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60695a-be4b-4e07-9d53-838e56324818 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:51.008582 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:51.044036 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0f6c6-0b6a-4fae-844b-abe1825a43bb None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:51.049010 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60695a-be4b-4e07-9d53-838e56324818 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:51.079321 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b3f50-09c8-48ac-856b-4efa440cb6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:51.079925 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b3f50-09c8-48ac-856b-4efa440cb6f7 None admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:51.080207 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b3f50-09c8-48ac-856b-4efa440cb6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:51.080486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b3f50-09c8-48ac-856b-4efa440cb6f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:51.081137 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b3f50-09c8-48ac-856b-4efa440cb6f7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:51.082641 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b3f50-09c8-48ac-856b-4efa440cb6f7 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:51.085340 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292aa2de-0412-469f-b471-176ae6cb63de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:51.085958 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292aa2de-0412-469f-b471-176ae6cb63de None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:51.086240 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292aa2de-0412-469f-b471-176ae6cb63de None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:51.086563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292aa2de-0412-469f-b471-176ae6cb63de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:51.097643 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292aa2de-0412-469f-b471-176ae6cb63de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:51.099109 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292aa2de-0412-469f-b471-176ae6cb63de None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:51.113850 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-292aa2de-0412-469f-b471-176ae6cb63de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:51.113850 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:51.113850 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:51.113850 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:51.113850 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:51.113850 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:51.113850 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:51.113850 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:51.113850 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:51.113850 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:51.113850 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:51.113850 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:51.113850 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:51.113850 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:51.113850 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:51.113850 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:51.114862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:51.114862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:51.114862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:51.114862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:51.114862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:51.114862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:51.114862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:51.114862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:51.114862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:51.114862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:51.114862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:51.114862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:51.114862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:51.114862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:51.114862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:51.114862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:51.114862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:51.115753 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:51.115753 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:51.115753 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:51.115753 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 410/830] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:51.115753 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292aa2de-0412-469f-b471-176ae6cb63de None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:51.155258 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:51.161296 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 421/831] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 07:56:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:56:51.162418 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b3f50-09c8-48ac-856b-4efa440cb6f7 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:51.252488 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292aa2de-0412-469f-b471-176ae6cb63de None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:51.269990 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:51.296862 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b3f50-09c8-48ac-856b-4efa440cb6f7 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:51.298699 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4639a35-c1f4-4336-87ec-c45bb5609212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:51.299754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4639a35-c1f4-4336-87ec-c45bb5609212 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:51.300117 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4639a35-c1f4-4336-87ec-c45bb5609212 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:51.300462 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4639a35-c1f4-4336-87ec-c45bb5609212 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:51.337470 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c1752-17c7-4b5a-aa0c-614c70a2f94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:51.338622 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c1752-17c7-4b5a-aa0c-614c70a2f94b None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:51.338899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c1752-17c7-4b5a-aa0c-614c70a2f94b None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:51.339279 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c1752-17c7-4b5a-aa0c-614c70a2f94b None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:51.340974 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c1752-17c7-4b5a-aa0c-614c70a2f94b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:51.340974 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c1752-17c7-4b5a-aa0c-614c70a2f94b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:51.341455 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c1752-17c7-4b5a-aa0c-614c70a2f94b None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:51.356196 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 422/832] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:51.361367 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c1752-17c7-4b5a-aa0c-614c70a2f94b None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:51.388016 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4639a35-c1f4-4336-87ec-c45bb5609212 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:51.389800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4639a35-c1f4-4336-87ec-c45bb5609212 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:51.435695 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:51.497601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c1752-17c7-4b5a-aa0c-614c70a2f94b None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:51.502357 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 411/833] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:56:51 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:56:51.510929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4639a35-c1f4-4336-87ec-c45bb5609212 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:51.533028 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:51.539142 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733b414-a179-42ef-9898-b241d4fd7835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:51.539786 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733b414-a179-42ef-9898-b241d4fd7835 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:51.540066 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733b414-a179-42ef-9898-b241d4fd7835 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:51.540395 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733b414-a179-42ef-9898-b241d4fd7835 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:51.548307 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733b414-a179-42ef-9898-b241d4fd7835 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:51.549692 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733b414-a179-42ef-9898-b241d4fd7835 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:51.562376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-7733b414-a179-42ef-9898-b241d4fd7835 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:56:51.562376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:51.562376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:51.562376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:51.562376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:51.562376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:51.562376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:51.562376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:51.562376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:51.562376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:51.562376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:51.562376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:51.562376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:56:51.562376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:56:51.562376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:56:51.562376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:56:51.563383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:51.563383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:51.563383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:56:51.563383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:51.563383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:56:51.563383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:51.563383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:51.563383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:51.563383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:51.563383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:51.563383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:51.563383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:51.563383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:51.563383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:51.563383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:51.563383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:51.563383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:51.563383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:51.564791 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:51.564791 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:51.564791 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:56:51.564791 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:56:51.564791 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:56:51.564791 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:56:51.564791 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:56:51.564791 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:56:51.564791 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:56:51.564791 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:51.564791 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 423/834] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Aug 23 07:56:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:51.569311 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733b414-a179-42ef-9898-b241d4fd7835 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:51.637300 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4639a35-c1f4-4336-87ec-c45bb5609212 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:51.678312 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d274fc2-8a32-431f-bab6-a3b9bd7d19cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:51.679197 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d274fc2-8a32-431f-bab6-a3b9bd7d19cd None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:51.679479 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d274fc2-8a32-431f-bab6-a3b9bd7d19cd None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:51.679744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d274fc2-8a32-431f-bab6-a3b9bd7d19cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:51.690768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d274fc2-8a32-431f-bab6-a3b9bd7d19cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:51.692214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d274fc2-8a32-431f-bab6-a3b9bd7d19cd None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:51.699087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733b414-a179-42ef-9898-b241d4fd7835 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:51.707468 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-4d274fc2-8a32-431f-bab6-a3b9bd7d19cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:51.707468 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:51.707468 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:51.707468 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:51.707468 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:51.707468 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:51.707468 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:51.707468 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:51.707468 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:51.707468 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:51.707468 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:51.707468 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:51.707468 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:51.707468 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:51.707468 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:51.707468 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:51.708421 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:51.708421 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:51.708421 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:51.708421 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:51.708421 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:51.708421 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:51.708421 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:51.708421 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:51.708421 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:51.708421 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:51.708421 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:51.708421 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:51.708421 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:51.708421 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:51.708421 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:51.708421 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:51.708421 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:51.709311 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:51.709311 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:51.709311 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:51.713198 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 412/835] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:51.714547 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7a438-2cc3-4c84-989f-9a8c8eed851d None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:51.714836 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7a438-2cc3-4c84-989f-9a8c8eed851d None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:51.715112 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7a438-2cc3-4c84-989f-9a8c8eed851d None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:51.716517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 413/836] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:51.717066 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7a438-2cc3-4c84-989f-9a8c8eed851d None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:51.720640 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:51.739193 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a06889-dba1-493d-9ac7-d39607addb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:51.739802 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a06889-dba1-493d-9ac7-d39607addb17 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:51.740082 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a06889-dba1-493d-9ac7-d39607addb17 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:51.740348 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a06889-dba1-493d-9ac7-d39607addb17 None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:51.741063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a06889-dba1-493d-9ac7-d39607addb17 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:51.741361 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a06889-dba1-493d-9ac7-d39607addb17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:51.742901 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a06889-dba1-493d-9ac7-d39607addb17 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:51.761399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 424/837] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Aug 23 07:56:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:51.762666 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7457aef-c308-4f7a-b9fd-496d4a28db62 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:51.762953 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7457aef-c308-4f7a-b9fd-496d4a28db62 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:51.763226 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7457aef-c308-4f7a-b9fd-496d4a28db62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:51.782053 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-d7457aef-c308-4f7a-b9fd-496d4a28db62 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:51.783378 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-d7457aef-c308-4f7a-b9fd-496d4a28db62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:51.787964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:51.824368 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7a438-2cc3-4c84-989f-9a8c8eed851d None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:51.853035 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 425/838] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:51 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:56:51.853944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7457aef-c308-4f7a-b9fd-496d4a28db62 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:51.865740 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901f0b0-e1e6-413d-9b4c-1c79f9f57b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:51.866823 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901f0b0-e1e6-413d-9b4c-1c79f9f57b38 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:51.867483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901f0b0-e1e6-413d-9b4c-1c79f9f57b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:51.867934 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901f0b0-e1e6-413d-9b4c-1c79f9f57b38 None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:51.869090 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901f0b0-e1e6-413d-9b4c-1c79f9f57b38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:51.869626 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901f0b0-e1e6-413d-9b4c-1c79f9f57b38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:51.871476 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901f0b0-e1e6-413d-9b4c-1c79f9f57b38 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:51.890339 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 414/839] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:51.891602 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901f0b0-e1e6-413d-9b4c-1c79f9f57b38 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:51.961794 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7457aef-c308-4f7a-b9fd-496d4a28db62 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:51.965001 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:52.003128 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba87a05-5f5a-4734-ae8c-61d4b95d0233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:52.003646 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba87a05-5f5a-4734-ae8c-61d4b95d0233 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:52.003928 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba87a05-5f5a-4734-ae8c-61d4b95d0233 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:52.004200 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba87a05-5f5a-4734-ae8c-61d4b95d0233 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:52.007965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901f0b0-e1e6-413d-9b4c-1c79f9f57b38 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:52.041792 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:52.045634 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc3574-8304-4ed0-a298-a69ed302f963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:52.046605 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc3574-8304-4ed0-a298-a69ed302f963 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:52.047088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc3574-8304-4ed0-a298-a69ed302f963 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:52.047555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc3574-8304-4ed0-a298-a69ed302f963 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:52.055293 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc3574-8304-4ed0-a298-a69ed302f963 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:52.057891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc3574-8304-4ed0-a298-a69ed302f963 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:52.070573 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-c4fc3574-8304-4ed0-a298-a69ed302f963 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:52.070573 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:52.070573 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:52.070573 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:52.070573 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:52.070573 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:52.070573 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:52.070573 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:52.070573 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:52.070573 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:52.070573 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:52.070573 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:52.070573 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:56:52.070573 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:56:52.070573 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:56:52.071438 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:56:52.071438 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:52.071438 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:52.071438 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:52.071438 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:52.071438 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:52.071438 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:52.071438 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:52.071438 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:52.071438 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:52.071438 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:52.071438 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:52.071438 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:52.071438 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:52.071438 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:52.071438 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:52.071438 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:52.073451 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:56:52.073451 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:56:52.073451 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:56:52.073451 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:56:52.073451 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:56:52.073451 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:56:52.073451 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:52.073451 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:52.080307 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba87a05-5f5a-4734-ae8c-61d4b95d0233 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:52.080307 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba87a05-5f5a-4734-ae8c-61d4b95d0233 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:52.080899 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 415/840] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:52.082165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc3574-8304-4ed0-a298-a69ed302f963 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:52.178895 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 426/841] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:56:51 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:56:52.179569 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba87a05-5f5a-4734-ae8c-61d4b95d0233 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:52.185340 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:52.190973 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc3574-8304-4ed0-a298-a69ed302f963 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:52.226782 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c7e91-0e03-4a47-822d-251118572554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:52.227568 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c7e91-0e03-4a47-822d-251118572554 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:52.227760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c7e91-0e03-4a47-822d-251118572554 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:52.228060 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c7e91-0e03-4a47-822d-251118572554 None admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:52.229629 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c7e91-0e03-4a47-822d-251118572554 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:52.229940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c7e91-0e03-4a47-822d-251118572554 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:52.231404 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c7e91-0e03-4a47-822d-251118572554 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:52.245005 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 416/842] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:56:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:52.245825 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c7e91-0e03-4a47-822d-251118572554 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:52.297909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:52.298363 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba87a05-5f5a-4734-ae8c-61d4b95d0233 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:52.337176 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8864450-255b-4a5d-bd43-b0a9a13cd88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:52.338259 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8864450-255b-4a5d-bd43-b0a9a13cd88c None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:52.338560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8864450-255b-4a5d-bd43-b0a9a13cd88c None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:52.338868 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8864450-255b-4a5d-bd43-b0a9a13cd88c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:52.350007 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8864450-255b-4a5d-bd43-b0a9a13cd88c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:52.355576 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-f8864450-255b-4a5d-bd43-b0a9a13cd88c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:56:52.355576 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:52.355576 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:52.355576 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:52.355576 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:52.355576 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:52.355576 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:52.355576 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:52.355576 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:52.355576 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:52.355576 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:52.355576 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:52.355576 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:52.355576 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:52.355576 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:52.355576 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:52.356472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:52.356472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:52.356472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:52.356472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:52.356472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:52.356472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:52.356472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:52.356472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:52.356472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:52.356472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:52.356472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:52.356472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:52.356472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:52.356472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:52.356472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:52.356472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:52.357304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:52.357304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:52.357304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:52.357304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:52.357304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:52.357304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:52.357304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:52.357304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:52.357304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:52.357304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:52.357304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:56:52.357304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:52.357304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 427/843] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:56:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:52.357978 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8864450-255b-4a5d-bd43-b0a9a13cd88c None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:52.362425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c7e91-0e03-4a47-822d-251118572554 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:52.398192 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6fe05-63f3-45a2-871a-038e76257ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:52.398908 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6fe05-63f3-45a2-871a-038e76257ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:52.399102 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6fe05-63f3-45a2-871a-038e76257ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:52.399373 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6fe05-63f3-45a2-871a-038e76257ed9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:52.410673 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6fe05-63f3-45a2-871a-038e76257ed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:52.412114 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6fe05-63f3-45a2-871a-038e76257ed9 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:52.426443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-7ed6fe05-63f3-45a2-871a-038e76257ed9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:52.426443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:52.426443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:52.426443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:52.426443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:52.426443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:52.426443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:52.426443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:52.426443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:52.426443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:52.426443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:52.426443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:52.426443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:52.426443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:52.426443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:52.426443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:52.427377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:52.427377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:52.427377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:52.427377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:52.427377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:52.427377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:52.427377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:52.427377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:52.427377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:52.427377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:52.427377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:52.427377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:52.427377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:52.427377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:52.427377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:52.427377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:52.427377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:52.428268 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:52.428268 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:52.428268 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:52.431219 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:52.432370 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 417/844] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:52.433206 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6fe05-63f3-45a2-871a-038e76257ed9 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:52.471374 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8864450-255b-4a5d-bd43-b0a9a13cd88c None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:52.505534 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f974e4-ee66-4148-b991-ad0a359c32fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:52.506126 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f974e4-ee66-4148-b991-ad0a359c32fd None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:52.506844 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f974e4-ee66-4148-b991-ad0a359c32fd None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:52.506844 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f974e4-ee66-4148-b991-ad0a359c32fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:52.507397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f974e4-ee66-4148-b991-ad0a359c32fd None admin] RBAC: Adding query filter params (role.id=e005fb4b59104519a433fc31da70f47e, scope.project.id=a80ab70ab6b9415c98017d05512c33eb, user.id=970300b51d504a2bbc48158855f02f34) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:52.507697 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f974e4-ee66-4148-b991-ad0a359c32fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:52.509109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f974e4-ee66-4148-b991-ad0a359c32fd None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:52.515468 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 428/845] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:56:52 2022] GET /identity/v3/role_assignments?user.id=970300b51d504a2bbc48158855f02f34&scope.project.id=a80ab70ab6b9415c98017d05512c33eb&role.id=e005fb4b59104519a433fc31da70f47e => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:52.516264 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f974e4-ee66-4148-b991-ad0a359c32fd None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:52.557133 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:52.562111 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6fe05-63f3-45a2-871a-038e76257ed9 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:52.610356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53167bd-dbcb-49dd-ba35-58c3d092644b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:52.611923 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53167bd-dbcb-49dd-ba35-58c3d092644b None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:52.612746 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53167bd-dbcb-49dd-ba35-58c3d092644b None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:52.613234 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53167bd-dbcb-49dd-ba35-58c3d092644b None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:52.614338 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53167bd-dbcb-49dd-ba35-58c3d092644b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:52.615200 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53167bd-dbcb-49dd-ba35-58c3d092644b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:52.616874 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53167bd-dbcb-49dd-ba35-58c3d092644b None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:52.634515 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 418/846] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:56:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:52.637285 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f974e4-ee66-4148-b991-ad0a359c32fd None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:52.639608 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53167bd-dbcb-49dd-ba35-58c3d092644b None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:52.671483 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:52.680458 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10440c8-87bd-4d63-90ad-fa6a6483e713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:52.684077 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10440c8-87bd-4d63-90ad-fa6a6483e713 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:52.684077 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10440c8-87bd-4d63-90ad-fa6a6483e713 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:52.684077 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10440c8-87bd-4d63-90ad-fa6a6483e713 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:52.684077 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10440c8-87bd-4d63-90ad-fa6a6483e713 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:52.684077 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10440c8-87bd-4d63-90ad-fa6a6483e713 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:52.685278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10440c8-87bd-4d63-90ad-fa6a6483e713 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:52.700333 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 429/847] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:52.707276 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10440c8-87bd-4d63-90ad-fa6a6483e713 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:52.772723 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53167bd-dbcb-49dd-ba35-58c3d092644b None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:52.814597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901724b4-c499-4096-b56f-de428a61e597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:52.815381 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901724b4-c499-4096-b56f-de428a61e597 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:52.815669 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901724b4-c499-4096-b56f-de428a61e597 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:52.815945 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901724b4-c499-4096-b56f-de428a61e597 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:52.827849 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901724b4-c499-4096-b56f-de428a61e597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:52.829307 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901724b4-c499-4096-b56f-de428a61e597 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:52.829458 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10440c8-87bd-4d63-90ad-fa6a6483e713 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:52.847691 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-901724b4-c499-4096-b56f-de428a61e597 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:52.847691 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:52.847691 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:52.847691 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:52.847691 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:52.847691 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:52.847691 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:52.847691 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:52.847691 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:52.847691 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:52.847691 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:52.847691 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:52.847691 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:52.847691 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:52.847691 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:52.847691 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:52.848764 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:52.848764 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:52.848764 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:52.848764 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:52.848764 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:52.848764 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:52.848764 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:52.848764 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:52.848764 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:52.848764 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:52.848764 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:52.848764 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:52.848764 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:52.848764 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:52.848764 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:52.848764 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:52.848764 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:52.849680 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:52.849680 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:52.849680 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:52.851877 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 419/848] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:52.857922 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901724b4-c499-4096-b56f-de428a61e597 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:52.873596 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad34ddd-dad4-48be-ae13-bff9c42e7bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:52.874150 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad34ddd-dad4-48be-ae13-bff9c42e7bbb None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:52.874470 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad34ddd-dad4-48be-ae13-bff9c42e7bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:52.874746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad34ddd-dad4-48be-ae13-bff9c42e7bbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:52.877969 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:52.881980 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad34ddd-dad4-48be-ae13-bff9c42e7bbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:52.883476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad34ddd-dad4-48be-ae13-bff9c42e7bbb None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:52.895390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-1ad34ddd-dad4-48be-ae13-bff9c42e7bbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:52.895390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:52.895390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:52.895390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:52.895390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:52.895390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:52.895390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:52.895390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:52.895390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:52.895390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:52.895390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:52.895390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:52.895390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:56:52.895390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:56:52.895390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:56:52.896531 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:56:52.896531 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:52.896531 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:52.896531 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:52.896531 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:52.896531 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:52.896531 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:52.896531 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:52.896531 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:52.896531 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:52.896531 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:52.896531 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:52.896531 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:52.896531 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:52.896531 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:52.896531 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:52.896531 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:52.897630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:56:52.897630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:56:52.897630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:56:52.897630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:56:52.897630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:56:52.897630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:56:52.897630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:52.897630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:52.897630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 430/849] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:52.903577 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad34ddd-dad4-48be-ae13-bff9c42e7bbb None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:52.974829 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:52.980570 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901724b4-c499-4096-b56f-de428a61e597 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:53.018997 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38522e98-9f0e-4134-bcf4-a23eecf8b70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:53.019935 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38522e98-9f0e-4134-bcf4-a23eecf8b70e None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:53.020432 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38522e98-9f0e-4134-bcf4-a23eecf8b70e None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:53.020869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38522e98-9f0e-4134-bcf4-a23eecf8b70e None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:53.021662 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38522e98-9f0e-4134-bcf4-a23eecf8b70e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:53.022115 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38522e98-9f0e-4134-bcf4-a23eecf8b70e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:53.023663 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38522e98-9f0e-4134-bcf4-a23eecf8b70e None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:53.037275 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 420/850] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:56:53.044366 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad34ddd-dad4-48be-ae13-bff9c42e7bbb None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:53.044549 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38522e98-9f0e-4134-bcf4-a23eecf8b70e None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:53.084387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827dd39-6c19-4f2e-96c1-10b7ac0313a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:53.084889 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827dd39-6c19-4f2e-96c1-10b7ac0313a2 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:53.085172 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827dd39-6c19-4f2e-96c1-10b7ac0313a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:53.085449 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827dd39-6c19-4f2e-96c1-10b7ac0313a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:53.086144 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827dd39-6c19-4f2e-96c1-10b7ac0313a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:53.086474 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827dd39-6c19-4f2e-96c1-10b7ac0313a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:53.088498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827dd39-6c19-4f2e-96c1-10b7ac0313a2 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:53.107047 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 431/851] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:56:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:53.109206 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827dd39-6c19-4f2e-96c1-10b7ac0313a2 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:53.143151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:53.179130 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38522e98-9f0e-4134-bcf4-a23eecf8b70e None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:53.218049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c373b3-2445-45fe-8426-d12878806adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:53.218575 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c373b3-2445-45fe-8426-d12878806adb None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:53.218922 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c373b3-2445-45fe-8426-d12878806adb None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:53.219202 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c373b3-2445-45fe-8426-d12878806adb None admin] PATH_INFO: `/v3/users/swift` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:53.227933 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c373b3-2445-45fe-8426-d12878806adb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:53.230703 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c373b3-2445-45fe-8426-d12878806adb None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:53.242681 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-c8c373b3-2445-45fe-8426-d12878806adb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 07:56:53.242681 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:53.242681 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:53.242681 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:53.242681 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:53.242681 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:53.242681 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:53.242681 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:53.242681 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:53.242681 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:53.242681 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:53.242681 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:53.242681 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:56:53.242681 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:56:53.242681 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:56:53.242681 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:56:53.243769 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:53.243769 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:53.243769 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:56:53.243769 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:53.243769 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:56:53.243769 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:53.243769 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:53.243769 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:53.243769 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:53.243769 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:53.243769 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:53.243769 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:53.243769 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:53.243769 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:53.243769 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:53.243769 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:53.243769 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:53.243769 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:53.244759 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:53.244759 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:53.244759 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:56:53.244759 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:56:53.244759 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:56:53.244759 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:56:53.244759 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:56:53.244759 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:56:53.244759 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 07:56:53.244759 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:53.245621 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 421/852] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:56:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:53.250178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c373b3-2445-45fe-8426-d12878806adb None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:53.263566 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827dd39-6c19-4f2e-96c1-10b7ac0313a2 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:53.279653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:53.308086 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec98e7-0edb-4e44-845e-a2376b6c4ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:53.308756 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec98e7-0edb-4e44-845e-a2376b6c4ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:53.308966 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec98e7-0edb-4e44-845e-a2376b6c4ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:53.309228 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec98e7-0edb-4e44-845e-a2376b6c4ad6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:53.309931 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec98e7-0edb-4e44-845e-a2376b6c4ad6 None admin] RBAC: Adding query filter params (role.id=e905040849d04aadbb8da8b0d216c92c, scope.project.id=a80ab70ab6b9415c98017d05512c33eb, user.id=b5c55e5c1cea47f29d378ea457384a31) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:53.310236 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec98e7-0edb-4e44-845e-a2376b6c4ad6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:53.311683 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec98e7-0edb-4e44-845e-a2376b6c4ad6 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:53.326490 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 432/853] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:56:53 2022] GET /identity/v3/role_assignments?user.id=b5c55e5c1cea47f29d378ea457384a31&scope.project.id=a80ab70ab6b9415c98017d05512c33eb&role.id=e905040849d04aadbb8da8b0d216c92c => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:53.326490 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad8e5b-86e0-47bb-8439-b8be5d1fa59d None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:53.326490 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad8e5b-86e0-47bb-8439-b8be5d1fa59d None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:53.326490 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad8e5b-86e0-47bb-8439-b8be5d1fa59d None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:53.326490 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 433/854] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:53.327552 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d8a19-40d1-401f-a6f0-b895be370b65 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:53.327844 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d8a19-40d1-401f-a6f0-b895be370b65 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:53.328123 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d8a19-40d1-401f-a6f0-b895be370b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:53.349396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-ca1d8a19-40d1-401f-a6f0-b895be370b65 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:53.350689 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-ca1d8a19-40d1-401f-a6f0-b895be370b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:53.392883 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c373b3-2445-45fe-8426-d12878806adb None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:53.436939 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:53.438677 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 434/855] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:53 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:56:53.443501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0e2a2-3ce8-4789-9ed5-42ef17a8fcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:53.444471 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0e2a2-3ce8-4789-9ed5-42ef17a8fcb6 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:53.444959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0e2a2-3ce8-4789-9ed5-42ef17a8fcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:53.445770 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0e2a2-3ce8-4789-9ed5-42ef17a8fcb6 None admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:53.447001 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0e2a2-3ce8-4789-9ed5-42ef17a8fcb6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:53.447562 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0e2a2-3ce8-4789-9ed5-42ef17a8fcb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:53.449572 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0e2a2-3ce8-4789-9ed5-42ef17a8fcb6 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:53.470013 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 422/856] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Aug 23 07:56:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:56:53.475550 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d8a19-40d1-401f-a6f0-b895be370b65 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:53.585694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d8a19-40d1-401f-a6f0-b895be370b65 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:53.588685 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:53.622372 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e48a9-a5f4-4331-8696-4d57767a58ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:53.623058 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e48a9-a5f4-4331-8696-4d57767a58ac None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:53.623298 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e48a9-a5f4-4331-8696-4d57767a58ac None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:53.623771 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e48a9-a5f4-4331-8696-4d57767a58ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:53.707634 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e48a9-a5f4-4331-8696-4d57767a58ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:53.709154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e48a9-a5f4-4331-8696-4d57767a58ac None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:53.731332 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0e2a2-3ce8-4789-9ed5-42ef17a8fcb6 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:53.821784 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 435/857] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:56:53 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:56:53.827554 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e48a9-a5f4-4331-8696-4d57767a58ac None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:53.829480 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:53.840670 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0e2a2-3ce8-4789-9ed5-42ef17a8fcb6 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:53.876066 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1643fe-5c04-45dd-b3a5-e2ffbe723923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:53.876698 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1643fe-5c04-45dd-b3a5-e2ffbe723923 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:53.876979 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1643fe-5c04-45dd-b3a5-e2ffbe723923 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:53.877311 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1643fe-5c04-45dd-b3a5-e2ffbe723923 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:53.877822 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1643fe-5c04-45dd-b3a5-e2ffbe723923 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:53.879246 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1643fe-5c04-45dd-b3a5-e2ffbe723923 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:53.888297 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-cf1643fe-5c04-45dd-b3a5-e2ffbe723923 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 07:56:53.888297 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:53.888297 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:56:53.888297 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:56:53.888297 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:56:53.888297 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:56:53.888297 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:56:53.888297 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:56:53.888297 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 07:56:53.888297 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:53.888297 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:56:53.888297 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:53.888297 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:53.888297 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:53.888297 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:53.888297 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:53.888297 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:53.889356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:53.889356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:53.889356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:53.889356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:53.889356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:53.889356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:53.889356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:56:53.889356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:56:53.889356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:56:53.889356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:56:53.889356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:53.889356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:53.889356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:53.889356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:53.889356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:53.889356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:53.890220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:53.890220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:53.890220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:53.890220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:53.890220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:53.890220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:53.890220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:53.890220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:53.890220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:53.890220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:53.890220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:56:53.890220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:56:53.890220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 07:56:53.890220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:53.890220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 423/858] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 23 07:56:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:53.899252 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1643fe-5c04-45dd-b3a5-e2ffbe723923 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:53.939787 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e48a9-a5f4-4331-8696-4d57767a58ac None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:53.976403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:53.980890 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d057f7-8e5a-4d7f-9c24-0466fb117a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:53.981534 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d057f7-8e5a-4d7f-9c24-0466fb117a64 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:53.982575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d057f7-8e5a-4d7f-9c24-0466fb117a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:53.982575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d057f7-8e5a-4d7f-9c24-0466fb117a64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:53.993355 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d057f7-8e5a-4d7f-9c24-0466fb117a64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:53.995320 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d057f7-8e5a-4d7f-9c24-0466fb117a64 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:54.013065 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-73d057f7-8e5a-4d7f-9c24-0466fb117a64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:54.013065 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:54.013065 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:54.013065 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:54.013065 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:54.013065 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:54.013065 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:54.013065 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:54.013065 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:54.013065 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:54.013065 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:54.013065 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:54.013065 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:54.013065 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:54.013065 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:54.013065 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:54.014151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:54.014151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:54.014151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:54.014151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:54.014151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:54.014151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:54.014151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:54.014151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:54.014151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:54.014151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:54.014151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:54.014151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:54.014151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:54.014151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:54.014151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:54.014151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:54.014151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:54.015162 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:54.015162 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:54.015162 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:54.019167 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 436/859] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:54.020060 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d057f7-8e5a-4d7f-9c24-0466fb117a64 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:54.042249 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1643fe-5c04-45dd-b3a5-e2ffbe723923 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:54.077037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:54.082098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c824cd-0c45-442a-bfa5-55fbb12a4b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:54.082979 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c824cd-0c45-442a-bfa5-55fbb12a4b75 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:54.083471 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c824cd-0c45-442a-bfa5-55fbb12a4b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:54.083976 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c824cd-0c45-442a-bfa5-55fbb12a4b75 None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:54.084823 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c824cd-0c45-442a-bfa5-55fbb12a4b75 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:54.085391 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c824cd-0c45-442a-bfa5-55fbb12a4b75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:54.086995 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c824cd-0c45-442a-bfa5-55fbb12a4b75 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:54.097852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 424/860] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 23 07:56:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:54.099377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c824cd-0c45-442a-bfa5-55fbb12a4b75 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:54.124680 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d057f7-8e5a-4d7f-9c24-0466fb117a64 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:54.159414 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c0815-118c-4dde-8d5c-de811f18737b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:54.160026 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c0815-118c-4dde-8d5c-de811f18737b None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:54.160303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c0815-118c-4dde-8d5c-de811f18737b None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:54.160574 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c0815-118c-4dde-8d5c-de811f18737b None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:54.161210 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c0815-118c-4dde-8d5c-de811f18737b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:54.161507 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c0815-118c-4dde-8d5c-de811f18737b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:54.162922 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c0815-118c-4dde-8d5c-de811f18737b None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:54.180184 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 437/861] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:54.181053 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c0815-118c-4dde-8d5c-de811f18737b None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:54.216109 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c824cd-0c45-442a-bfa5-55fbb12a4b75 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:54.235428 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:54.254520 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56bf36-e3af-48bc-bb59-ef5a938c9508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:54.255448 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56bf36-e3af-48bc-bb59-ef5a938c9508 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:54.255938 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56bf36-e3af-48bc-bb59-ef5a938c9508 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:54.256446 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56bf36-e3af-48bc-bb59-ef5a938c9508 None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:54.257383 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56bf36-e3af-48bc-bb59-ef5a938c9508 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:54.257909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56bf36-e3af-48bc-bb59-ef5a938c9508 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:54.260207 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56bf36-e3af-48bc-bb59-ef5a938c9508 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:54.274425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 425/862] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 23 07:56:54 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:56:54.284932 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c0815-118c-4dde-8d5c-de811f18737b None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:54.307930 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:54.335140 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f829c-14ed-4554-91e7-34bf6b0f6ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:54.335788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f829c-14ed-4554-91e7-34bf6b0f6ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:54.336055 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f829c-14ed-4554-91e7-34bf6b0f6ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:54.336327 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f829c-14ed-4554-91e7-34bf6b0f6ac7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:54.344575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f829c-14ed-4554-91e7-34bf6b0f6ac7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:54.346061 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f829c-14ed-4554-91e7-34bf6b0f6ac7 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:54.359175 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-d26f829c-14ed-4554-91e7-34bf6b0f6ac7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:54.359175 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:54.359175 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:54.359175 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:54.359175 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:54.359175 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:54.359175 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:54.359175 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:54.359175 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:54.359175 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:54.359175 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:54.359175 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:54.359175 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:56:54.359175 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:56:54.359175 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:56:54.360185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:56:54.360185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:54.360185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:54.360185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:54.360185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:54.360185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:54.360185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:54.360185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:54.360185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:54.360185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:54.360185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:54.360185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:54.360185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:54.360185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:54.360185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:54.360185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:54.360185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:54.361068 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:56:54.361068 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:56:54.361068 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:56:54.361068 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:56:54.361068 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:56:54.361068 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:56:54.361068 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:54.361068 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:54.361068 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 438/863] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:54.366502 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56bf36-e3af-48bc-bb59-ef5a938c9508 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:54.473971 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56bf36-e3af-48bc-bb59-ef5a938c9508 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:54.509829 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19afd8-7ed5-4d58-b408-6f8cc9e8c540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:54.510379 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19afd8-7ed5-4d58-b408-6f8cc9e8c540 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:54.510655 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19afd8-7ed5-4d58-b408-6f8cc9e8c540 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:54.510926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19afd8-7ed5-4d58-b408-6f8cc9e8c540 None admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:54.511609 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19afd8-7ed5-4d58-b408-6f8cc9e8c540 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:54.511907 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19afd8-7ed5-4d58-b408-6f8cc9e8c540 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:54.513330 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19afd8-7ed5-4d58-b408-6f8cc9e8c540 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:54.526823 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 426/864] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:56:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:54.532799 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f829c-14ed-4554-91e7-34bf6b0f6ac7 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:54.639265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b8d1c-cce0-4465-be63-9ed93caeb13b None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:54.639594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b8d1c-cce0-4465-be63-9ed93caeb13b None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:54.639817 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b8d1c-cce0-4465-be63-9ed93caeb13b None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:54.642044 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 427/865] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:56:54.644416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f829c-14ed-4554-91e7-34bf6b0f6ac7 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:54.649578 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34659805-9e69-430d-8a0c-32ca390c3bda None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:54.650020 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34659805-9e69-430d-8a0c-32ca390c3bda None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:54.650191 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34659805-9e69-430d-8a0c-32ca390c3bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:54.677470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-34659805-9e69-430d-8a0c-32ca390c3bda None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:54.679386 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-34659805-9e69-430d-8a0c-32ca390c3bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:54.687680 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd73696-2ebe-4980-8d86-4957126bf4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:54.688288 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd73696-2ebe-4980-8d86-4957126bf4ff None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:54.688567 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd73696-2ebe-4980-8d86-4957126bf4ff None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:54.688841 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd73696-2ebe-4980-8d86-4957126bf4ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:54.689566 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd73696-2ebe-4980-8d86-4957126bf4ff None admin] RBAC: Adding query filter params (role.id=e905040849d04aadbb8da8b0d216c92c, scope.project.id=a80ab70ab6b9415c98017d05512c33eb, user.id=4718cad0c0b9461d9c4152d7ea4b385d) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:54.689869 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd73696-2ebe-4980-8d86-4957126bf4ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:54.691336 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd73696-2ebe-4980-8d86-4957126bf4ff None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:54.706326 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 439/866] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:56:54 2022] GET /identity/v3/role_assignments?user.id=4718cad0c0b9461d9c4152d7ea4b385d&scope.project.id=a80ab70ab6b9415c98017d05512c33eb&role.id=e905040849d04aadbb8da8b0d216c92c => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:54.728852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:54.765781 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 428/867] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:56:55.034236 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd73696-2ebe-4980-8d86-4957126bf4ff None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:55.076783 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:55.137848 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd73696-2ebe-4980-8d86-4957126bf4ff None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:55.172883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670660d2-7768-4d4c-810c-1b6489b1bcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:55.173527 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670660d2-7768-4d4c-810c-1b6489b1bcce None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:55.173802 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670660d2-7768-4d4c-810c-1b6489b1bcce None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:55.174071 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670660d2-7768-4d4c-810c-1b6489b1bcce None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:55.184396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670660d2-7768-4d4c-810c-1b6489b1bcce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:56:55.189547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-670660d2-7768-4d4c-810c-1b6489b1bcce None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 07:56:55.189547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:55.189547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:55.189547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:55.189547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:55.189547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:55.189547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:55.189547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:55.189547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:55.189547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:55.189547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:55.189547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:55.189547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:56:55.189547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:56:55.189547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:56:55.189547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:56:55.190508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:56:55.190508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:56:55.190508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:56:55.190508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:56:55.190508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:55.190508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:55.190508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:55.190508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:55.190508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:55.190508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:55.190508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:55.190508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:55.190508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:55.190508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:55.190508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:55.190508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:55.191711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:55.191711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:55.191711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:55.191711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:55.191711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:56:55.191711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:56:55.191711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:56:55.191711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:56:55.191711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:56:55.191711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:56:55.191711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 07:56:55.191711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:55.191711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 440/868] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Aug 23 07:56:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:55.196695 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34659805-9e69-430d-8a0c-32ca390c3bda None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:55.302340 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34659805-9e69-430d-8a0c-32ca390c3bda None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:55.338872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f600f75-e8d3-40f1-9ebc-b4f426dc1d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:55.339490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f600f75-e8d3-40f1-9ebc-b4f426dc1d33 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:55.339774 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f600f75-e8d3-40f1-9ebc-b4f426dc1d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:55.340051 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f600f75-e8d3-40f1-9ebc-b4f426dc1d33 None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:55.340719 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f600f75-e8d3-40f1-9ebc-b4f426dc1d33 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:55.341024 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f600f75-e8d3-40f1-9ebc-b4f426dc1d33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:55.342435 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f600f75-e8d3-40f1-9ebc-b4f426dc1d33 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:55.351221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 429/869] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Aug 23 07:56:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:55.356848 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670660d2-7768-4d4c-810c-1b6489b1bcce None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:55.456244 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:55.460212 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670660d2-7768-4d4c-810c-1b6489b1bcce None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:55.464176 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab23eba-f18b-49b7-a04e-4b21d4e54dee None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:55.464464 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab23eba-f18b-49b7-a04e-4b21d4e54dee None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:55.466116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab23eba-f18b-49b7-a04e-4b21d4e54dee None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:55.466612 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 430/870] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:55.473002 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a5a05-1bb3-420c-887e-f97e691c8608 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:55.474112 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a5a05-1bb3-420c-887e-f97e691c8608 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:55.475414 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a5a05-1bb3-420c-887e-f97e691c8608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:55.497959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-c16a5a05-1bb3-420c-887e-f97e691c8608 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:55.499516 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-c16a5a05-1bb3-420c-887e-f97e691c8608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:55.501116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15272766-5fcd-43b2-bbce-e47b56b5c8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:55.501954 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15272766-5fcd-43b2-bbce-e47b56b5c8e0 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:55.502476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15272766-5fcd-43b2-bbce-e47b56b5c8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:55.502751 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15272766-5fcd-43b2-bbce-e47b56b5c8e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:55.513144 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15272766-5fcd-43b2-bbce-e47b56b5c8e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:55.514609 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15272766-5fcd-43b2-bbce-e47b56b5c8e0 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:55.530364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-15272766-5fcd-43b2-bbce-e47b56b5c8e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:55.530364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:55.530364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:55.530364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:55.530364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:55.530364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:55.530364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:55.530364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:55.530364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:55.530364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:55.530364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:55.530364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:55.530364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:55.530364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:55.530364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:55.530364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:55.531399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:55.531399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:55.531399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:55.531399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:55.531399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:55.531399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:55.531399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:55.531399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:55.531399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:55.531399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:55.531399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:55.531399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:55.531399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:55.531399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:55.531399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:55.531399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:55.531399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:55.532306 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:55.532306 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:55.532306 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:55.532306 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 441/871] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:55.537784 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:55.537994 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15272766-5fcd-43b2-bbce-e47b56b5c8e0 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:55.594502 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 431/872] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:55 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:56:55.641264 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15272766-5fcd-43b2-bbce-e47b56b5c8e0 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:55.680956 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c53fc-1730-440e-9263-1b7ed00336b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:55.682514 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c53fc-1730-440e-9263-1b7ed00336b9 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:55.682995 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c53fc-1730-440e-9263-1b7ed00336b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:55.683492 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c53fc-1730-440e-9263-1b7ed00336b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:55.684313 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c53fc-1730-440e-9263-1b7ed00336b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:55.684807 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c53fc-1730-440e-9263-1b7ed00336b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:55.686382 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c53fc-1730-440e-9263-1b7ed00336b9 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:55.702642 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 442/873] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:56:55.704557 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a5a05-1bb3-420c-887e-f97e691c8608 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:55.804512 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a5a05-1bb3-420c-887e-f97e691c8608 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:55.847865 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885aa00-6c3c-4fe3-adc4-210604242129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:55.848511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885aa00-6c3c-4fe3-adc4-210604242129 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:55.848798 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885aa00-6c3c-4fe3-adc4-210604242129 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:55.849069 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885aa00-6c3c-4fe3-adc4-210604242129 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:55.857946 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885aa00-6c3c-4fe3-adc4-210604242129 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:55.859530 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885aa00-6c3c-4fe3-adc4-210604242129 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:55.875039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-3885aa00-6c3c-4fe3-adc4-210604242129 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 07:56:55.875039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:55.875039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:55.875039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:55.875039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:55.875039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:55.875039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:55.875039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:55.875039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:55.875039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:55.875039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:55.875039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:55.875039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:56:55.875039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:56:55.875039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:56:55.875039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:56:55.876049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:55.876049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:55.876049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:56:55.876049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:55.876049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:56:55.876049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:56:55.876049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:55.876049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:55.876049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:55.876049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:55.876049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:55.876049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:55.876049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:55.876049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:55.876049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:55.876049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:55.876049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:55.876049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:55.876998 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:55.876998 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:55.876998 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:56:55.876998 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:56:55.876998 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:56:55.876998 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:56:55.876998 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:56:55.876998 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:56:55.876998 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 07:56:55.876998 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:55.879973 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 432/874] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 23 07:56:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:55.880101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c53fc-1730-440e-9263-1b7ed00336b9 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:55.888300 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885aa00-6c3c-4fe3-adc4-210604242129 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:55.900594 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:55.923474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:55.986525 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c53fc-1730-440e-9263-1b7ed00336b9 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:56.018751 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885aa00-6c3c-4fe3-adc4-210604242129 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:56.042668 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a02d7-60d3-4dcc-acfa-22ce8f31e280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:56.043769 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a02d7-60d3-4dcc-acfa-22ce8f31e280 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:56.044253 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a02d7-60d3-4dcc-acfa-22ce8f31e280 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:56.044725 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a02d7-60d3-4dcc-acfa-22ce8f31e280 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:56.045707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a02d7-60d3-4dcc-acfa-22ce8f31e280 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:56.047593 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a02d7-60d3-4dcc-acfa-22ce8f31e280 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:56.058185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-b64a02d7-60d3-4dcc-acfa-22ce8f31e280 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 07:56:56.058185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:56.058185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:56:56.058185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:56:56.058185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:56:56.058185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:56:56.058185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:56:56.058185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:56:56.058185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 07:56:56.058185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:56.058185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:56:56.058185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:56.058185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:56.058185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:56.058185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:56.058185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:56.059145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:56.059145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:56.059145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:56.059145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:56.059145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:56.059145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:56.059145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:56.059145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:56:56.059145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:56:56.059145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:56:56.059145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:56:56.059145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:56.059145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:56.059145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:56.059145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:56.059145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:56.059145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:56.060018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:56.060018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:56.060018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:56.060018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:56.060018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:56.060018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:56.060018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:56.060018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:56.060018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:56.060018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:56.060018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:56:56.060018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:56:56.060018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 07:56:56.060018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:56.061930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae20de-8a4d-4244-922a-aa7611b6025a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:56.066341 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae20de-8a4d-4244-922a-aa7611b6025a None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:56.066341 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae20de-8a4d-4244-922a-aa7611b6025a None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:56.066341 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae20de-8a4d-4244-922a-aa7611b6025a None admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:56.066341 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae20de-8a4d-4244-922a-aa7611b6025a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:56.066341 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae20de-8a4d-4244-922a-aa7611b6025a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:56.066341 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae20de-8a4d-4244-922a-aa7611b6025a None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:56.067179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 443/875] 10.222.0.57 () {56 vars in 1132 bytes} [Tue Aug 23 07:56:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:56.069114 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a02d7-60d3-4dcc-acfa-22ce8f31e280 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:56.086387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 433/876] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Aug 23 07:56:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:56:56.092144 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae20de-8a4d-4244-922a-aa7611b6025a None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:56.161684 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:56.189522 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a02d7-60d3-4dcc-acfa-22ce8f31e280 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:56.194772 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:56.220977 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae20de-8a4d-4244-922a-aa7611b6025a None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:56.230119 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf64ffb-ab82-4eda-8dae-dfb094f916fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:56.231927 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf64ffb-ab82-4eda-8dae-dfb094f916fe None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:56.232427 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf64ffb-ab82-4eda-8dae-dfb094f916fe None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:56.232947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf64ffb-ab82-4eda-8dae-dfb094f916fe None admin] PATH_INFO: `/v3/services` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:56.233884 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf64ffb-ab82-4eda-8dae-dfb094f916fe None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:56.234423 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf64ffb-ab82-4eda-8dae-dfb094f916fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:56.236106 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf64ffb-ab82-4eda-8dae-dfb094f916fe None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:56.246646 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 444/877] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 23 07:56:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:56:56.247883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf64ffb-ab82-4eda-8dae-dfb094f916fe None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:56.262396 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92cc36-249f-498f-9631-e3edc3eca713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:56.263972 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92cc36-249f-498f-9631-e3edc3eca713 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:56.264253 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92cc36-249f-498f-9631-e3edc3eca713 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:56.264527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92cc36-249f-498f-9631-e3edc3eca713 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:56.351230 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92cc36-249f-498f-9631-e3edc3eca713 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:56.352825 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92cc36-249f-498f-9631-e3edc3eca713 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:56.363523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf64ffb-ab82-4eda-8dae-dfb094f916fe None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:56.399420 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a607a-977f-45fd-9e3c-84b00da50064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:56.400617 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a607a-977f-45fd-9e3c-84b00da50064 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:56.400894 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a607a-977f-45fd-9e3c-84b00da50064 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:56.401204 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a607a-977f-45fd-9e3c-84b00da50064 None admin] PATH_INFO: `/v3/services` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:56.401835 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a607a-977f-45fd-9e3c-84b00da50064 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:56.402134 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a607a-977f-45fd-9e3c-84b00da50064 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:56.403569 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a607a-977f-45fd-9e3c-84b00da50064 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:56.408082 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 445/878] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 23 07:56:56 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:56.409261 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7dcd4-7dac-4a8e-928f-0d6f8877148b None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:56.409538 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7dcd4-7dac-4a8e-928f-0d6f8877148b None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:56.409810 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7dcd4-7dac-4a8e-928f-0d6f8877148b None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:56.411210 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 446/879] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:56.416895 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd992fad-ecba-4e9b-b3e7-6dbf68cd348d None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:56.417105 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd992fad-ecba-4e9b-b3e7-6dbf68cd348d None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:56.417379 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd992fad-ecba-4e9b-b3e7-6dbf68cd348d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:56.424360 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:56.438031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-fd992fad-ecba-4e9b-b3e7-6dbf68cd348d None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:56.439298 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-fd992fad-ecba-4e9b-b3e7-6dbf68cd348d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:56.454513 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:56.482870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 434/880] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:56:56 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:56:56.488080 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92cc36-249f-498f-9631-e3edc3eca713 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:56.539389 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 447/881] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:56:56.598484 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92cc36-249f-498f-9631-e3edc3eca713 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:56.633769 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be6403-2f2d-48d8-a3a0-1a741a88fc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:56.635021 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be6403-2f2d-48d8-a3a0-1a741a88fc31 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:56.635497 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be6403-2f2d-48d8-a3a0-1a741a88fc31 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:56.635924 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be6403-2f2d-48d8-a3a0-1a741a88fc31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:56.646833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be6403-2f2d-48d8-a3a0-1a741a88fc31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:56.649194 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be6403-2f2d-48d8-a3a0-1a741a88fc31 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:56.665223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-01be6403-2f2d-48d8-a3a0-1a741a88fc31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:56.665223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:56.665223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:56.665223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:56.665223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:56.665223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:56.665223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:56.665223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:56.665223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:56.665223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:56.665223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:56.665223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:56.665223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:56:56.665223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:56:56.665223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:56:56.665223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:56:56.666517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:56.666517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:56.666517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:56.666517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:56.666517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:56.666517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:56.666517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:56.666517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:56.666517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:56.666517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:56.666517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:56.666517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:56.666517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:56.666517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:56.666517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:56.666517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:56.666517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:56:56.667779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:56:56.667779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:56:56.667779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:56.669501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 435/882] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:56:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:56.674671 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd992fad-ecba-4e9b-b3e7-6dbf68cd348d None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:56.735653 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9eaaef-acf1-4849-9515-3976b43a88c8 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:56.735997 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9eaaef-acf1-4849-9515-3976b43a88c8 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:56.736211 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9eaaef-acf1-4849-9515-3976b43a88c8 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:56.737787 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 436/883] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:56:56.743052 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cd31b-b322-447e-834c-81ac6d953a14 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:56.744197 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cd31b-b322-447e-834c-81ac6d953a14 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:56.744849 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cd31b-b322-447e-834c-81ac6d953a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:56.763548 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-874cd31b-b322-447e-834c-81ac6d953a14 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:56.765065 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-874cd31b-b322-447e-834c-81ac6d953a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:56.787086 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd992fad-ecba-4e9b-b3e7-6dbf68cd348d None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:56.794635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:56.818463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:56.830386 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e4b5b-11fc-40f3-8a41-c94f07f96018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:56.830816 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e4b5b-11fc-40f3-8a41-c94f07f96018 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:56.831091 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e4b5b-11fc-40f3-8a41-c94f07f96018 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:56.831366 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e4b5b-11fc-40f3-8a41-c94f07f96018 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:56.832005 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e4b5b-11fc-40f3-8a41-c94f07f96018 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:56.832303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e4b5b-11fc-40f3-8a41-c94f07f96018 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:56.833672 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e4b5b-11fc-40f3-8a41-c94f07f96018 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:56.850640 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 437/884] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:56:56.850640 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874cd31b-b322-447e-834c-81ac6d953a14 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:56.850886 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 448/885] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:56.851709 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e4b5b-11fc-40f3-8a41-c94f07f96018 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:56.958565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874cd31b-b322-447e-834c-81ac6d953a14 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:56.967294 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e4b5b-11fc-40f3-8a41-c94f07f96018 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:56.996548 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33df1e9-5347-4caa-a5dd-f15c17a4dc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:56.997574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33df1e9-5347-4caa-a5dd-f15c17a4dc2b None admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:56.997863 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33df1e9-5347-4caa-a5dd-f15c17a4dc2b None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:56.998122 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33df1e9-5347-4caa-a5dd-f15c17a4dc2b None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:56.998786 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33df1e9-5347-4caa-a5dd-f15c17a4dc2b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:57.000166 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33df1e9-5347-4caa-a5dd-f15c17a4dc2b None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:57.005642 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb655b3e-8c56-4cb1-a960-a8a74b20967f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:57.006322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb655b3e-8c56-4cb1-a960-a8a74b20967f None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:57.006682 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb655b3e-8c56-4cb1-a960-a8a74b20967f None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:57.007018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb655b3e-8c56-4cb1-a960-a8a74b20967f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:57.014834 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb655b3e-8c56-4cb1-a960-a8a74b20967f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:57.016341 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb655b3e-8c56-4cb1-a960-a8a74b20967f None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:57.028879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-bb655b3e-8c56-4cb1-a960-a8a74b20967f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:57.028879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:57.028879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:57.028879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:57.028879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:57.028879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:57.028879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:57.028879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:57.028879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:57.028879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:57.028879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:57.028879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:57.028879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:56:57.028879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:56:57.028879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:56:57.029770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:56:57.029770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:57.029770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:57.029770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:57.029770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:57.029770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:57.029770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:57.029770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:57.029770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:57.029770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:57.029770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:57.029770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:57.029770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:57.029770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:57.029770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:57.029770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:57.029770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:57.035504 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:56:57.035504 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:56:57.035504 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:56:57.035504 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:56:57.035504 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:56:57.035504 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:56:57.035504 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:56:57.035504 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:57.035504 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 449/886] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:56:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:56:57.037387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb655b3e-8c56-4cb1-a960-a8a74b20967f None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:57.072507 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 438/887] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 23 07:56:56 2022] POST /identity/v3/services => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:56:57.099274 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:57.154134 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb655b3e-8c56-4cb1-a960-a8a74b20967f None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:57.167780 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33df1e9-5347-4caa-a5dd-f15c17a4dc2b None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:57.197800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:57.209579 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16a52a-29fc-4ba3-b2ce-a012d42f14b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:57.210672 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16a52a-29fc-4ba3-b2ce-a012d42f14b2 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:57.211160 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16a52a-29fc-4ba3-b2ce-a012d42f14b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:57.211622 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16a52a-29fc-4ba3-b2ce-a012d42f14b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:57.212474 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16a52a-29fc-4ba3-b2ce-a012d42f14b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:57.212949 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16a52a-29fc-4ba3-b2ce-a012d42f14b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:57.215497 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16a52a-29fc-4ba3-b2ce-a012d42f14b2 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:57.229297 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 450/888] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:56:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:56:57.235095 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16a52a-29fc-4ba3-b2ce-a012d42f14b2 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:57.297045 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33df1e9-5347-4caa-a5dd-f15c17a4dc2b None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:57.332147 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd952c-900b-4718-99b7-8929f611cf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:57.332786 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd952c-900b-4718-99b7-8929f611cf92 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:57.333064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd952c-900b-4718-99b7-8929f611cf92 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:57.333335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd952c-900b-4718-99b7-8929f611cf92 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:57.333913 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd952c-900b-4718-99b7-8929f611cf92 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:57.335310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd952c-900b-4718-99b7-8929f611cf92 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:57.344762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-efcd952c-900b-4718-99b7-8929f611cf92 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:56:57.344762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:57.344762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:56:57.344762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:56:57.344762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:56:57.344762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:56:57.344762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:56:57.344762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:56:57.344762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:56:57.344762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:57.344762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:56:57.344762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:57.344762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:57.344762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:57.344762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:57.344762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:57.344762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:57.345765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:57.345765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:57.345765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:57.345765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:57.345765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:57.345765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:57.345765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:56:57.345765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:56:57.345765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:56:57.345765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:56:57.345765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:57.345765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:57.345765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:57.345765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:57.345765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:57.345765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:57.346633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:57.346633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:57.346633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:57.346633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:57.346633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:57.346633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:57.346633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:57.346633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:57.346633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:57.346633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:57.346633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:56:57.346633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:56:57.346633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:56:57.346633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:56:57.346633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 439/889] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 23 07:56:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:57.351777 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd952c-900b-4718-99b7-8929f611cf92 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:57.365871 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16a52a-29fc-4ba3-b2ce-a012d42f14b2 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:57.379739 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:57.412697 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37385416-5625-4fd3-b0ad-6180129d4f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:57.413395 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37385416-5625-4fd3-b0ad-6180129d4f19 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:57.413804 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37385416-5625-4fd3-b0ad-6180129d4f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:57.414147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37385416-5625-4fd3-b0ad-6180129d4f19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:57.415011 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37385416-5625-4fd3-b0ad-6180129d4f19 None admin] RBAC: Adding query filter params (role.id=0c9e286fb47049feb93649dbd95342a1, scope.project.id=a80ab70ab6b9415c98017d05512c33eb, user.id=970300b51d504a2bbc48158855f02f34) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:57.415440 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37385416-5625-4fd3-b0ad-6180129d4f19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:57.417068 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37385416-5625-4fd3-b0ad-6180129d4f19 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:57.426439 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 451/890] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:56:57 2022] GET /identity/v3/role_assignments?user.id=970300b51d504a2bbc48158855f02f34&scope.project.id=a80ab70ab6b9415c98017d05512c33eb&role.id=0c9e286fb47049feb93649dbd95342a1 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:57.457955 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:57.473318 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd952c-900b-4718-99b7-8929f611cf92 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:57.513598 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449249d-8276-4cc8-a2c7-dd3b72146d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:57.515075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449249d-8276-4cc8-a2c7-dd3b72146d8a None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:57.515529 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449249d-8276-4cc8-a2c7-dd3b72146d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:57.515972 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449249d-8276-4cc8-a2c7-dd3b72146d8a None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:57.516793 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449249d-8276-4cc8-a2c7-dd3b72146d8a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:57.518161 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449249d-8276-4cc8-a2c7-dd3b72146d8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:57.519078 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449249d-8276-4cc8-a2c7-dd3b72146d8a None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:57.525486 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 440/891] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 23 07:56:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:56:57.534417 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37385416-5625-4fd3-b0ad-6180129d4f19 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:57.643477 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37385416-5625-4fd3-b0ad-6180129d4f19 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:57.684177 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15765241-d2cb-4f32-b3d2-c044a8269d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:57.684787 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15765241-d2cb-4f32-b3d2-c044a8269d74 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:57.685064 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15765241-d2cb-4f32-b3d2-c044a8269d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:57.685335 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15765241-d2cb-4f32-b3d2-c044a8269d74 None admin] PATH_INFO: `/v3/services` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:57.685963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15765241-d2cb-4f32-b3d2-c044a8269d74 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:57.686261 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15765241-d2cb-4f32-b3d2-c044a8269d74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:57.687650 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15765241-d2cb-4f32-b3d2-c044a8269d74 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:57.692512 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 452/892] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 23 07:56:57 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:58.391105 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a93d0-9e7e-4921-9420-15fa04aed7bd None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:58.391530 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a93d0-9e7e-4921-9420-15fa04aed7bd None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:58.391650 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a93d0-9e7e-4921-9420-15fa04aed7bd None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:58.393196 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 441/893] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:58.398520 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121066f-7b7b-4cd0-a7af-7b2404eb112a None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:58.398951 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121066f-7b7b-4cd0-a7af-7b2404eb112a None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:58.399131 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121066f-7b7b-4cd0-a7af-7b2404eb112a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:58.416844 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-2121066f-7b7b-4cd0-a7af-7b2404eb112a None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:58.418016 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-2121066f-7b7b-4cd0-a7af-7b2404eb112a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:58.449144 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:58.490226 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 453/894] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:58 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:56:58.769999 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a93d0-9e7e-4921-9420-15fa04aed7bd None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:58.872987 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a93d0-9e7e-4921-9420-15fa04aed7bd None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:58.906756 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9b44d-45f0-4fce-a78d-e83018b3f061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:58.907287 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9b44d-45f0-4fce-a78d-e83018b3f061 None admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:58.907565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9b44d-45f0-4fce-a78d-e83018b3f061 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:58.907837 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9b44d-45f0-4fce-a78d-e83018b3f061 None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:58.908525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9b44d-45f0-4fce-a78d-e83018b3f061 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:58.910002 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9b44d-45f0-4fce-a78d-e83018b3f061 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:59.001640 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 442/895] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 23 07:56:58 2022] POST /identity/v3/services => generated 269 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:56:59.183072 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87968408-dfb9-4526-918a-bc8551adaee0 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:59.183072 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87968408-dfb9-4526-918a-bc8551adaee0 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:59.183072 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87968408-dfb9-4526-918a-bc8551adaee0 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:59.183837 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 454/896] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:59.189426 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d516d-66ad-4e28-a474-b827986440bd None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:59.189715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d516d-66ad-4e28-a474-b827986440bd None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:59.189991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d516d-66ad-4e28-a474-b827986440bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:59.210130 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-af5d516d-66ad-4e28-a474-b827986440bd None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:59.211674 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-af5d516d-66ad-4e28-a474-b827986440bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:59.220533 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:59.288125 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 443/897] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:59 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:56:59.433381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bc82b-3149-41c9-91be-090d031da883 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:59.433867 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bc82b-3149-41c9-91be-090d031da883 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:59.433867 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bc82b-3149-41c9-91be-090d031da883 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:59.435504 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 455/898] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:56:59.440804 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1a64b-d4a6-4e9e-97cd-52d157792fd0 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:59.441321 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1a64b-d4a6-4e9e-97cd-52d157792fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:59.441801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1a64b-d4a6-4e9e-97cd-52d157792fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:59.461494 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-aec1a64b-d4a6-4e9e-97cd-52d157792fd0 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:59.463149 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-aec1a64b-d4a6-4e9e-97cd-52d157792fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:59.533561 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 444/899] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:59 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:56:59.571467 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bc82b-3149-41c9-91be-090d031da883 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:59.605788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c95aa-ea68-4251-a143-e28395a0a397 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:59.606471 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c95aa-ea68-4251-a143-e28395a0a397 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:59.606951 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c95aa-ea68-4251-a143-e28395a0a397 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:59.609006 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 445/900] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:56:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:56:59.614001 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf10c23-7fc5-47a2-90e2-958a0915715f None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:59.614297 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf10c23-7fc5-47a2-90e2-958a0915715f None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:59.614913 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf10c23-7fc5-47a2-90e2-958a0915715f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:59.633384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-dcf10c23-7fc5-47a2-90e2-958a0915715f None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:56:59.635071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-dcf10c23-7fc5-47a2-90e2-958a0915715f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:56:59.689538 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bc82b-3149-41c9-91be-090d031da883 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:59.703502 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:59.718460 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 446/901] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:56:59 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:56:59.730983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd111006-97de-47b8-aba5-beb12eb117b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:59.731669 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd111006-97de-47b8-aba5-beb12eb117b8 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:59.731949 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd111006-97de-47b8-aba5-beb12eb117b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:59.732222 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd111006-97de-47b8-aba5-beb12eb117b8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:59.732863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd111006-97de-47b8-aba5-beb12eb117b8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:59.734305 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd111006-97de-47b8-aba5-beb12eb117b8 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:59.746030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-fd111006-97de-47b8-aba5-beb12eb117b8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 07:56:59.746030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:59.746030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:56:59.746030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:56:59.746030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:56:59.746030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:56:59.746030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:56:59.746030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:56:59.746030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 07:56:59.746030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:59.746030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:56:59.746030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:59.746030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:56:59.746030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:56:59.746030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:56:59.746030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:56:59.746030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:56:59.747249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:56:59.747249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:56:59.747249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:56:59.747249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:56:59.747249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:56:59.747249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:56:59.747249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:56:59.747249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:56:59.747249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:56:59.747249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:56:59.747249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:56:59.747249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:56:59.747249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:56:59.747249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:56:59.747249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:56:59.747249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:56:59.748116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:56:59.748116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:56:59.748116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:56:59.748116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:56:59.748116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:56:59.748116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:56:59.748116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:56:59.748116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:56:59.748116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:56:59.748116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:56:59.748116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:56:59.748116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:56:59.748116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 07:56:59.748116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:56:59.748116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 456/902] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 23 07:56:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:56:59.753642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf10c23-7fc5-47a2-90e2-958a0915715f None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:59.853565 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd111006-97de-47b8-aba5-beb12eb117b8 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:59.860758 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf10c23-7fc5-47a2-90e2-958a0915715f None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:56:59.885781 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:56:59.896742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4e299-528d-4b6e-b2c4-5a80242ba8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:56:59.897348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4e299-528d-4b6e-b2c4-5a80242ba8c9 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:56:59.897626 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4e299-528d-4b6e-b2c4-5a80242ba8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:56:59.897898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4e299-528d-4b6e-b2c4-5a80242ba8c9 None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:56:59.898592 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4e299-528d-4b6e-b2c4-5a80242ba8c9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:56:59.899075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4e299-528d-4b6e-b2c4-5a80242ba8c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:56:59.901332 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4e299-528d-4b6e-b2c4-5a80242ba8c9 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:56:59.906718 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 447/903] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 23 07:56:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:56:59.918083 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4e299-528d-4b6e-b2c4-5a80242ba8c9 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:56:59.972886 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd111006-97de-47b8-aba5-beb12eb117b8 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:00.004641 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:00.011197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abb8b0-da9d-46eb-805f-974734af7a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:00.011940 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abb8b0-da9d-46eb-805f-974734af7a7a None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:00.012223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abb8b0-da9d-46eb-805f-974734af7a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:00.012508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abb8b0-da9d-46eb-805f-974734af7a7a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:00.023293 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04abb8b0-da9d-46eb-805f-974734af7a7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:57:00.028772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-04abb8b0-da9d-46eb-805f-974734af7a7a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 07:57:00.028772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:00.028772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:00.028772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:00.028772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:00.028772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:00.028772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:00.028772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:00.028772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:00.028772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:00.028772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:00.028772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:00.028772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:57:00.028772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:57:00.028772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:57:00.028772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:57:00.029757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:57:00.029757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:57:00.029757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:57:00.029757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:57:00.029757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:00.029757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:00.029757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:00.029757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:00.029757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:00.029757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:00.029757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:00.029757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:00.029757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:00.029757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:00.029757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:00.029757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:00.030916 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:00.030916 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:00.030916 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:00.030916 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:00.030916 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:57:00.030916 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:57:00.030916 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:57:00.030916 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:57:00.030916 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:57:00.030916 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:57:00.030916 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 07:57:00.030916 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:00.030916 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 457/904] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Aug 23 07:56:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:57:00.031617 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abb8b0-da9d-46eb-805f-974734af7a7a None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:00.054252 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4e299-528d-4b6e-b2c4-5a80242ba8c9 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:00.091238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f0257-47c8-466f-8bc3-32477fe35d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:00.091856 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f0257-47c8-466f-8bc3-32477fe35d33 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:00.092140 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f0257-47c8-466f-8bc3-32477fe35d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:00.092416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f0257-47c8-466f-8bc3-32477fe35d33 None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:00.093037 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f0257-47c8-466f-8bc3-32477fe35d33 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:00.093339 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f0257-47c8-466f-8bc3-32477fe35d33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:00.094758 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f0257-47c8-466f-8bc3-32477fe35d33 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:00.104809 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 448/905] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 23 07:56:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:00.104809 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f0257-47c8-466f-8bc3-32477fe35d33 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:00.136804 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:00.146384 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abb8b0-da9d-46eb-805f-974734af7a7a None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:00.182773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3979f7-9fc5-40e6-ae13-7539ca0cf11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:00.183377 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3979f7-9fc5-40e6-ae13-7539ca0cf11d None admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:00.183713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3979f7-9fc5-40e6-ae13-7539ca0cf11d None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:00.183990 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3979f7-9fc5-40e6-ae13-7539ca0cf11d None admin] PATH_INFO: `/v3/services` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:00.184627 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3979f7-9fc5-40e6-ae13-7539ca0cf11d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:00.186115 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3979f7-9fc5-40e6-ae13-7539ca0cf11d None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:00.209361 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f0257-47c8-466f-8bc3-32477fe35d33 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:00.234845 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:00.243156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483fc7c-e0d4-4fb4-8b83-f9a1937c804d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:00.243849 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483fc7c-e0d4-4fb4-8b83-f9a1937c804d None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:00.244139 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483fc7c-e0d4-4fb4-8b83-f9a1937c804d None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:00.244409 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483fc7c-e0d4-4fb4-8b83-f9a1937c804d None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:00.245059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483fc7c-e0d4-4fb4-8b83-f9a1937c804d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:00.245356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483fc7c-e0d4-4fb4-8b83-f9a1937c804d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:00.246753 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483fc7c-e0d4-4fb4-8b83-f9a1937c804d None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:00.255027 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 449/906] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Aug 23 07:57:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:00.255705 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483fc7c-e0d4-4fb4-8b83-f9a1937c804d None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:00.266453 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 458/907] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 23 07:57:00 2022] POST /identity/v3/services => generated 241 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:57:00.266453 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3979f7-9fc5-40e6-ae13-7539ca0cf11d None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:00.400332 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483fc7c-e0d4-4fb4-8b83-f9a1937c804d None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:00.400643 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3979f7-9fc5-40e6-ae13-7539ca0cf11d None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:00.443566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf39f5f-7be9-4c91-a4f1-6aa74dfc7193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:00.444142 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf39f5f-7be9-4c91-a4f1-6aa74dfc7193 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:00.444450 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf39f5f-7be9-4c91-a4f1-6aa74dfc7193 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:00.444726 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf39f5f-7be9-4c91-a4f1-6aa74dfc7193 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:00.445561 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf39f5f-7be9-4c91-a4f1-6aa74dfc7193 None admin] RBAC: Adding query filter params (interface=public, service_id=1734a9a4f79e47619311fa16025f0816, region_id=RegionOne) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:00.445855 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf39f5f-7be9-4c91-a4f1-6aa74dfc7193 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:00.447643 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf39f5f-7be9-4c91-a4f1-6aa74dfc7193 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:00.449460 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd6310-288a-46cf-8782-eb36ff4a1124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:00.450701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd6310-288a-46cf-8782-eb36ff4a1124 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:00.451125 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd6310-288a-46cf-8782-eb36ff4a1124 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:00.451530 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd6310-288a-46cf-8782-eb36ff4a1124 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:00.460383 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 450/908] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Aug 23 07:57:00 2022] GET /identity/v3/endpoints?service_id=1734a9a4f79e47619311fa16025f0816&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:00.461867 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf39f5f-7be9-4c91-a4f1-6aa74dfc7193 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:00.470894 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd6310-288a-46cf-8782-eb36ff4a1124 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:00.472541 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd6310-288a-46cf-8782-eb36ff4a1124 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:00.480163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:00.495896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-defd6310-288a-46cf-8782-eb36ff4a1124 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:57:00.495896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:00.495896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:00.495896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:00.495896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:00.495896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:00.495896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:00.495896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:00.495896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:00.495896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:00.495896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:00.495896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:00.495896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:57:00.495896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:57:00.495896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:57:00.495896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:57:00.497054 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:00.497054 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:00.497054 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:00.497054 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:00.497054 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:00.497054 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:00.497054 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:00.497054 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:00.497054 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:00.497054 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:00.497054 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:00.497054 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:00.497054 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:00.497054 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:00.497054 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:00.497054 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:00.497054 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:57:00.497976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:57:00.497976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:57:00.497976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:00.497976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 459/909] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:57:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:00.497976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd6310-288a-46cf-8782-eb36ff4a1124 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:00.525214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:00.576071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf39f5f-7be9-4c91-a4f1-6aa74dfc7193 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:00.614463 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa6bd1-f839-4428-aa6a-2fbb9ee6c67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:00.615566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa6bd1-f839-4428-aa6a-2fbb9ee6c67f None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:00.616136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa6bd1-f839-4428-aa6a-2fbb9ee6c67f None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:00.616602 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa6bd1-f839-4428-aa6a-2fbb9ee6c67f None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:00.617413 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa6bd1-f839-4428-aa6a-2fbb9ee6c67f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:00.619985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa6bd1-f839-4428-aa6a-2fbb9ee6c67f None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:00.632695 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd6310-288a-46cf-8782-eb36ff4a1124 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:00.633138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 451/910] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Aug 23 07:57:00 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 07:57:00.673049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f505ce4-cca4-41ae-a297-ad8448bd90a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:00.673670 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f505ce4-cca4-41ae-a297-ad8448bd90a4 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:00.673947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f505ce4-cca4-41ae-a297-ad8448bd90a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:00.674219 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f505ce4-cca4-41ae-a297-ad8448bd90a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:00.674917 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f505ce4-cca4-41ae-a297-ad8448bd90a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:00.675219 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f505ce4-cca4-41ae-a297-ad8448bd90a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:00.676704 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f505ce4-cca4-41ae-a297-ad8448bd90a4 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:00.691470 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 460/911] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:00.697694 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa6bd1-f839-4428-aa6a-2fbb9ee6c67f None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:00.808561 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa6bd1-f839-4428-aa6a-2fbb9ee6c67f None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:00.826895 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:00.844420 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4988bef-275d-43f2-a277-72fefea2f829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:00.845446 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4988bef-275d-43f2-a277-72fefea2f829 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:00.845873 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4988bef-275d-43f2-a277-72fefea2f829 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:00.846395 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4988bef-275d-43f2-a277-72fefea2f829 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:00.854574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4988bef-275d-43f2-a277-72fefea2f829 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:00.856191 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4988bef-275d-43f2-a277-72fefea2f829 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:00.867472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-c4988bef-275d-43f2-a277-72fefea2f829 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 07:57:00.867472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:00.867472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:00.867472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:00.867472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:00.867472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:00.867472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:00.867472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:00.867472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:00.867472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:00.867472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:00.867472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:00.867472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:57:00.867472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:57:00.867472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:57:00.867472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:57:00.869180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:00.869180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:00.869180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:57:00.869180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:57:00.869180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:57:00.869180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:57:00.869180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:00.869180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:00.869180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:00.869180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:00.869180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:00.869180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:00.869180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:00.869180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:00.869180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:00.869180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:00.869180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:00.869180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:00.870353 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:00.870353 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:00.870353 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:57:00.870353 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:57:00.870353 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:57:00.870353 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:57:00.870353 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:57:00.870353 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:57:00.870353 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 07:57:00.870353 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:00.872602 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 452/912] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 23 07:57:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:00.878004 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f505ce4-cca4-41ae-a297-ad8448bd90a4 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:00.938820 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:00.983116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f505ce4-cca4-41ae-a297-ad8448bd90a4 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:01.018402 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c1302-1a1b-4546-ba44-9675a37f313b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:01.019014 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c1302-1a1b-4546-ba44-9675a37f313b None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:01.019292 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c1302-1a1b-4546-ba44-9675a37f313b None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:01.019562 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c1302-1a1b-4546-ba44-9675a37f313b None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:01.020297 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c1302-1a1b-4546-ba44-9675a37f313b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:01.020598 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c1302-1a1b-4546-ba44-9675a37f313b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:01.022028 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c1302-1a1b-4546-ba44-9675a37f313b None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:01.025918 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5490f6-c65d-4b1d-96d9-e8f5408c0685 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:01.026433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5490f6-c65d-4b1d-96d9-e8f5408c0685 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:01.026917 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5490f6-c65d-4b1d-96d9-e8f5408c0685 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:01.028694 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 453/913] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:57:01.035388 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c135be-9ecb-479f-af6f-6d8816072b8f None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:01.035912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c135be-9ecb-479f-af6f-6d8816072b8f None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:01.036865 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c135be-9ecb-479f-af6f-6d8816072b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:01.040812 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 461/914] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Aug 23 07:57:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:01.046507 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c1302-1a1b-4546-ba44-9675a37f313b None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:01.062330 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-c6c135be-9ecb-479f-af6f-6d8816072b8f None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:01.064549 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-c6c135be-9ecb-479f-af6f-6d8816072b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:01.144861 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 454/915] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:57:01.159174 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c1302-1a1b-4546-ba44-9675a37f313b None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:01.178656 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:01.197213 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c476b-0252-4a39-9093-92d4e1c14148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:01.197891 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c476b-0252-4a39-9093-92d4e1c14148 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:01.198173 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c476b-0252-4a39-9093-92d4e1c14148 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:01.198480 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c476b-0252-4a39-9093-92d4e1c14148 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:01.209123 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c476b-0252-4a39-9093-92d4e1c14148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:01.210762 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c476b-0252-4a39-9093-92d4e1c14148 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:01.226528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-335c476b-0252-4a39-9093-92d4e1c14148 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:57:01.226528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:01.226528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:01.226528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:01.226528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:01.226528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:01.226528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:01.226528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:01.226528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:01.226528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:01.226528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:01.226528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:01.226528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:57:01.226528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:57:01.226528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:57:01.226528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:57:01.227484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:01.227484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:01.227484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:01.227484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:01.227484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:01.227484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:01.227484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:01.227484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:01.227484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:01.227484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:01.227484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:01.227484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:01.227484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:01.227484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:01.227484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:01.227484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:01.227484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:57:01.228566 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:57:01.228566 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:57:01.228566 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:01.228566 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 462/916] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:57:01.239351 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c135be-9ecb-479f-af6f-6d8816072b8f None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:01.346188 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c135be-9ecb-479f-af6f-6d8816072b8f None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:01.353684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:01.380489 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac3d46-bc2c-45ea-8d06-655d3a684972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:01.381132 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac3d46-bc2c-45ea-8d06-655d3a684972 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:01.381437 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac3d46-bc2c-45ea-8d06-655d3a684972 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:01.381710 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac3d46-bc2c-45ea-8d06-655d3a684972 None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:01.382369 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac3d46-bc2c-45ea-8d06-655d3a684972 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:01.382671 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac3d46-bc2c-45ea-8d06-655d3a684972 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:01.384610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac3d46-bc2c-45ea-8d06-655d3a684972 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:01.399592 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 455/917] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:01.405183 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c476b-0252-4a39-9093-92d4e1c14148 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:01.457084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac3d46-bc2c-45ea-8d06-655d3a684972 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:01.524827 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c476b-0252-4a39-9093-92d4e1c14148 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:01.572797 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39a572-31ec-47dc-8028-76639b1918c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:01.573957 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39a572-31ec-47dc-8028-76639b1918c6 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:01.574243 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39a572-31ec-47dc-8028-76639b1918c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:01.574786 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39a572-31ec-47dc-8028-76639b1918c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:01.581688 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac3d46-bc2c-45ea-8d06-655d3a684972 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:01.583567 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39a572-31ec-47dc-8028-76639b1918c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:01.585889 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39a572-31ec-47dc-8028-76639b1918c6 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:01.601946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-9e39a572-31ec-47dc-8028-76639b1918c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:57:01.601946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:01.601946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:01.601946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:01.601946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:01.601946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:01.601946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:01.601946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:01.601946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:01.601946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:01.601946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:01.601946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:01.601946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:57:01.601946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:57:01.601946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:57:01.603523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:57:01.603523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:01.603523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:01.603523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:01.603523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:01.603523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:01.603523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:01.603523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:01.603523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:01.603523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:01.603523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:01.603523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:01.603523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:01.603523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:01.603523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:01.603523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:01.603523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:01.604421 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:57:01.604421 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:57:01.604421 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:57:01.604421 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:57:01.604421 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:57:01.604421 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:57:01.604421 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:57:01.604421 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:01.604854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 463/918] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:57:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:01.611179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39a572-31ec-47dc-8028-76639b1918c6 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:01.633596 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d77db0-6a84-4d02-9206-adc5a19776f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:01.634539 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d77db0-6a84-4d02-9206-adc5a19776f9 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:01.634845 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d77db0-6a84-4d02-9206-adc5a19776f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:01.635124 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d77db0-6a84-4d02-9206-adc5a19776f9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:01.635714 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d77db0-6a84-4d02-9206-adc5a19776f9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:01.637093 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d77db0-6a84-4d02-9206-adc5a19776f9 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:01.650151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-f4d77db0-6a84-4d02-9206-adc5a19776f9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 07:57:01.650151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:01.650151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:57:01.650151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:57:01.650151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:57:01.650151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:57:01.650151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:57:01.650151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:57:01.650151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 07:57:01.650151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:01.650151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:57:01.650151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:01.650151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:01.650151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:01.650151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:01.650151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:01.651110 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:01.651110 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:01.651110 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:01.651110 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:01.651110 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:01.651110 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:01.651110 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:01.651110 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:57:01.651110 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:57:01.651110 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:57:01.651110 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:57:01.651110 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:01.651110 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:01.651110 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:01.651110 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:01.651110 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:01.651110 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:01.652966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:01.652966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:01.652966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:01.652966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:01.652966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:01.652966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:01.652966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:01.652966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:01.652966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:01.652966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:01.652966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:57:01.652966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:57:01.652966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 07:57:01.652966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:01.656064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 456/919] 10.222.0.57 () {56 vars in 1132 bytes} [Tue Aug 23 07:57:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:57:01.657289 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:01.661578 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d77db0-6a84-4d02-9206-adc5a19776f9 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:01.702821 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:01.743932 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39a572-31ec-47dc-8028-76639b1918c6 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:01.779301 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d77db0-6a84-4d02-9206-adc5a19776f9 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:01.781253 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecace57-575d-4640-8e6f-470db7ce6b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:01.782101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecace57-575d-4640-8e6f-470db7ce6b1f None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:01.782421 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecace57-575d-4640-8e6f-470db7ce6b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:01.782770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecace57-575d-4640-8e6f-470db7ce6b1f None admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:01.783575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecace57-575d-4640-8e6f-470db7ce6b1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:01.784644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecace57-575d-4640-8e6f-470db7ce6b1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:01.785529 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecace57-575d-4640-8e6f-470db7ce6b1f None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:01.804379 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 464/920] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:57:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:01.805478 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecace57-575d-4640-8e6f-470db7ce6b1f None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:01.824580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1064a-0b17-4633-9136-5c96b5363597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:01.825433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1064a-0b17-4633-9136-5c96b5363597 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:01.825949 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1064a-0b17-4633-9136-5c96b5363597 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:01.826389 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1064a-0b17-4633-9136-5c96b5363597 None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:01.827160 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1064a-0b17-4633-9136-5c96b5363597 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:01.827610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1064a-0b17-4633-9136-5c96b5363597 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:01.829185 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1064a-0b17-4633-9136-5c96b5363597 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:01.834707 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 457/921] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 23 07:57:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:01.841190 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1064a-0b17-4633-9136-5c96b5363597 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:01.902194 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:01.918859 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecace57-575d-4640-8e6f-470db7ce6b1f None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:01.955237 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2130c-a559-4b78-a605-8df88ac2190b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:01.956275 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2130c-a559-4b78-a605-8df88ac2190b None admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:01.956275 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2130c-a559-4b78-a605-8df88ac2190b None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:01.956616 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2130c-a559-4b78-a605-8df88ac2190b None admin] PATH_INFO: `/v3/projects/a80ab70ab6b9415c98017d05512c33eb/users/970300b51d504a2bbc48158855f02f34/roles/0c9e286fb47049feb93649dbd95342a1` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:01.959861 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b2130c-a559-4b78-a605-8df88ac2190b None admin] RBAC: Authorizing `identity:create_grant(project_id=a80ab70ab6b9415c98017d05512c33eb, user_id=970300b51d504a2bbc48158855f02f34, role_id=0c9e286fb47049feb93649dbd95342a1)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:01.961307 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b2130c-a559-4b78-a605-8df88ac2190b None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:01.974215 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:01.982007 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1064a-0b17-4633-9136-5c96b5363597 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:02.016459 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd458645-5ef8-4e40-a394-152c11af56b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:02.017065 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd458645-5ef8-4e40-a394-152c11af56b2 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:02.017345 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd458645-5ef8-4e40-a394-152c11af56b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:02.017617 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd458645-5ef8-4e40-a394-152c11af56b2 None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:02.018234 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd458645-5ef8-4e40-a394-152c11af56b2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:02.018561 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd458645-5ef8-4e40-a394-152c11af56b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:02.019926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd458645-5ef8-4e40-a394-152c11af56b2 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:02.024893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 458/922] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 23 07:57:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:02.030722 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd458645-5ef8-4e40-a394-152c11af56b2 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:02.073495 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 465/923] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 23 07:57:01 2022] PUT /identity/v3/projects/a80ab70ab6b9415c98017d05512c33eb/users/970300b51d504a2bbc48158855f02f34/roles/0c9e286fb47049feb93649dbd95342a1 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 07:57:02.156715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd458645-5ef8-4e40-a394-152c11af56b2 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:02.195097 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7e112-ade7-407d-a130-709c33369f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:02.195715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7e112-ade7-407d-a130-709c33369f50 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:02.196043 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7e112-ade7-407d-a130-709c33369f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:02.196359 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7e112-ade7-407d-a130-709c33369f50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:02.197138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7e112-ade7-407d-a130-709c33369f50 None admin] RBAC: Adding query filter params (interface=public, service_id=b0eaa7a78e6e41a7bb03a5c13e614dbe, region_id=RegionOne) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:02.197439 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7e112-ade7-407d-a130-709c33369f50 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:02.199125 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7e112-ade7-407d-a130-709c33369f50 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:02.209663 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 459/924] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Aug 23 07:57:02 2022] GET /identity/v3/endpoints?service_id=b0eaa7a78e6e41a7bb03a5c13e614dbe&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:57:02.211441 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2130c-a559-4b78-a605-8df88ac2190b None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:02.292432 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b7d6a-9cf0-4d7e-bdc2-16d281de7755 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:02.293061 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b7d6a-9cf0-4d7e-bdc2-16d281de7755 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:02.293534 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b7d6a-9cf0-4d7e-bdc2-16d281de7755 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:02.295378 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 460/925] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:57:02.300364 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985405b-13d3-4dcb-ac93-25a6d486aec7 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:02.300653 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985405b-13d3-4dcb-ac93-25a6d486aec7 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:02.300927 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985405b-13d3-4dcb-ac93-25a6d486aec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:02.319743 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-f985405b-13d3-4dcb-ac93-25a6d486aec7 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:02.320937 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-f985405b-13d3-4dcb-ac93-25a6d486aec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:02.328477 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2130c-a559-4b78-a605-8df88ac2190b None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:02.339680 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:02.371632 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba883d7-a097-4afd-b370-db27f9cbae3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:02.372262 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba883d7-a097-4afd-b370-db27f9cbae3d None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:02.372604 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba883d7-a097-4afd-b370-db27f9cbae3d None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:02.372885 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba883d7-a097-4afd-b370-db27f9cbae3d None admin] PATH_INFO: `/v3/services` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:02.373821 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba883d7-a097-4afd-b370-db27f9cbae3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:02.375523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba883d7-a097-4afd-b370-db27f9cbae3d None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:02.387999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 466/926] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Aug 23 07:57:02 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 07:57:02.402221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 461/927] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:57:02.680369 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba883d7-a097-4afd-b370-db27f9cbae3d None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:02.689817 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6d25b-80bb-4acf-aabb-78b85ee5093a None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:02.690096 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6d25b-80bb-4acf-aabb-78b85ee5093a None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:02.690426 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6d25b-80bb-4acf-aabb-78b85ee5093a None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:02.692104 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 462/928] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:57:02.697167 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9716eb-6ad0-4433-a89b-64cc1cc6a97d None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:02.697459 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9716eb-6ad0-4433-a89b-64cc1cc6a97d None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:02.697742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9716eb-6ad0-4433-a89b-64cc1cc6a97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:02.697895 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:02.717080 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-0a9716eb-6ad0-4433-a89b-64cc1cc6a97d None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:02.718324 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-0a9716eb-6ad0-4433-a89b-64cc1cc6a97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:02.796916 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 463/929] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:57:02.813331 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba883d7-a097-4afd-b370-db27f9cbae3d None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:02.850247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f72125-e14e-4962-a5dc-b4a658c7c4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:02.851305 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f72125-e14e-4962-a5dc-b4a658c7c4da None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:02.851818 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f72125-e14e-4962-a5dc-b4a658c7c4da None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:02.852293 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f72125-e14e-4962-a5dc-b4a658c7c4da None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:02.853755 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f72125-e14e-4962-a5dc-b4a658c7c4da None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:02.855417 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f72125-e14e-4962-a5dc-b4a658c7c4da None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:02.864876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-05f72125-e14e-4962-a5dc-b4a658c7c4da None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:57:02.864876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:02.864876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:57:02.864876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:57:02.864876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:57:02.864876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:57:02.864876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:57:02.864876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:57:02.864876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:57:02.864876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:02.864876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:57:02.864876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:02.864876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:02.864876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:02.864876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:02.864876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:02.864876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:02.865865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:02.865865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:02.865865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:02.865865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:02.865865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:02.865865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:02.865865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:57:02.865865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:57:02.865865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:57:02.865865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:57:02.865865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:02.865865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:02.865865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:02.865865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:02.865865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:02.865865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:02.866750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:02.866750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:02.866750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:02.866750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:02.866750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:02.866750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:02.866750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:02.866750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:02.866750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:02.866750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:02.866750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:57:02.866750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:57:02.866750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:57:02.866750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:02.869100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 467/930] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 23 07:57:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:02.875116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9716eb-6ad0-4433-a89b-64cc1cc6a97d None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:02.974877 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:02.978235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9716eb-6ad0-4433-a89b-64cc1cc6a97d None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:03.013070 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301dcb70-b918-4998-b187-c9f6755158b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:03.013687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301dcb70-b918-4998-b187-c9f6755158b4 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:03.013967 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301dcb70-b918-4998-b187-c9f6755158b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:03.014240 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301dcb70-b918-4998-b187-c9f6755158b4 None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:03.014947 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301dcb70-b918-4998-b187-c9f6755158b4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:03.015255 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301dcb70-b918-4998-b187-c9f6755158b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:03.016745 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301dcb70-b918-4998-b187-c9f6755158b4 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:03.022203 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 464/931] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 23 07:57:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:03.028159 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f72125-e14e-4962-a5dc-b4a658c7c4da None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:03.070061 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301dcb70-b918-4998-b187-c9f6755158b4 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:03.122735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:03.153359 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f72125-e14e-4962-a5dc-b4a658c7c4da None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:03.175939 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301dcb70-b918-4998-b187-c9f6755158b4 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:03.196934 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f09247-0dd3-457c-aba1-19cd23531766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:03.197573 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f09247-0dd3-457c-aba1-19cd23531766 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:03.197860 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f09247-0dd3-457c-aba1-19cd23531766 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:03.198134 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f09247-0dd3-457c-aba1-19cd23531766 None admin] PATH_INFO: `/v3/services` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:03.199081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f09247-0dd3-457c-aba1-19cd23531766 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:03.199995 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f09247-0dd3-457c-aba1-19cd23531766 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:03.201779 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f09247-0dd3-457c-aba1-19cd23531766 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:03.210450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 468/932] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 23 07:57:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:03.215463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f09247-0dd3-457c-aba1-19cd23531766 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:03.218728 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e032139-32b5-48d3-9a0b-f6f0c14a8c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:03.219576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e032139-32b5-48d3-9a0b-f6f0c14a8c6f None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:03.219952 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e032139-32b5-48d3-9a0b-f6f0c14a8c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:03.220321 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e032139-32b5-48d3-9a0b-f6f0c14a8c6f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:03.220992 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e032139-32b5-48d3-9a0b-f6f0c14a8c6f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:03.222498 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e032139-32b5-48d3-9a0b-f6f0c14a8c6f None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:03.232485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-1e032139-32b5-48d3-9a0b-f6f0c14a8c6f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 07:57:03.232485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:03.232485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:57:03.232485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:57:03.232485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:57:03.232485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:57:03.232485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:57:03.232485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:57:03.232485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 07:57:03.232485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:03.232485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:57:03.232485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:03.232485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:03.232485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:03.232485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:03.232485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:03.232485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:03.233684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:03.233684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:03.233684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:03.233684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:03.233684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:03.233684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:03.233684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:57:03.233684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:57:03.233684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:57:03.233684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:57:03.233684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:03.233684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:03.233684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:03.233684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:03.233684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:03.233684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:03.234762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:03.234762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:03.234762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:03.234762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:03.234762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:03.234762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:03.234762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:03.234762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:03.234762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:03.234762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:03.234762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:57:03.234762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:57:03.234762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 07:57:03.234762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:03.236584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 465/933] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 23 07:57:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:57:03.241362 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e032139-32b5-48d3-9a0b-f6f0c14a8c6f None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:03.257041 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:03.330542 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f09247-0dd3-457c-aba1-19cd23531766 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:03.354447 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e032139-32b5-48d3-9a0b-f6f0c14a8c6f None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:03.367163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f77b62-c19c-4c9d-a5eb-e379535488f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:03.368198 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f77b62-c19c-4c9d-a5eb-e379535488f4 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:03.368811 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f77b62-c19c-4c9d-a5eb-e379535488f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:03.369314 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f77b62-c19c-4c9d-a5eb-e379535488f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:03.370204 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f77b62-c19c-4c9d-a5eb-e379535488f4 None admin] RBAC: Adding query filter params (interface=public, service_id=c172b8ceab9d4cd1ab9cb590aa9c1941, region_id=RegionOne) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:03.370758 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f77b62-c19c-4c9d-a5eb-e379535488f4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:03.372504 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f77b62-c19c-4c9d-a5eb-e379535488f4 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:03.378552 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 469/934] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Aug 23 07:57:03 2022] GET /identity/v3/endpoints?service_id=c172b8ceab9d4cd1ab9cb590aa9c1941&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:03.386804 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f77b62-c19c-4c9d-a5eb-e379535488f4 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:03.388428 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:03.405562 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69730e41-f7cd-4eb4-93f9-4b6a59d9314a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:03.406204 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69730e41-f7cd-4eb4-93f9-4b6a59d9314a None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:03.406549 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69730e41-f7cd-4eb4-93f9-4b6a59d9314a None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:03.406828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69730e41-f7cd-4eb4-93f9-4b6a59d9314a None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:03.407455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69730e41-f7cd-4eb4-93f9-4b6a59d9314a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:03.407934 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69730e41-f7cd-4eb4-93f9-4b6a59d9314a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:03.409132 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69730e41-f7cd-4eb4-93f9-4b6a59d9314a None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:03.414489 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 466/935] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 23 07:57:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:57:03.419998 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69730e41-f7cd-4eb4-93f9-4b6a59d9314a None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:03.513934 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f77b62-c19c-4c9d-a5eb-e379535488f4 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:03.523080 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:03.551884 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834582e-9dba-420a-9727-1be53192a740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:03.552515 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834582e-9dba-420a-9727-1be53192a740 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:03.552800 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834582e-9dba-420a-9727-1be53192a740 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:03.553073 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834582e-9dba-420a-9727-1be53192a740 None admin] PATH_INFO: `/v3/services` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:03.553677 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834582e-9dba-420a-9727-1be53192a740 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:03.555112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834582e-9dba-420a-9727-1be53192a740 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:03.562695 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69730e41-f7cd-4eb4-93f9-4b6a59d9314a None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:03.570625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 470/936] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Aug 23 07:57:03 2022] GET /identity/v3/services => generated 1497 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 07:57:03.604720 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2137b-84f3-42fd-9581-1060517318f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:03.605720 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2137b-84f3-42fd-9581-1060517318f3 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:03.606302 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2137b-84f3-42fd-9581-1060517318f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:03.606793 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2137b-84f3-42fd-9581-1060517318f3 None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:03.607654 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df2137b-84f3-42fd-9581-1060517318f3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:03.608220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df2137b-84f3-42fd-9581-1060517318f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:03.609874 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df2137b-84f3-42fd-9581-1060517318f3 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:03.616562 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 467/937] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 23 07:57:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:03.623545 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834582e-9dba-420a-9727-1be53192a740 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:03.703412 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:03.739799 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834582e-9dba-420a-9727-1be53192a740 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:03.777239 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9268a-952b-4880-adc6-fc152f790d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:03.777834 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9268a-952b-4880-adc6-fc152f790d3f None admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:03.778156 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9268a-952b-4880-adc6-fc152f790d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:03.778461 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9268a-952b-4880-adc6-fc152f790d3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:03.779137 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9268a-952b-4880-adc6-fc152f790d3f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:03.780632 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9268a-952b-4880-adc6-fc152f790d3f None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:03.863575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 471/938] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 07:57:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:57:04.057471 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798dc5e-d2be-4848-b1f1-8d3f0a9171d5 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:04.057954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798dc5e-d2be-4848-b1f1-8d3f0a9171d5 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:04.057954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798dc5e-d2be-4848-b1f1-8d3f0a9171d5 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:04.059599 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 468/939] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:57:04.065180 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6b0e7-b928-4728-895c-f206acc92731 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:04.065472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6b0e7-b928-4728-895c-f206acc92731 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:04.065751 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6b0e7-b928-4728-895c-f206acc92731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:04.085800 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-7bc6b0e7-b928-4728-895c-f206acc92731 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:04.087899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-7bc6b0e7-b928-4728-895c-f206acc92731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:04.173235 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 472/940] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:57:04.412065 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14604341-fdb1-4cdd-93ca-7989bf71b822 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:04.412261 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14604341-fdb1-4cdd-93ca-7989bf71b822 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:04.412545 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14604341-fdb1-4cdd-93ca-7989bf71b822 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:04.414131 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 469/941] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:57:04.420207 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db001487-6dbc-408f-b62a-a6f4c718bc5d None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:04.420500 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db001487-6dbc-408f-b62a-a6f4c718bc5d None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:04.420782 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db001487-6dbc-408f-b62a-a6f4c718bc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:04.439867 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14604341-fdb1-4cdd-93ca-7989bf71b822 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:04.440887 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-db001487-6dbc-408f-b62a-a6f4c718bc5d None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:04.442078 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-db001487-6dbc-408f-b62a-a6f4c718bc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:04.509505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:04.538445 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 473/942] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:57:04.556456 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14604341-fdb1-4cdd-93ca-7989bf71b822 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:04.593856 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d337e-f91a-4d66-b8a7-832bf444c406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:04.594859 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d337e-f91a-4d66-b8a7-832bf444c406 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:04.595355 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d337e-f91a-4d66-b8a7-832bf444c406 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:04.595855 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d337e-f91a-4d66-b8a7-832bf444c406 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:04.602984 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:04.607092 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d337e-f91a-4d66-b8a7-832bf444c406 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:57:04.611963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-865d337e-f91a-4d66-b8a7-832bf444c406 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 07:57:04.611963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:04.611963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:04.611963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:04.611963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:04.611963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:04.611963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:04.611963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:04.611963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:04.611963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:04.611963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:04.611963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:04.611963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:57:04.611963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:57:04.611963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:57:04.611963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:57:04.621761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:57:04.621761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:57:04.621761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:57:04.621761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:57:04.621761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:04.621761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:04.621761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:04.621761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:04.621761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:04.621761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:04.621761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:04.621761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:04.621761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:04.621761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:04.621761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:04.621761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:04.622744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:04.622744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:04.622744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:04.622744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:04.622744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:57:04.622744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:57:04.622744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:57:04.622744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:57:04.622744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:57:04.622744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:57:04.622744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 07:57:04.622744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:04.622744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 470/943] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Aug 23 07:57:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:04.623430 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db001487-6dbc-408f-b62a-a6f4c718bc5d None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:04.734993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db001487-6dbc-408f-b62a-a6f4c718bc5d None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:04.776607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b730788-6a30-4ef1-aa54-79d4fe48c994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:04.777700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b730788-6a30-4ef1-aa54-79d4fe48c994 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:04.778188 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b730788-6a30-4ef1-aa54-79d4fe48c994 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:04.778701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b730788-6a30-4ef1-aa54-79d4fe48c994 None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:04.779592 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b730788-6a30-4ef1-aa54-79d4fe48c994 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:04.780103 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b730788-6a30-4ef1-aa54-79d4fe48c994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:04.781796 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b730788-6a30-4ef1-aa54-79d4fe48c994 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:04.791571 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 474/944] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Aug 23 07:57:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:04.797522 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d337e-f91a-4d66-b8a7-832bf444c406 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:04.808521 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b730788-6a30-4ef1-aa54-79d4fe48c994 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:04.853637 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:04.905895 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d337e-f91a-4d66-b8a7-832bf444c406 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:04.916701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b730788-6a30-4ef1-aa54-79d4fe48c994 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:04.947091 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63d91b-c5c5-4660-9c7c-fceebb2c8e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:04.970162 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63d91b-c5c5-4660-9c7c-fceebb2c8e22 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:04.970162 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63d91b-c5c5-4660-9c7c-fceebb2c8e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:04.970162 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63d91b-c5c5-4660-9c7c-fceebb2c8e22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:04.970162 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63d91b-c5c5-4660-9c7c-fceebb2c8e22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:04.970162 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63d91b-c5c5-4660-9c7c-fceebb2c8e22 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:04.970603 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b7a6c-2864-4ca6-85b0-fb213c484eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:04.970603 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b7a6c-2864-4ca6-85b0-fb213c484eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:04.970603 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b7a6c-2864-4ca6-85b0-fb213c484eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:04.970603 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b7a6c-2864-4ca6-85b0-fb213c484eb0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:04.970913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b7a6c-2864-4ca6-85b0-fb213c484eb0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:04.970913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b7a6c-2864-4ca6-85b0-fb213c484eb0 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:04.978774 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-8e6b7a6c-2864-4ca6-85b0-fb213c484eb0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 07:57:04.978774 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:04.978774 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:57:04.978774 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:57:04.978774 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:57:04.978774 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:57:04.978774 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:57:04.978774 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:57:04.978774 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 07:57:04.978774 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:04.978774 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:57:04.978774 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:04.978774 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:04.978774 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:04.978774 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:04.978774 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:04.980056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:04.980056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:04.980056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:04.980056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:04.980056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:04.980056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:04.980056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:04.980056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:57:04.980056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:57:04.980056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:57:04.980056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:57:04.980056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:04.980056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:04.980056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:04.980056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:04.980056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:04.980056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:04.981048 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:04.981048 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:04.981048 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:04.981048 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:04.981048 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:04.981048 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:04.981048 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:04.981048 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:04.981048 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:04.981048 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:04.981048 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:57:04.981048 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:57:04.981048 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 07:57:04.981048 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:04.981048 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 475/945] 10.222.0.57 () {56 vars in 1132 bytes} [Tue Aug 23 07:57:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:57:04.984876 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-0d63d91b-c5c5-4660-9c7c-fceebb2c8e22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:57:04.984876 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:04.984876 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:04.984876 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:04.984876 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:04.984876 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:04.984876 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:04.984876 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:04.984876 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:04.984876 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:04.984876 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:04.984876 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:04.984876 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:57:04.984876 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:57:04.984876 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:57:04.984876 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:57:04.990870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:04.990870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:04.990870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:04.990870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:04.990870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:04.990870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:04.990870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:04.990870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:04.990870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:04.990870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:04.990870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:04.990870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:04.990870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:04.990870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:04.990870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:04.990870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:04.990870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:57:04.993069 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:57:04.993069 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:57:04.993069 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:04.993069 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 471/946] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:57:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:04.994347 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b7a6c-2864-4ca6-85b0-fb213c484eb0 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:04.996337 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63d91b-c5c5-4660-9c7c-fceebb2c8e22 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:05.049466 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:05.099403 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b7a6c-2864-4ca6-85b0-fb213c484eb0 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:05.104378 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63d91b-c5c5-4660-9c7c-fceebb2c8e22 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:05.106826 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:05.135984 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958283bd-5523-4d10-ad50-62528e0747d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:05.136664 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958283bd-5523-4d10-ad50-62528e0747d6 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:05.136944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958283bd-5523-4d10-ad50-62528e0747d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:05.137218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958283bd-5523-4d10-ad50-62528e0747d6 None admin] PATH_INFO: `/v3/services` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:05.137904 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958283bd-5523-4d10-ad50-62528e0747d6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:05.138128 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958283bd-5523-4d10-ad50-62528e0747d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:05.139875 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958283bd-5523-4d10-ad50-62528e0747d6 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:05.142512 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849778e-b5b3-4203-ba7e-b52bde05982c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:05.143356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849778e-b5b3-4203-ba7e-b52bde05982c None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:05.143844 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849778e-b5b3-4203-ba7e-b52bde05982c None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:05.144316 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849778e-b5b3-4203-ba7e-b52bde05982c None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:05.145154 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849778e-b5b3-4203-ba7e-b52bde05982c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:05.145303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 476/947] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 23 07:57:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:05.145838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849778e-b5b3-4203-ba7e-b52bde05982c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:05.147486 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849778e-b5b3-4203-ba7e-b52bde05982c None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:05.151504 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958283bd-5523-4d10-ad50-62528e0747d6 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:05.162737 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 472/948] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:57:05.168838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849778e-b5b3-4203-ba7e-b52bde05982c None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:05.255596 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958283bd-5523-4d10-ad50-62528e0747d6 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:05.292115 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0dd3e5-5144-4b75-9fad-160ad90b2289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:05.293139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0dd3e5-5144-4b75-9fad-160ad90b2289 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:05.293629 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0dd3e5-5144-4b75-9fad-160ad90b2289 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:05.294130 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0dd3e5-5144-4b75-9fad-160ad90b2289 None admin] PATH_INFO: `/v3/services` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:05.294985 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0dd3e5-5144-4b75-9fad-160ad90b2289 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:05.295175 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849778e-b5b3-4203-ba7e-b52bde05982c None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:05.295667 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0dd3e5-5144-4b75-9fad-160ad90b2289 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:05.297252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0dd3e5-5144-4b75-9fad-160ad90b2289 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:05.302810 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 477/949] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 23 07:57:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:57:05.309965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:05.311162 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0dd3e5-5144-4b75-9fad-160ad90b2289 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:05.337896 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca1bc2-d52a-42f2-808f-0adbf475f8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:05.338576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca1bc2-d52a-42f2-808f-0adbf475f8fc None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:05.338861 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca1bc2-d52a-42f2-808f-0adbf475f8fc None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:05.339139 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca1bc2-d52a-42f2-808f-0adbf475f8fc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:05.349774 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca1bc2-d52a-42f2-808f-0adbf475f8fc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:05.351093 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:05.351275 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca1bc2-d52a-42f2-808f-0adbf475f8fc None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:05.369518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-96ca1bc2-d52a-42f2-808f-0adbf475f8fc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 07:57:05.369518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:05.369518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:05.369518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:05.369518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:05.369518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:05.369518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:05.369518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:05.369518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:05.369518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:05.369518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:05.369518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:05.369518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:57:05.369518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:57:05.369518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:57:05.369518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:57:05.370565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:05.370565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:05.370565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:57:05.370565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:57:05.370565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:57:05.370565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:57:05.370565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:05.370565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:05.370565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:05.370565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:05.370565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:05.370565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:05.370565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:05.370565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:05.370565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:05.370565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:05.370565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:05.370565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:05.371600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:05.371600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:05.371600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:57:05.371600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:57:05.371600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:57:05.371600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:57:05.371600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:57:05.371600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:57:05.371600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 07:57:05.371600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:05.378693 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 473/950] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 23 07:57:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:05.379803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca1bc2-d52a-42f2-808f-0adbf475f8fc None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:05.439604 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0dd3e5-5144-4b75-9fad-160ad90b2289 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:05.492933 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca1bc2-d52a-42f2-808f-0adbf475f8fc None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:05.497178 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a1fed-d446-4959-a9c3-068f22b5b79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:05.498091 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a1fed-d446-4959-a9c3-068f22b5b79d None admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:05.498648 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a1fed-d446-4959-a9c3-068f22b5b79d None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:05.499128 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a1fed-d446-4959-a9c3-068f22b5b79d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:05.500050 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a1fed-d446-4959-a9c3-068f22b5b79d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:05.502188 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a1fed-d446-4959-a9c3-068f22b5b79d None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:05.530392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a40c7-1494-4637-8f02-f56db00b4544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:05.530991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a40c7-1494-4637-8f02-f56db00b4544 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:05.531274 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a40c7-1494-4637-8f02-f56db00b4544 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:05.531550 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a40c7-1494-4637-8f02-f56db00b4544 None admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:05.532306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a40c7-1494-4637-8f02-f56db00b4544 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:05.532584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a40c7-1494-4637-8f02-f56db00b4544 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:05.534010 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a40c7-1494-4637-8f02-f56db00b4544 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:05.552891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 474/951] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Aug 23 07:57:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:05.558391 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a40c7-1494-4637-8f02-f56db00b4544 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:05.587371 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:05.638509 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 478/952] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 07:57:05 2022] POST /identity/v3/endpoints => generated 347 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:57:05.669252 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a40c7-1494-4637-8f02-f56db00b4544 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:05.674027 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c0ab6-6b22-4a6c-821a-22ae62487b9f None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:05.674362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c0ab6-6b22-4a6c-821a-22ae62487b9f None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:05.674625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c0ab6-6b22-4a6c-821a-22ae62487b9f None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:05.676287 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 479/953] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:57:05.683985 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650eb13-601e-4b0b-9746-8420e90bca5e None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:05.684272 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650eb13-601e-4b0b-9746-8420e90bca5e None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:05.684720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650eb13-601e-4b0b-9746-8420e90bca5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:05.706524 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-a650eb13-601e-4b0b-9746-8420e90bca5e None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:05.708908 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-a650eb13-601e-4b0b-9746-8420e90bca5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:05.720225 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0db097-55a0-44cb-b706-d0ece0b94586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:05.721030 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0db097-55a0-44cb-b706-d0ece0b94586 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:05.721405 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0db097-55a0-44cb-b706-d0ece0b94586 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:05.721771 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0db097-55a0-44cb-b706-d0ece0b94586 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:05.810388 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 480/954] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:57:05.812050 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0db097-55a0-44cb-b706-d0ece0b94586 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:05.813636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0db097-55a0-44cb-b706-d0ece0b94586 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:05.851379 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:05.860937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a67b0-5907-4421-a382-1bf4296e1989 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:05.861220 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a67b0-5907-4421-a382-1bf4296e1989 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:05.866730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a67b0-5907-4421-a382-1bf4296e1989 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:05.866730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 481/955] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:57:05.872129 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2019c9d-d573-4fe4-91e2-8fb830b9e685 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:05.872492 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2019c9d-d573-4fe4-91e2-8fb830b9e685 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:05.872838 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2019c9d-d573-4fe4-91e2-8fb830b9e685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:05.897690 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-c2019c9d-d573-4fe4-91e2-8fb830b9e685 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:05.900171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c2019c9d-d573-4fe4-91e2-8fb830b9e685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:05.919979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:05.946990 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 475/956] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:57:05 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:57:05.955557 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0db097-55a0-44cb-b706-d0ece0b94586 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:05.994363 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 482/957] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:57:06.072230 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0db097-55a0-44cb-b706-d0ece0b94586 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:06.093887 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2019c9d-d573-4fe4-91e2-8fb830b9e685 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:06.096458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:06.110240 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfecec-d914-49fb-aee9-52ffbbb66fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:06.110940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfecec-d914-49fb-aee9-52ffbbb66fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:06.111169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfecec-d914-49fb-aee9-52ffbbb66fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:06.111432 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfecec-d914-49fb-aee9-52ffbbb66fd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:06.125500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bfecec-d914-49fb-aee9-52ffbbb66fd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:06.126835 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bfecec-d914-49fb-aee9-52ffbbb66fd0 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:06.146611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-68bfecec-d914-49fb-aee9-52ffbbb66fd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:57:06.146611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:06.146611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:06.146611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:06.146611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:06.146611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:06.146611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:06.146611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:06.146611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:06.146611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:06.146611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:06.146611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:06.146611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:57:06.146611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:57:06.146611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:57:06.146611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:57:06.148544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:06.148544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:06.148544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:06.148544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:06.148544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:06.148544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:06.148544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:06.148544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:06.148544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:06.148544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:06.148544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:06.148544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:06.148544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:06.148544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:06.148544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:06.148544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:06.148544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:57:06.151136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:57:06.151136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:57:06.151136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:06.151136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 476/958] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:06.158394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfecec-d914-49fb-aee9-52ffbbb66fd0 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:06.226222 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2019c9d-d573-4fe4-91e2-8fb830b9e685 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:06.270370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d13e59-c4dd-4a1e-a18f-1d883e8995de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:06.271368 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d13e59-c4dd-4a1e-a18f-1d883e8995de None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:06.271714 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d13e59-c4dd-4a1e-a18f-1d883e8995de None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:06.272364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d13e59-c4dd-4a1e-a18f-1d883e8995de None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:06.272955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d13e59-c4dd-4a1e-a18f-1d883e8995de None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:06.274456 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d13e59-c4dd-4a1e-a18f-1d883e8995de None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:06.285601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-a4d13e59-c4dd-4a1e-a18f-1d883e8995de None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:57:06.285601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:06.285601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:57:06.285601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:57:06.285601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:57:06.285601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:57:06.285601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:57:06.285601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:57:06.285601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:57:06.285601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:06.285601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:57:06.285601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:06.285601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:06.285601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:06.285601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:06.285601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:06.285601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:06.292581 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:06.292581 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:06.292581 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:06.292581 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:06.292581 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:06.292581 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:06.292581 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:57:06.292581 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:57:06.292581 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:57:06.292581 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:57:06.292581 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:06.292581 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:06.292581 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:06.292581 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:06.292581 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:06.292581 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:06.293494 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:06.293494 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:06.293494 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:06.293494 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:06.293494 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:06.293494 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:06.293494 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:06.293494 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:06.293494 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:06.293494 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:06.293494 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:57:06.293494 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:57:06.293494 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:57:06.293494 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:06.293494 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 483/959] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 23 07:57:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:57:06.294313 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d13e59-c4dd-4a1e-a18f-1d883e8995de None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:06.294387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfecec-d914-49fb-aee9-52ffbbb66fd0 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:06.315252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:06.325532 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242482a-700a-4eb2-89d3-fa4ba827120c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:06.326062 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242482a-700a-4eb2-89d3-fa4ba827120c None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:06.326361 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242482a-700a-4eb2-89d3-fa4ba827120c None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:06.326556 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242482a-700a-4eb2-89d3-fa4ba827120c None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:06.327188 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242482a-700a-4eb2-89d3-fa4ba827120c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:06.327486 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242482a-700a-4eb2-89d3-fa4ba827120c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:06.328861 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242482a-700a-4eb2-89d3-fa4ba827120c None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:06.346694 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 477/960] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:06.346694 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242482a-700a-4eb2-89d3-fa4ba827120c None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:06.378814 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:06.410464 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d13e59-c4dd-4a1e-a18f-1d883e8995de None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:06.446488 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242482a-700a-4eb2-89d3-fa4ba827120c None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:06.447711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90c282-7dbd-40f0-a1fd-bf16bd4f8386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:06.448945 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90c282-7dbd-40f0-a1fd-bf16bd4f8386 None admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:06.450142 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90c282-7dbd-40f0-a1fd-bf16bd4f8386 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:06.450638 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90c282-7dbd-40f0-a1fd-bf16bd4f8386 None admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:06.451569 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c90c282-7dbd-40f0-a1fd-bf16bd4f8386 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:06.453406 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c90c282-7dbd-40f0-a1fd-bf16bd4f8386 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:06.456732 dv-cinder-854070-4-smb devstack@keystone.service[81771]: WARNING keystone.server.flask.common [None req-0c90c282-7dbd-40f0-a1fd-bf16bd4f8386 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 23 07:57:06.482763 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b343e-a158-473b-8589-0646597773c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:06.483375 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b343e-a158-473b-8589-0646597773c9 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:06.483659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b343e-a158-473b-8589-0646597773c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:06.483933 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b343e-a158-473b-8589-0646597773c9 None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:06.484560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b343e-a158-473b-8589-0646597773c9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:06.484864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b343e-a158-473b-8589-0646597773c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:06.486240 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b343e-a158-473b-8589-0646597773c9 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:06.491446 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 478/961] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 23 07:57:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:06.494388 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b343e-a158-473b-8589-0646597773c9 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:06.519072 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.sql.core [None req-0c90c282-7dbd-40f0-a1fd-bf16bd4f8386 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 07:57:06.519072 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 07:57:06.519072 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [parameters: {'id': 'b62478f4add443fba2785db4b0816082', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 07:57:06.519072 dv-cinder-854070-4-smb devstack@keystone.service[81771]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81771) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 07:57:06.535630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-0c90c282-7dbd-40f0-a1fd-bf16bd4f8386 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b62478f4add443fba2785db4b0816082.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b62478f4add443fba2785db4b0816082. Aug 23 07:57:06.535630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:06.535630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 07:57:06.535630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 07:57:06.535630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 07:57:06.535630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 07:57:06.535630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 07:57:06.535630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 07:57:06.535630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 07:57:06.535630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application conn.query(q) Aug 23 07:57:06.535630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 07:57:06.535630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 07:57:06.535630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 07:57:06.536473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application result.read() Aug 23 07:57:06.536473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 07:57:06.536473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 07:57:06.536473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 07:57:06.536473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 07:57:06.536473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 07:57:06.536473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 07:57:06.536473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 07:57:06.536473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 07:57:06.536473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 07:57:06.536473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:06.536473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 07:57:06.536473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:06.536473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:06.536473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 07:57:06.536473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 07:57:06.536473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 23 07:57:06.536473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 23 07:57:06.537442 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 07:57:06.537442 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application next(self.gen) Aug 23 07:57:06.537442 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 07:57:06.537442 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application yield resource Aug 23 07:57:06.537442 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 07:57:06.537442 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application next(self.gen) Aug 23 07:57:06.537442 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 07:57:06.537442 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 07:57:06.537442 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 07:57:06.537442 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 07:57:06.537442 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 07:57:06.537442 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise self.value Aug 23 07:57:06.537442 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 07:57:06.537442 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 07:57:06.537442 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 07:57:06.537442 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application session.commit() Aug 23 07:57:06.537442 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 07:57:06.538410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 07:57:06.538410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 07:57:06.538410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 07:57:06.538410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 07:57:06.538410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self.session.flush() Aug 23 07:57:06.538410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 07:57:06.538410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 07:57:06.538410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 07:57:06.538410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 07:57:06.538410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 07:57:06.538410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application compat.raise_( Aug 23 07:57:06.538410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 07:57:06.538410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception Aug 23 07:57:06.538410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 07:57:06.538410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 07:57:06.538410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 07:57:06.538410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 07:57:06.539312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 07:57:06.539312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 07:57:06.539312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 07:57:06.539312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 07:57:06.539312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 23 07:57:06.539312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 23 07:57:06.539312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 07:57:06.539312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 07:57:06.539312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 07:57:06.539312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 07:57:06.539312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 07:57:06.539312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 07:57:06.539312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 07:57:06.539312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 07:57:06.539312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 07:57:06.540706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 07:57:06.540706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 07:57:06.540706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception Aug 23 07:57:06.540706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 07:57:06.540706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 07:57:06.540706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 07:57:06.540706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 07:57:06.540706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 07:57:06.540706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 07:57:06.540706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 07:57:06.540706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application conn.query(q) Aug 23 07:57:06.540706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 07:57:06.540706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 07:57:06.540706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 07:57:06.540706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application result.read() Aug 23 07:57:06.540706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 07:57:06.540706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 07:57:06.541606 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 07:57:06.541606 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 07:57:06.541606 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 07:57:06.541606 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 07:57:06.541606 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 07:57:06.541606 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 07:57:06.541606 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 07:57:06.541606 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 07:57:06.541606 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [parameters: {'id': 'b62478f4add443fba2785db4b0816082', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 07:57:06.541606 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 07:57:06.541606 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:06.541606 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:57:06.541606 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:06.541606 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:06.541606 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 23 07:57:06.542450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 23 07:57:06.542450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 07:57:06.542450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 07:57:06.542450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 23 07:57:06.542450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:06.542450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:57:06.542450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:06.542450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:06.542450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:06.542450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:06.542450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:06.542450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:06.542450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:06.542450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:06.542450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:06.542450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:06.542450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:06.543382 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:06.543382 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 23 07:57:06.543382 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 23 07:57:06.543382 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:06.543382 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:06.543382 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 23 07:57:06.543382 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 23 07:57:06.543382 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b62478f4add443fba2785db4b0816082. Aug 23 07:57:06.543382 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:06.543382 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 484/962] 10.222.0.57 () {60 vars in 1140 bytes} [Tue Aug 23 07:57:06 2022] POST /identity/v3/projects => generated 262 bytes in 249 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:06.543382 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90c282-7dbd-40f0-a1fd-bf16bd4f8386 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:06.607065 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:06.609845 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b343e-a158-473b-8589-0646597773c9 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:06.614942 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:06.646840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c691d28-b643-46d3-af75-33ba74994c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:06.646840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c691d28-b643-46d3-af75-33ba74994c1b None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:06.646840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c691d28-b643-46d3-af75-33ba74994c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:06.646840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c691d28-b643-46d3-af75-33ba74994c1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:06.653891 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90c282-7dbd-40f0-a1fd-bf16bd4f8386 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:06.656263 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c691d28-b643-46d3-af75-33ba74994c1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:06.657714 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c691d28-b643-46d3-af75-33ba74994c1b None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:06.672511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-3c691d28-b643-46d3-af75-33ba74994c1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:57:06.672511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:06.672511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:06.672511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:06.672511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:06.672511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:06.672511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:06.672511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:06.672511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:06.672511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:06.672511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:06.672511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:06.672511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:57:06.672511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:57:06.672511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:57:06.673424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:57:06.673424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:06.673424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:06.673424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:06.673424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:06.673424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:06.673424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:06.673424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:06.673424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:06.673424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:06.673424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:06.673424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:06.673424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:06.673424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:06.673424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:06.673424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:06.673424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:06.679457 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:57:06.679457 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:57:06.679457 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:57:06.679457 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:57:06.679457 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:57:06.679457 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:57:06.679457 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:57:06.679457 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:06.679457 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 479/963] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:57:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:06.679457 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c691d28-b643-46d3-af75-33ba74994c1b None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:06.694626 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377a2cf-cfca-4b7d-9d70-2c8b769d1589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:06.695250 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377a2cf-cfca-4b7d-9d70-2c8b769d1589 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:06.695737 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377a2cf-cfca-4b7d-9d70-2c8b769d1589 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:06.696915 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377a2cf-cfca-4b7d-9d70-2c8b769d1589 None admin] PATH_INFO: `/v3/services` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:06.698152 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377a2cf-cfca-4b7d-9d70-2c8b769d1589 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:06.699302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377a2cf-cfca-4b7d-9d70-2c8b769d1589 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:06.701580 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377a2cf-cfca-4b7d-9d70-2c8b769d1589 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:06.710087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 485/964] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 23 07:57:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:06.712057 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377a2cf-cfca-4b7d-9d70-2c8b769d1589 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:06.792158 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c691d28-b643-46d3-af75-33ba74994c1b None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:06.818671 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377a2cf-cfca-4b7d-9d70-2c8b769d1589 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:06.828230 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52633e64-4f94-4263-bea0-eaa9baa42846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:06.828891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52633e64-4f94-4263-bea0-eaa9baa42846 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:06.829176 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52633e64-4f94-4263-bea0-eaa9baa42846 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:06.829455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52633e64-4f94-4263-bea0-eaa9baa42846 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:06.838312 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52633e64-4f94-4263-bea0-eaa9baa42846 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:06.839812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52633e64-4f94-4263-bea0-eaa9baa42846 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:06.851384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-52633e64-4f94-4263-bea0-eaa9baa42846 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:57:06.851384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:06.851384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:06.851384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:06.851384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:06.851384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:06.851384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:06.851384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:06.851384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:06.851384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:06.851384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:06.851384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:06.851384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:57:06.851384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:57:06.851384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:57:06.852277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:57:06.852277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:06.852277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:06.852277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:06.852277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:06.852277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:06.852277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:06.852277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:06.852277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:06.852277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:06.852277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:06.852277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:06.852277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:06.852277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:06.852277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:06.852277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:06.852277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:06.853241 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:57:06.853241 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:57:06.853241 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:57:06.853241 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:57:06.853241 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:57:06.853241 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:57:06.853241 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:57:06.853241 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:06.853241 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 480/965] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:57:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:06.853816 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52633e64-4f94-4263-bea0-eaa9baa42846 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:06.862554 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5435787-b0cc-463b-adfc-170a799aa096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:06.863111 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5435787-b0cc-463b-adfc-170a799aa096 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:06.863612 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5435787-b0cc-463b-adfc-170a799aa096 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:06.863726 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5435787-b0cc-463b-adfc-170a799aa096 None admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:06.864348 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5435787-b0cc-463b-adfc-170a799aa096 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:06.864656 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5435787-b0cc-463b-adfc-170a799aa096 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:06.866084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5435787-b0cc-463b-adfc-170a799aa096 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:06.868315 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:06.877190 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:06.885157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 486/966] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:57:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:06.885157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5435787-b0cc-463b-adfc-170a799aa096 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:06.969098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52633e64-4f94-4263-bea0-eaa9baa42846 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:06.987105 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5435787-b0cc-463b-adfc-170a799aa096 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:07.005526 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad766e-9528-48c8-ad4d-3795e3ee693e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:07.006135 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad766e-9528-48c8-ad4d-3795e3ee693e None admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:07.006448 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad766e-9528-48c8-ad4d-3795e3ee693e None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:07.006723 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad766e-9528-48c8-ad4d-3795e3ee693e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:07.007366 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad766e-9528-48c8-ad4d-3795e3ee693e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:07.009268 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad766e-9528-48c8-ad4d-3795e3ee693e None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:07.023881 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffaed0b-be05-4db2-8045-c96dba26c60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:07.024724 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffaed0b-be05-4db2-8045-c96dba26c60b None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:07.025075 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffaed0b-be05-4db2-8045-c96dba26c60b None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:07.025457 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffaed0b-be05-4db2-8045-c96dba26c60b None admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:07.026805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffaed0b-be05-4db2-8045-c96dba26c60b None admin] RBAC: Adding query filter params (name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:07.027228 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffaed0b-be05-4db2-8045-c96dba26c60b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:07.028696 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffaed0b-be05-4db2-8045-c96dba26c60b None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:07.047026 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 487/967] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 23 07:57:06 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:07.047026 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffaed0b-be05-4db2-8045-c96dba26c60b None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:07.112504 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 481/968] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 07:57:06 2022] POST /identity/v3/endpoints => generated 349 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:57:07.120717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:07.180012 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffaed0b-be05-4db2-8045-c96dba26c60b None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:07.229693 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54744a4-f0b4-4bfc-8faa-afd1772d2114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:07.230391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54744a4-f0b4-4bfc-8faa-afd1772d2114 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:07.230672 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54744a4-f0b4-4bfc-8faa-afd1772d2114 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:07.231002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54744a4-f0b4-4bfc-8faa-afd1772d2114 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:07.231748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54744a4-f0b4-4bfc-8faa-afd1772d2114 None admin] RBAC: Adding query filter params (role.id=0c9e286fb47049feb93649dbd95342a1, scope.project.id=a80ab70ab6b9415c98017d05512c33eb, user.id=970300b51d504a2bbc48158855f02f34) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:07.232052 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54744a4-f0b4-4bfc-8faa-afd1772d2114 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:07.233519 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54744a4-f0b4-4bfc-8faa-afd1772d2114 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:07.240893 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 488/969] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:57:07 2022] GET /identity/v3/role_assignments?user.id=970300b51d504a2bbc48158855f02f34&scope.project.id=a80ab70ab6b9415c98017d05512c33eb&role.id=0c9e286fb47049feb93649dbd95342a1 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:07.696733 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d93918-cfc5-4e58-951d-5ee267c04f56 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:07.697116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d93918-cfc5-4e58-951d-5ee267c04f56 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:07.697288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d93918-cfc5-4e58-951d-5ee267c04f56 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:07.701055 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 482/970] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:57:07.706573 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecaded9-3746-418b-962f-979055315f32 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:07.706865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecaded9-3746-418b-962f-979055315f32 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:07.707136 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecaded9-3746-418b-962f-979055315f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:07.725989 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-8ecaded9-3746-418b-962f-979055315f32 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:07.728227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-8ecaded9-3746-418b-962f-979055315f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:07.798917 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 489/971] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:57:08.063670 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d93918-cfc5-4e58-951d-5ee267c04f56 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:08.149633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:08.180312 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d93918-cfc5-4e58-951d-5ee267c04f56 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:08.216559 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2f997-7d88-497e-952f-38a6f630dfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:08.217439 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2f997-7d88-497e-952f-38a6f630dfea None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:08.217871 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2f997-7d88-497e-952f-38a6f630dfea None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:08.218319 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2f997-7d88-497e-952f-38a6f630dfea None admin] PATH_INFO: `/v3/services/compute` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:08.219071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2f997-7d88-497e-952f-38a6f630dfea None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:08.220693 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2f997-7d88-497e-952f-38a6f630dfea None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:08.231040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-08c2f997-7d88-497e-952f-38a6f630dfea None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 07:57:08.231040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:08.231040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:57:08.231040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:57:08.231040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:57:08.231040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:57:08.231040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:57:08.231040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:57:08.231040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 07:57:08.231040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:08.231040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:57:08.231040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:08.231040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:08.231040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:08.231040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:08.231040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:08.231040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:08.232238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:08.232238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:08.232238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:08.232238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:08.232238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:08.232238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:08.232238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:57:08.232238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:57:08.232238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:57:08.232238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:57:08.232238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:08.232238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:08.232238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:08.232238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:08.232238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:08.232238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:08.233280 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:08.233280 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:08.233280 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:08.233280 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:08.233280 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:08.233280 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:08.233280 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:08.233280 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:08.233280 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:08.233280 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:08.233280 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:57:08.233280 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:57:08.233280 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 07:57:08.233280 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:08.235737 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 483/972] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:57:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:08.245191 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecaded9-3746-418b-962f-979055315f32 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:08.296267 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:08.355103 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecaded9-3746-418b-962f-979055315f32 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:08.392059 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f70b1-3c9e-4b96-ac1f-d6ab4855fee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:08.392668 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f70b1-3c9e-4b96-ac1f-d6ab4855fee4 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:08.392947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f70b1-3c9e-4b96-ac1f-d6ab4855fee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:08.393218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f70b1-3c9e-4b96-ac1f-d6ab4855fee4 None admin] PATH_INFO: `/v3/services` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:08.393844 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f70b1-3c9e-4b96-ac1f-d6ab4855fee4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:08.394199 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f70b1-3c9e-4b96-ac1f-d6ab4855fee4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:08.395584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f70b1-3c9e-4b96-ac1f-d6ab4855fee4 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:08.401109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 490/973] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 23 07:57:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:08.407684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2f997-7d88-497e-952f-38a6f630dfea None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:08.531436 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2f997-7d88-497e-952f-38a6f630dfea None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:08.568798 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37a74c-b1ee-49f8-adb3-12b7d18241b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:08.569469 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37a74c-b1ee-49f8-adb3-12b7d18241b8 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:08.569759 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37a74c-b1ee-49f8-adb3-12b7d18241b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:08.570034 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37a74c-b1ee-49f8-adb3-12b7d18241b8 None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:08.570694 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37a74c-b1ee-49f8-adb3-12b7d18241b8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:08.571020 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37a74c-b1ee-49f8-adb3-12b7d18241b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:08.572964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37a74c-b1ee-49f8-adb3-12b7d18241b8 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:08.578068 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 484/974] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 23 07:57:08 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:09.109651 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9b870-31c2-45dd-be03-d732fdc3a60b None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:09.110033 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9b870-31c2-45dd-be03-d732fdc3a60b None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:09.110246 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9b870-31c2-45dd-be03-d732fdc3a60b None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:09.111606 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 491/975] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:57:09.116923 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81208729-b1fa-42c1-8928-8c4b6f6ecd2c None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:09.117208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81208729-b1fa-42c1-8928-8c4b6f6ecd2c None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:09.117485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81208729-b1fa-42c1-8928-8c4b6f6ecd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:09.125483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:09.136203 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-81208729-b1fa-42c1-8928-8c4b6f6ecd2c None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:09.137397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-81208729-b1fa-42c1-8928-8c4b6f6ecd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:09.150330 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffff06d-61e6-4ef8-8ba3-bad6c7b74f0d None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:09.150921 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffff06d-61e6-4ef8-8ba3-bad6c7b74f0d None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:09.151370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffff06d-61e6-4ef8-8ba3-bad6c7b74f0d None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:09.158458 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 492/976] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:57:09.158458 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81b565-4e27-4735-a87e-006c04a97302 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:09.158458 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81b565-4e27-4735-a87e-006c04a97302 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:09.158721 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81b565-4e27-4735-a87e-006c04a97302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:09.179277 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-0e81b565-4e27-4735-a87e-006c04a97302 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:09.181034 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-0e81b565-4e27-4735-a87e-006c04a97302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:09.214670 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 485/977] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:57:09.259193 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 493/978] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:57:09.318850 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4562c-fb07-4436-8b96-4498d50eed7a None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:09.319175 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4562c-fb07-4436-8b96-4498d50eed7a None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:09.319401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4562c-fb07-4436-8b96-4498d50eed7a None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:09.321016 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 486/979] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:57:09.326355 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266da67a-3933-4ed9-8077-83db61192f0c None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:09.326648 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266da67a-3933-4ed9-8077-83db61192f0c None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:09.326922 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266da67a-3933-4ed9-8077-83db61192f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:09.345296 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-266da67a-3933-4ed9-8077-83db61192f0c None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:09.346499 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-266da67a-3933-4ed9-8077-83db61192f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:09.376242 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:09.423945 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 494/980] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:57:09.501214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4562c-fb07-4436-8b96-4498d50eed7a None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:09.551960 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266da67a-3933-4ed9-8077-83db61192f0c None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:09.638488 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4562c-fb07-4436-8b96-4498d50eed7a None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:09.672829 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266da67a-3933-4ed9-8077-83db61192f0c None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:09.688144 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc6dcc-3411-4760-9f43-267b092f3b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:09.689124 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc6dcc-3411-4760-9f43-267b092f3b69 None admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:09.689641 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc6dcc-3411-4760-9f43-267b092f3b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:09.690119 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc6dcc-3411-4760-9f43-267b092f3b69 None admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:09.691116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc6dcc-3411-4760-9f43-267b092f3b69 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:09.692897 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc6dcc-3411-4760-9f43-267b092f3b69 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:09.696591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: WARNING keystone.server.flask.common [None req-76dc6dcc-3411-4760-9f43-267b092f3b69 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 23 07:57:09.705375 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:09.709548 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7262fe-d4e7-4c43-ae22-3cee84c65d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:09.710177 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7262fe-d4e7-4c43-ae22-3cee84c65d4b None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:09.710483 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7262fe-d4e7-4c43-ae22-3cee84c65d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:09.710756 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7262fe-d4e7-4c43-ae22-3cee84c65d4b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:09.711366 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7262fe-d4e7-4c43-ae22-3cee84c65d4b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:09.713394 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7262fe-d4e7-4c43-ae22-3cee84c65d4b None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:09.722098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-5e7262fe-d4e7-4c43-ae22-3cee84c65d4b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:57:09.722098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:09.722098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:57:09.722098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:57:09.722098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:57:09.722098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:57:09.722098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:57:09.722098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:57:09.722098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:57:09.722098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:09.722098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:57:09.722098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:09.722098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:09.722098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:09.722098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:09.722098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:09.722098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:09.723236 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:09.723236 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:09.723236 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:09.723236 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:09.723236 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:09.723236 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:09.723236 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:57:09.723236 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:57:09.723236 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:57:09.723236 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:57:09.723236 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:09.723236 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:09.723236 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:09.723236 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:09.723236 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:09.723236 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:09.724079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:09.724079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:09.724079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:09.724079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:09.724079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:09.724079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:09.724079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:09.724079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:09.724079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:09.724079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:09.724079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:57:09.724079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:57:09.724079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:57:09.724079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:09.724079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 495/981] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 23 07:57:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:57:09.725931 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7262fe-d4e7-4c43-ae22-3cee84c65d4b None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:09.735916 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.sql.core [None req-76dc6dcc-3411-4760-9f43-267b092f3b69 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 07:57:09.735916 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 07:57:09.735916 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [parameters: {'user_id': '21ae233d5d3442b5b004919a6ef069f6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 07:57:09.735916 dv-cinder-854070-4-smb devstack@keystone.service[81770]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81770) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 07:57:09.742803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-76dc6dcc-3411-4760-9f43-267b092f3b69 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 07:57:09.742803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:09.742803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 07:57:09.742803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 07:57:09.742803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 07:57:09.742803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 07:57:09.742803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 07:57:09.742803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 07:57:09.742803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 07:57:09.742803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application conn.query(q) Aug 23 07:57:09.742803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 07:57:09.742803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 07:57:09.742803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 07:57:09.742803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application result.read() Aug 23 07:57:09.742803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 07:57:09.743761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 07:57:09.743761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 07:57:09.743761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 07:57:09.743761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 07:57:09.743761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 07:57:09.743761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 07:57:09.743761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 07:57:09.743761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 07:57:09.743761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:09.743761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 07:57:09.743761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:09.743761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:09.743761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 07:57:09.743761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 07:57:09.743761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 23 07:57:09.743761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 23 07:57:09.743761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 07:57:09.743761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application next(self.gen) Aug 23 07:57:09.744749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 07:57:09.744749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application yield resource Aug 23 07:57:09.744749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 07:57:09.744749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application next(self.gen) Aug 23 07:57:09.744749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 07:57:09.744749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 07:57:09.744749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 07:57:09.744749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 07:57:09.744749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 07:57:09.744749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise self.value Aug 23 07:57:09.744749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 07:57:09.744749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 07:57:09.744749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 07:57:09.744749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application session.commit() Aug 23 07:57:09.744749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 07:57:09.744749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 07:57:09.744749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 07:57:09.745838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 07:57:09.745838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 07:57:09.745838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self.session.flush() Aug 23 07:57:09.745838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 07:57:09.745838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 07:57:09.745838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 07:57:09.745838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 07:57:09.745838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 07:57:09.745838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application compat.raise_( Aug 23 07:57:09.745838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 07:57:09.745838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception Aug 23 07:57:09.745838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 07:57:09.745838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 07:57:09.745838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 07:57:09.745838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 07:57:09.745838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 07:57:09.745838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 07:57:09.747959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 07:57:09.747959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 07:57:09.747959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 23 07:57:09.747959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 23 07:57:09.747959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 07:57:09.747959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 07:57:09.747959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 07:57:09.747959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 07:57:09.747959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 07:57:09.747959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 07:57:09.747959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 07:57:09.747959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 07:57:09.747959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 07:57:09.747959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 07:57:09.747959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 07:57:09.747959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception Aug 23 07:57:09.748848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 07:57:09.748848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 07:57:09.748848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 07:57:09.748848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 07:57:09.748848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 07:57:09.748848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 07:57:09.748848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 07:57:09.748848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application conn.query(q) Aug 23 07:57:09.748848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 07:57:09.748848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 07:57:09.748848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 07:57:09.748848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application result.read() Aug 23 07:57:09.748848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 07:57:09.748848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 07:57:09.748848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 07:57:09.748848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 07:57:09.749708 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 07:57:09.749708 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 07:57:09.749708 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 07:57:09.749708 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 07:57:09.749708 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 07:57:09.749708 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 07:57:09.749708 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [parameters: {'user_id': '21ae233d5d3442b5b004919a6ef069f6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 07:57:09.749708 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 07:57:09.749708 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:09.749708 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:57:09.749708 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:09.749708 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:09.749708 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:09.749708 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:09.749708 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:09.753427 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:09.753427 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:09.753427 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:09.753427 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:09.753427 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:09.753427 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:09.753427 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:09.753427 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 23 07:57:09.753427 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 23 07:57:09.753427 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:09.753427 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:09.753427 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:57:09.753427 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:57:09.753427 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:57:09.753427 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:57:09.753427 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 23 07:57:09.753427 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 23 07:57:09.755854 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 23 07:57:09.755854 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 23 07:57:09.755854 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 07:57:09.755854 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 07:57:09.755854 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 07:57:09.755854 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:09.755854 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 487/982] 10.222.0.57 () {60 vars in 1131 bytes} [Tue Aug 23 07:57:09 2022] POST /identity/v3/users => generated 160 bytes in 244 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:09.755854 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc6dcc-3411-4760-9f43-267b092f3b69 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:09.777035 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:09.851889 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7262fe-d4e7-4c43-ae22-3cee84c65d4b None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:09.872370 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc6dcc-3411-4760-9f43-267b092f3b69 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:09.891838 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e18e99-0021-4cb2-802b-8b68527e13e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:09.892670 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e18e99-0021-4cb2-802b-8b68527e13e5 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:09.892963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e18e99-0021-4cb2-802b-8b68527e13e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:09.893240 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e18e99-0021-4cb2-802b-8b68527e13e5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:09.893823 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e18e99-0021-4cb2-802b-8b68527e13e5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:09.895248 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e18e99-0021-4cb2-802b-8b68527e13e5 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:09.905101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-e7e18e99-0021-4cb2-802b-8b68527e13e5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 07:57:09.905101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:09.905101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:57:09.905101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:57:09.905101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:57:09.905101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:57:09.905101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:57:09.905101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:57:09.905101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 07:57:09.905101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:09.905101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:57:09.905101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:09.905101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:09.905101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:09.905101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:09.905101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:09.905101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:09.906084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:09.906084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:09.906084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:09.906084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:09.906084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:09.906084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:09.906084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:57:09.906084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:57:09.906084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:57:09.906084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:57:09.906084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:09.906084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:09.906084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:09.906084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:09.906084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:09.906084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:09.906976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:09.906976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:09.906976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:09.906976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:09.906976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:09.906976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:09.906976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:09.906976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:09.906976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:09.906976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:09.906976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:57:09.906976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:57:09.906976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 07:57:09.906976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:09.906976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 496/983] 10.222.0.57 () {56 vars in 1105 bytes} [Tue Aug 23 07:57:09 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:09.908331 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e18e99-0021-4cb2-802b-8b68527e13e5 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:09.916247 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497aace2-11c2-452c-8628-9656f4b7145f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:09.917133 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497aace2-11c2-452c-8628-9656f4b7145f None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:09.917759 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497aace2-11c2-452c-8628-9656f4b7145f None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:09.918128 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497aace2-11c2-452c-8628-9656f4b7145f None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:09.918885 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497aace2-11c2-452c-8628-9656f4b7145f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:09.919283 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497aace2-11c2-452c-8628-9656f4b7145f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:09.921194 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497aace2-11c2-452c-8628-9656f4b7145f None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:09.929347 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 488/984] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 23 07:57:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:09.930240 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497aace2-11c2-452c-8628-9656f4b7145f None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:09.998959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:10.015148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:10.020722 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e18e99-0021-4cb2-802b-8b68527e13e5 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:10.043388 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497aace2-11c2-452c-8628-9656f4b7145f None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:10.056054 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0566a-c5ab-4a66-af99-b795c350c247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:10.056761 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0566a-c5ab-4a66-af99-b795c350c247 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:10.057116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0566a-c5ab-4a66-af99-b795c350c247 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:10.057469 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0566a-c5ab-4a66-af99-b795c350c247 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:10.065831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0566a-c5ab-4a66-af99-b795c350c247 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:10.067311 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0566a-c5ab-4a66-af99-b795c350c247 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:10.080336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e7fd5-d85b-4844-bfa3-dba4a7ca1d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:10.080945 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e7fd5-d85b-4844-bfa3-dba4a7ca1d60 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:10.081224 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e7fd5-d85b-4844-bfa3-dba4a7ca1d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:10.081416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-33c0566a-c5ab-4a66-af99-b795c350c247 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 07:57:10.081416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:10.081416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:10.081416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:10.081416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:10.081416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:10.081416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:10.081416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:10.081416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:10.081416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:10.081416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:10.081416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:10.081416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:57:10.081416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:57:10.081416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:57:10.081416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:57:10.082570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:10.082570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:10.082570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:57:10.082570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:57:10.082570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:57:10.082570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:57:10.082570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:10.082570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:10.082570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:10.082570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:10.082570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:10.082570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:10.082570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:10.082570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:10.082570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:10.082570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:10.082570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:10.082570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:10.083564 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:10.083564 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:10.083564 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:57:10.083564 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:57:10.083564 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:57:10.083564 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:57:10.083564 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:57:10.083564 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:57:10.083564 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 07:57:10.083564 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:10.084115 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e7fd5-d85b-4844-bfa3-dba4a7ca1d60 None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:10.084115 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e7fd5-d85b-4844-bfa3-dba4a7ca1d60 None admin] RBAC: Adding query filter params (name=image) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:10.084115 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e7fd5-d85b-4844-bfa3-dba4a7ca1d60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:10.084308 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 497/985] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:57:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:10.085422 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0566a-c5ab-4a66-af99-b795c350c247 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:10.088659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e7fd5-d85b-4844-bfa3-dba4a7ca1d60 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:10.098961 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 489/986] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:57:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:10.099842 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e7fd5-d85b-4844-bfa3-dba4a7ca1d60 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:10.207793 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0566a-c5ab-4a66-af99-b795c350c247 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:10.215127 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e7fd5-d85b-4844-bfa3-dba4a7ca1d60 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:10.239513 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:10.244245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472637fe-0b61-42c3-9e13-1179c8319525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:10.244799 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472637fe-0b61-42c3-9e13-1179c8319525 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:10.245144 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472637fe-0b61-42c3-9e13-1179c8319525 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:10.245489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472637fe-0b61-42c3-9e13-1179c8319525 None admin] PATH_INFO: `/v3/services` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:10.246348 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472637fe-0b61-42c3-9e13-1179c8319525 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:10.246959 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472637fe-0b61-42c3-9e13-1179c8319525 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:10.247861 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472637fe-0b61-42c3-9e13-1179c8319525 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:10.251293 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ebbfc-bdd9-4d55-9d6b-e9da147d6d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:10.251902 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ebbfc-bdd9-4d55-9d6b-e9da147d6d93 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:10.252181 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ebbfc-bdd9-4d55-9d6b-e9da147d6d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:10.252454 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ebbfc-bdd9-4d55-9d6b-e9da147d6d93 None admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:10.257588 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 498/987] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 23 07:57:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:10.257739 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ebbfc-bdd9-4d55-9d6b-e9da147d6d93 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:10.257739 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ebbfc-bdd9-4d55-9d6b-e9da147d6d93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:10.257886 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472637fe-0b61-42c3-9e13-1179c8319525 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:10.257971 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ebbfc-bdd9-4d55-9d6b-e9da147d6d93 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:10.282974 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:10.298961 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 490/988] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 23 07:57:10 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:10.298961 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ebbfc-bdd9-4d55-9d6b-e9da147d6d93 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:10.411105 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472637fe-0b61-42c3-9e13-1179c8319525 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:10.413777 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ebbfc-bdd9-4d55-9d6b-e9da147d6d93 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:10.455122 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4d2b2-1511-4414-9c24-21bbba0a5fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:10.456101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4d2b2-1511-4414-9c24-21bbba0a5fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:10.456605 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4d2b2-1511-4414-9c24-21bbba0a5fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:10.457083 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4d2b2-1511-4414-9c24-21bbba0a5fe1 None admin] PATH_INFO: `/v3/services` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:10.458065 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4d2b2-1511-4414-9c24-21bbba0a5fe1 None admin] RBAC: Adding query filter params (type=image) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:10.458710 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4d2b2-1511-4414-9c24-21bbba0a5fe1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:10.460478 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4d2b2-1511-4414-9c24-21bbba0a5fe1 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:10.460968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f01b6-a5a3-419a-985d-dc4b878345d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:10.461645 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f01b6-a5a3-419a-985d-dc4b878345d5 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:10.462250 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f01b6-a5a3-419a-985d-dc4b878345d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:10.462607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f01b6-a5a3-419a-985d-dc4b878345d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:10.463700 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f01b6-a5a3-419a-985d-dc4b878345d5 None admin] RBAC: Adding query filter params (interface=admin, service_id=c172b8ceab9d4cd1ab9cb590aa9c1941, region_id=RegionOne) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:10.464168 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f01b6-a5a3-419a-985d-dc4b878345d5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:10.465533 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f01b6-a5a3-419a-985d-dc4b878345d5 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:10.472584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 499/989] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:57:10 2022] GET /identity/v3/services?type=image => generated 122 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:10.472853 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 491/990] 10.222.0.57 () {56 vars in 1249 bytes} [Tue Aug 23 07:57:10 2022] GET /identity/v3/endpoints?service_id=c172b8ceab9d4cd1ab9cb590aa9c1941&interface=admin®ion_id=RegionOne => generated 193 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:10.479077 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4d2b2-1511-4414-9c24-21bbba0a5fe1 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:10.580782 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:10.598427 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4d2b2-1511-4414-9c24-21bbba0a5fe1 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:10.601787 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79ac26-0606-4a07-8199-cc09d0615123 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:10.602071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79ac26-0606-4a07-8199-cc09d0615123 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:10.602911 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79ac26-0606-4a07-8199-cc09d0615123 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:10.604288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 492/991] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:57:10.609992 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4ecd7-8c98-44fc-824c-f0d0be24bcda None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:10.610357 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4ecd7-8c98-44fc-824c-f0d0be24bcda None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:10.610607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4ecd7-8c98-44fc-824c-f0d0be24bcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:10.631486 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-32d4ecd7-8c98-44fc-824c-f0d0be24bcda None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:10.632302 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-32d4ecd7-8c98-44fc-824c-f0d0be24bcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:10.645644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103419a-5f5a-4f8e-8f20-42f49f1e750a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:10.646266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103419a-5f5a-4f8e-8f20-42f49f1e750a None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:10.646574 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103419a-5f5a-4f8e-8f20-42f49f1e750a None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:10.646870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103419a-5f5a-4f8e-8f20-42f49f1e750a None admin] PATH_INFO: `/v3/services` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:10.647451 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103419a-5f5a-4f8e-8f20-42f49f1e750a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:10.648826 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103419a-5f5a-4f8e-8f20-42f49f1e750a None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:10.655505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 500/992] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Aug 23 07:57:10 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 07:57:10.689370 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:10.716246 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 493/993] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:57:10.981816 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103419a-5f5a-4f8e-8f20-42f49f1e750a None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:11.082744 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103419a-5f5a-4f8e-8f20-42f49f1e750a None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:11.117835 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e73c62-6206-4e47-9af5-0973406d2c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:11.118471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e73c62-6206-4e47-9af5-0973406d2c31 None admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:11.118827 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e73c62-6206-4e47-9af5-0973406d2c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:11.119103 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e73c62-6206-4e47-9af5-0973406d2c31 None admin] PATH_INFO: `/v3/services` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:11.119734 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e73c62-6206-4e47-9af5-0973406d2c31 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:11.121093 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e73c62-6206-4e47-9af5-0973406d2c31 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:11.185113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 501/994] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 23 07:57:10 2022] POST /identity/v3/services => generated 242 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:57:12.384930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92495b41-e823-46c3-986f-ab27a0dbf246 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:12.385452 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92495b41-e823-46c3-986f-ab27a0dbf246 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:12.385452 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92495b41-e823-46c3-986f-ab27a0dbf246 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:12.386872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 494/995] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:57:12.392221 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570edc1-0dd0-4d81-94a2-f5d2ef1c3e50 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:12.392612 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570edc1-0dd0-4d81-94a2-f5d2ef1c3e50 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:12.392789 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570edc1-0dd0-4d81-94a2-f5d2ef1c3e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:12.411218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-d570edc1-0dd0-4d81-94a2-f5d2ef1c3e50 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:12.412385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-d570edc1-0dd0-4d81-94a2-f5d2ef1c3e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:12.414353 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:12.487867 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 502/996] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:57:12.568360 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28452afc-1571-4140-985d-96509d1f3902 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:12.568677 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28452afc-1571-4140-985d-96509d1f3902 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:12.568913 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28452afc-1571-4140-985d-96509d1f3902 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:12.570427 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 495/997] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:57:12.576063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf4e63-8ec6-4034-abe8-16c8fd7a24c2 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:12.576356 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf4e63-8ec6-4034-abe8-16c8fd7a24c2 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:12.576633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf4e63-8ec6-4034-abe8-16c8fd7a24c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:12.595232 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-eccf4e63-8ec6-4034-abe8-16c8fd7a24c2 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:12.596411 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-eccf4e63-8ec6-4034-abe8-16c8fd7a24c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:12.672731 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 503/998] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:57:12.757421 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28452afc-1571-4140-985d-96509d1f3902 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:12.864101 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28452afc-1571-4140-985d-96509d1f3902 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:12.898200 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d70b0c1-14bf-44f9-94c6-69586aeb669b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:12.899120 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70b0c1-14bf-44f9-94c6-69586aeb669b None admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:12.899550 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70b0c1-14bf-44f9-94c6-69586aeb669b None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:12.900027 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d70b0c1-14bf-44f9-94c6-69586aeb669b None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:12.900807 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d70b0c1-14bf-44f9-94c6-69586aeb669b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:12.902416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d70b0c1-14bf-44f9-94c6-69586aeb669b None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:12.943786 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf4e63-8ec6-4034-abe8-16c8fd7a24c2 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:13.002581 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 496/999] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 23 07:57:12 2022] POST /identity/v3/services => generated 242 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:57:13.010214 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:13.052941 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf4e63-8ec6-4034-abe8-16c8fd7a24c2 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:13.100680 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b6e8e-5545-41f2-8947-41a5bdddee91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:13.101014 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd13a5-6e64-403b-9981-218f7418613e None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:13.101270 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd13a5-6e64-403b-9981-218f7418613e None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:13.101390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b6e8e-5545-41f2-8947-41a5bdddee91 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:13.101470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd13a5-6e64-403b-9981-218f7418613e None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:13.101637 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b6e8e-5545-41f2-8947-41a5bdddee91 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:13.101855 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b6e8e-5545-41f2-8947-41a5bdddee91 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:13.103091 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b6e8e-5545-41f2-8947-41a5bdddee91 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:13.106334 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 497/1000] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:57:13.106496 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b6e8e-5545-41f2-8947-41a5bdddee91 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:13.109337 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd8e6e-178c-4943-87e2-c907ee5100fe None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:13.109684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd8e6e-178c-4943-87e2-c907ee5100fe None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:13.110055 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd8e6e-178c-4943-87e2-c907ee5100fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:13.115788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-419b6e8e-5545-41f2-8947-41a5bdddee91 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:57:13.115788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:13.115788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:57:13.115788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:57:13.115788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:57:13.115788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:57:13.115788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:57:13.115788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:57:13.115788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:57:13.115788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:13.115788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:57:13.115788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:13.115788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:13.115788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:13.115788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:13.115788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:13.115788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:13.116888 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:13.116888 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:13.116888 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:13.116888 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:13.116888 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:13.116888 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:13.116888 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:57:13.116888 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:57:13.116888 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:57:13.116888 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:57:13.116888 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:13.116888 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:13.116888 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:13.116888 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:13.116888 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:13.116888 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:13.117902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:13.117902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:13.117902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:13.117902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:13.117902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:13.117902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:13.117902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:13.117902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:13.117902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:13.117902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:13.117902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:57:13.117902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:57:13.117902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:57:13.117902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:13.117902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 504/1001] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 23 07:57:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:13.124411 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b6e8e-5545-41f2-8947-41a5bdddee91 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:13.130258 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-06fd8e6e-178c-4943-87e2-c907ee5100fe None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:13.131522 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-06fd8e6e-178c-4943-87e2-c907ee5100fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:13.171373 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:13.212631 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 498/1002] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:13 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:57:13.237039 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b6e8e-5545-41f2-8947-41a5bdddee91 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:13.261343 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:13.271767 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fbb82-8b91-4609-b66b-0228e0694b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:13.272377 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fbb82-8b91-4609-b66b-0228e0694b14 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:13.272659 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fbb82-8b91-4609-b66b-0228e0694b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:13.272992 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fbb82-8b91-4609-b66b-0228e0694b14 None admin] PATH_INFO: `/v3/services` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:13.273685 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38fbb82-8b91-4609-b66b-0228e0694b14 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:13.274586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38fbb82-8b91-4609-b66b-0228e0694b14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:13.276030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38fbb82-8b91-4609-b66b-0228e0694b14 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:13.284666 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 505/1003] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 23 07:57:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:57:13.286801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd8e6e-178c-4943-87e2-c907ee5100fe None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:13.391122 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd8e6e-178c-4943-87e2-c907ee5100fe None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:13.425089 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b1d7c-8d96-4110-881e-462ce9891f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:13.426046 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b1d7c-8d96-4110-881e-462ce9891f0a None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:13.426622 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b1d7c-8d96-4110-881e-462ce9891f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:13.427079 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b1d7c-8d96-4110-881e-462ce9891f0a None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:13.427889 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b1d7c-8d96-4110-881e-462ce9891f0a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:13.428373 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b1d7c-8d96-4110-881e-462ce9891f0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:13.429976 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b1d7c-8d96-4110-881e-462ce9891f0a None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:13.440304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 499/1004] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 23 07:57:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:13.441574 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fbb82-8b91-4609-b66b-0228e0694b14 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:13.486947 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b1d7c-8d96-4110-881e-462ce9891f0a None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:13.547523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fbb82-8b91-4609-b66b-0228e0694b14 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:13.583126 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c9104-4bca-47e2-b527-37cc939d2a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:13.583748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c9104-4bca-47e2-b527-37cc939d2a15 None admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:13.584029 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c9104-4bca-47e2-b527-37cc939d2a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:13.584423 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c9104-4bca-47e2-b527-37cc939d2a15 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:13.585193 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c9104-4bca-47e2-b527-37cc939d2a15 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:13.586644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c9104-4bca-47e2-b527-37cc939d2a15 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:13.590403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:13.658648 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b1d7c-8d96-4110-881e-462ce9891f0a None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:13.685258 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 506/1005] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 07:57:13 2022] POST /identity/v3/endpoints => generated 325 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:57:13.705475 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef12e8-c6fc-4e1b-8085-77d3cf733dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:13.706140 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef12e8-c6fc-4e1b-8085-77d3cf733dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:13.706457 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef12e8-c6fc-4e1b-8085-77d3cf733dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:13.706740 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef12e8-c6fc-4e1b-8085-77d3cf733dd6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:13.707318 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef12e8-c6fc-4e1b-8085-77d3cf733dd6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:13.708770 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef12e8-c6fc-4e1b-8085-77d3cf733dd6 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:13.718735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-95ef12e8-c6fc-4e1b-8085-77d3cf733dd6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 07:57:13.718735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:13.718735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:57:13.718735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:57:13.718735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:57:13.718735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:57:13.718735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:57:13.718735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:57:13.718735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 07:57:13.718735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:13.718735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:57:13.718735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:13.718735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:13.718735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:13.718735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:13.718735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:13.718735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:13.719819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:13.719819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:13.719819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:13.719819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:13.719819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:13.719819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:13.719819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:57:13.719819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:57:13.719819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:57:13.719819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:57:13.719819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:13.719819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:13.719819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:13.719819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:13.719819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:13.719819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:13.725864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:13.725864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:13.725864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:13.725864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:13.725864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:13.725864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:13.725864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:13.725864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:13.725864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:13.725864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:13.725864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:57:13.725864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:57:13.725864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 07:57:13.725864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:13.725864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 500/1006] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:57:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:57:13.728955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c9104-4bca-47e2-b527-37cc939d2a15 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:13.781774 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:13.835795 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c9104-4bca-47e2-b527-37cc939d2a15 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:13.874605 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb60d5-63b9-480b-821a-054c7dcb3ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:13.875573 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb60d5-63b9-480b-821a-054c7dcb3ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:13.875865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb60d5-63b9-480b-821a-054c7dcb3ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:13.876145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb60d5-63b9-480b-821a-054c7dcb3ca1 None admin] PATH_INFO: `/v3/services` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:13.876785 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb60d5-63b9-480b-821a-054c7dcb3ca1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:13.877091 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb60d5-63b9-480b-821a-054c7dcb3ca1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:13.878491 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb60d5-63b9-480b-821a-054c7dcb3ca1 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:13.884026 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 507/1007] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 23 07:57:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:13.889480 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef12e8-c6fc-4e1b-8085-77d3cf733dd6 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:13.982765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:13.992555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef12e8-c6fc-4e1b-8085-77d3cf733dd6 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:14.026990 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eeaf99-36b4-4a14-8ac7-a520f14644ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:14.027595 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eeaf99-36b4-4a14-8ac7-a520f14644ff None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:14.027873 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eeaf99-36b4-4a14-8ac7-a520f14644ff None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:14.028145 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eeaf99-36b4-4a14-8ac7-a520f14644ff None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:14.028762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eeaf99-36b4-4a14-8ac7-a520f14644ff None admin] RBAC: Adding query filter params (type=compute) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:14.029059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eeaf99-36b4-4a14-8ac7-a520f14644ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:14.030446 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eeaf99-36b4-4a14-8ac7-a520f14644ff None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:14.035494 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 501/1008] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 23 07:57:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:14.041881 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb60d5-63b9-480b-821a-054c7dcb3ca1 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:14.144930 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb60d5-63b9-480b-821a-054c7dcb3ca1 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:14.158204 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:14.179822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c3cb4-2e5d-4be4-8f6d-092db91277e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:14.180830 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c3cb4-2e5d-4be4-8f6d-092db91277e5 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:14.181110 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c3cb4-2e5d-4be4-8f6d-092db91277e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:14.181378 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c3cb4-2e5d-4be4-8f6d-092db91277e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:14.182092 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c3cb4-2e5d-4be4-8f6d-092db91277e5 None admin] RBAC: Adding query filter params (interface=public, service_id=95d4096d01e14f60a7ec3da56ca72ba4, region_id=RegionOne) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:14.182424 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c3cb4-2e5d-4be4-8f6d-092db91277e5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:14.183859 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c3cb4-2e5d-4be4-8f6d-092db91277e5 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:14.190455 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 508/1009] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Aug 23 07:57:14 2022] GET /identity/v3/endpoints?service_id=95d4096d01e14f60a7ec3da56ca72ba4&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:14.194902 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eeaf99-36b4-4a14-8ac7-a520f14644ff None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:14.294013 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eeaf99-36b4-4a14-8ac7-a520f14644ff None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:14.327297 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd83ed-c229-4a33-97c5-2e5a5c236aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:14.327897 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd83ed-c229-4a33-97c5-2e5a5c236aad None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:14.328171 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd83ed-c229-4a33-97c5-2e5a5c236aad None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:14.328438 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd83ed-c229-4a33-97c5-2e5a5c236aad None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:14.329026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd83ed-c229-4a33-97c5-2e5a5c236aad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:14.330414 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd83ed-c229-4a33-97c5-2e5a5c236aad None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:14.337424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 502/1010] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Aug 23 07:57:14 2022] GET /identity/v3/services => generated 1957 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 07:57:14.924749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8ea00-c9eb-4581-9ed8-bf9875983169 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:14.925238 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8ea00-c9eb-4581-9ed8-bf9875983169 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:14.925238 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8ea00-c9eb-4581-9ed8-bf9875983169 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:14.926727 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 509/1011] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:57:14.932310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bc07c-8e2f-43e9-9e77-f632816dc466 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:14.932718 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bc07c-8e2f-43e9-9e77-f632816dc466 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:14.932892 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bc07c-8e2f-43e9-9e77-f632816dc466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:14.950771 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-8d4bc07c-8e2f-43e9-9e77-f632816dc466 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:14.951949 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-8d4bc07c-8e2f-43e9-9e77-f632816dc466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:14.965559 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:15.019420 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 503/1012] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:14 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:57:15.291062 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8ea00-c9eb-4581-9ed8-bf9875983169 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:15.396433 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8ea00-c9eb-4581-9ed8-bf9875983169 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:15.431855 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b56779-c199-4c20-940b-02fe98d0a8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:15.432481 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b56779-c199-4c20-940b-02fe98d0a8f3 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:15.432754 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b56779-c199-4c20-940b-02fe98d0a8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:15.433023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b56779-c199-4c20-940b-02fe98d0a8f3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:15.433597 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b56779-c199-4c20-940b-02fe98d0a8f3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:15.434982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b56779-c199-4c20-940b-02fe98d0a8f3 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:15.443546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-67b56779-c199-4c20-940b-02fe98d0a8f3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 07:57:15.443546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:15.443546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:57:15.443546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:57:15.443546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:57:15.443546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:57:15.443546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:57:15.443546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:57:15.443546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 07:57:15.443546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:15.443546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:57:15.443546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:15.443546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:15.443546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:15.443546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:15.443546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:15.443546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:15.444517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:15.444517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:15.444517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:15.444517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:15.444517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:15.444517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:15.444517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:57:15.444517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:57:15.444517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:57:15.444517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:57:15.444517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:15.444517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:15.444517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:15.444517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:15.444517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:15.444517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:15.445396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:15.445396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:15.445396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:15.445396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:15.445396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:15.445396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:15.445396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:15.445396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:15.445396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:15.445396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:15.445396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:57:15.445396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:57:15.445396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 07:57:15.445396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:15.447014 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 510/1013] 10.222.0.57 () {56 vars in 1105 bytes} [Tue Aug 23 07:57:15 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:15.451129 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bc07c-8e2f-43e9-9e77-f632816dc466 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:15.552340 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bc07c-8e2f-43e9-9e77-f632816dc466 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:15.585082 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c41aa4-fe3c-4a59-893d-96acec71a519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:15.585690 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c41aa4-fe3c-4a59-893d-96acec71a519 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:15.585970 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c41aa4-fe3c-4a59-893d-96acec71a519 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:15.586247 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c41aa4-fe3c-4a59-893d-96acec71a519 None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:15.587421 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c41aa4-fe3c-4a59-893d-96acec71a519 None admin] RBAC: Adding query filter params (name=image) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:15.587719 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c41aa4-fe3c-4a59-893d-96acec71a519 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:15.589094 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c41aa4-fe3c-4a59-893d-96acec71a519 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:15.598372 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 504/1014] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:57:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:15.599645 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b56779-c199-4c20-940b-02fe98d0a8f3 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:15.640346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334831bb-0682-4b78-9435-152425d3cfb4 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:15.640649 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334831bb-0682-4b78-9435-152425d3cfb4 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:15.640908 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334831bb-0682-4b78-9435-152425d3cfb4 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:15.642400 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 505/1015] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:57:15.647269 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67121030-44ce-4312-9dd7-22dc930b17d0 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:15.647562 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67121030-44ce-4312-9dd7-22dc930b17d0 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:15.647840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67121030-44ce-4312-9dd7-22dc930b17d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:15.652385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:15.667600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-67121030-44ce-4312-9dd7-22dc930b17d0 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:15.668778 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-67121030-44ce-4312-9dd7-22dc930b17d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:15.676673 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:15.721122 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b56779-c199-4c20-940b-02fe98d0a8f3 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:15.739534 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 506/1016] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:15 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:57:15.758068 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca55d9-373d-4ba7-880a-ed58905a44a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:15.759268 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca55d9-373d-4ba7-880a-ed58905a44a7 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:15.759513 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca55d9-373d-4ba7-880a-ed58905a44a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:15.759780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca55d9-373d-4ba7-880a-ed58905a44a7 None admin] PATH_INFO: `/v3/services` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:15.760396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca55d9-373d-4ba7-880a-ed58905a44a7 None admin] RBAC: Adding query filter params (type=image) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:15.760694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca55d9-373d-4ba7-880a-ed58905a44a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:15.762053 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca55d9-373d-4ba7-880a-ed58905a44a7 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:15.768447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 511/1017] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:57:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:15.775317 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67121030-44ce-4312-9dd7-22dc930b17d0 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:15.872347 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67121030-44ce-4312-9dd7-22dc930b17d0 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:15.906269 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d76ec-6c5d-4877-acf2-1ba66aada38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:15.906895 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d76ec-6c5d-4877-acf2-1ba66aada38a None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:15.907176 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d76ec-6c5d-4877-acf2-1ba66aada38a None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:15.907447 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d76ec-6c5d-4877-acf2-1ba66aada38a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:15.908226 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d76ec-6c5d-4877-acf2-1ba66aada38a None admin] RBAC: Adding query filter params (interface=public, service_id=95a0542fe7064e86a55248d67d356b9a, region_id=RegionOne) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:15.908512 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d76ec-6c5d-4877-acf2-1ba66aada38a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:15.909881 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d76ec-6c5d-4877-acf2-1ba66aada38a None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:15.919555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 507/1018] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Aug 23 07:57:15 2022] GET /identity/v3/endpoints?service_id=95a0542fe7064e86a55248d67d356b9a&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:15.920789 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca55d9-373d-4ba7-880a-ed58905a44a7 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:16.011934 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d76ec-6c5d-4877-acf2-1ba66aada38a None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:16.020689 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:16.022725 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca55d9-373d-4ba7-880a-ed58905a44a7 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:16.025782 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:16.057225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7a959-f2d5-4ed3-93ad-ed89d81b7fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:16.057833 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7a959-f2d5-4ed3-93ad-ed89d81b7fce None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:16.058113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7a959-f2d5-4ed3-93ad-ed89d81b7fce None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:16.058420 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7a959-f2d5-4ed3-93ad-ed89d81b7fce None admin] PATH_INFO: `/v3/services` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:16.059010 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7a959-f2d5-4ed3-93ad-ed89d81b7fce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:16.060373 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7a959-f2d5-4ed3-93ad-ed89d81b7fce None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:16.074534 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 512/1019] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Aug 23 07:57:15 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 07:57:16.121847 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d76ec-6c5d-4877-acf2-1ba66aada38a None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:16.162080 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02320e2f-5042-4f0b-a3b2-16c37d932330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:16.162680 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02320e2f-5042-4f0b-a3b2-16c37d932330 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:16.162967 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02320e2f-5042-4f0b-a3b2-16c37d932330 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:16.163244 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02320e2f-5042-4f0b-a3b2-16c37d932330 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:16.164448 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02320e2f-5042-4f0b-a3b2-16c37d932330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:16.165968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02320e2f-5042-4f0b-a3b2-16c37d932330 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:16.167803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 508/1020] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:57:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:57:16.173483 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7a959-f2d5-4ed3-93ad-ed89d81b7fce None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:16.267095 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136e7cf-64e7-4b90-af50-c2e4d72fcfc2 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:16.267420 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136e7cf-64e7-4b90-af50-c2e4d72fcfc2 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:16.267656 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136e7cf-64e7-4b90-af50-c2e4d72fcfc2 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:16.269123 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 509/1021] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:57:16.274621 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d34f7-40a0-4485-8f3b-956e0dfc63b4 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:16.274904 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d34f7-40a0-4485-8f3b-956e0dfc63b4 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:16.275242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d34f7-40a0-4485-8f3b-956e0dfc63b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:16.285239 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7a959-f2d5-4ed3-93ad-ed89d81b7fce None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:16.294177 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-1a4d34f7-40a0-4485-8f3b-956e0dfc63b4 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:16.295402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-1a4d34f7-40a0-4485-8f3b-956e0dfc63b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:16.322711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b7e7a-7f41-4acc-9828-b97c860b06a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:16.323318 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b7e7a-7f41-4acc-9828-b97c860b06a0 None admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:16.323593 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b7e7a-7f41-4acc-9828-b97c860b06a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:16.324119 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b7e7a-7f41-4acc-9828-b97c860b06a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:16.324750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b7e7a-7f41-4acc-9828-b97c860b06a0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:16.326182 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b7e7a-7f41-4acc-9828-b97c860b06a0 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:16.366696 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 510/1022] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:16 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:57:16.412018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 513/1023] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 23 07:57:16 2022] POST /identity/v3/projects => generated 311 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:57:16.638425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d34f7-40a0-4485-8f3b-956e0dfc63b4 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:16.642610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:16.741960 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d34f7-40a0-4485-8f3b-956e0dfc63b4 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:16.776395 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e15635-866e-45cb-a878-8bf54fabe013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:16.777027 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e15635-866e-45cb-a878-8bf54fabe013 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:16.777308 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e15635-866e-45cb-a878-8bf54fabe013 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:16.777581 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e15635-866e-45cb-a878-8bf54fabe013 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:16.778153 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e15635-866e-45cb-a878-8bf54fabe013 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:16.779563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e15635-866e-45cb-a878-8bf54fabe013 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:16.788214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-63e15635-866e-45cb-a878-8bf54fabe013 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 07:57:16.788214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:16.788214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:57:16.788214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:57:16.788214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:57:16.788214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:57:16.788214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:57:16.788214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:57:16.788214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 07:57:16.788214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:16.788214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:57:16.788214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:16.788214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:16.788214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:16.788214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:16.788214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:16.788214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:16.789208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:16.789208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:16.789208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:16.789208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:16.789208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:16.789208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:16.789208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:57:16.789208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:57:16.789208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:57:16.789208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:57:16.789208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:16.789208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:16.789208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:16.789208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:16.789208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:16.789208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:16.791124 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:16.791124 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:16.791124 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:16.791124 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:16.791124 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:16.791124 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:16.791124 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:16.791124 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:16.791124 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:16.791124 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:16.791124 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:57:16.791124 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:57:16.791124 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 07:57:16.791124 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:16.791124 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 511/1024] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:57:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:16.795849 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b7e7a-7f41-4acc-9828-b97c860b06a0 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:16.819863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:16.900558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b7e7a-7f41-4acc-9828-b97c860b06a0 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:16.935938 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46decd-ab08-488f-b44a-022a99c0b7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:16.936929 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46decd-ab08-488f-b44a-022a99c0b7ac None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:16.937395 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46decd-ab08-488f-b44a-022a99c0b7ac None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:16.937851 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46decd-ab08-488f-b44a-022a99c0b7ac None admin] PATH_INFO: `/v3/services` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:16.938688 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46decd-ab08-488f-b44a-022a99c0b7ac None admin] RBAC: Adding query filter params (name=compute) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:16.939197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46decd-ab08-488f-b44a-022a99c0b7ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:16.940760 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46decd-ab08-488f-b44a-022a99c0b7ac None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:16.947061 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 514/1025] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 23 07:57:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:16.952553 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e15635-866e-45cb-a878-8bf54fabe013 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:17.020225 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:17.059689 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e15635-866e-45cb-a878-8bf54fabe013 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:17.094648 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c85ea-913f-47d4-879f-ad4a2025022c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:17.095257 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c85ea-913f-47d4-879f-ad4a2025022c None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:17.095534 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c85ea-913f-47d4-879f-ad4a2025022c None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:17.095801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c85ea-913f-47d4-879f-ad4a2025022c None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:17.096419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c85ea-913f-47d4-879f-ad4a2025022c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:17.096717 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c85ea-913f-47d4-879f-ad4a2025022c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:17.098082 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c85ea-913f-47d4-879f-ad4a2025022c None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:17.107865 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 512/1026] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 23 07:57:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:17.109060 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46decd-ab08-488f-b44a-022a99c0b7ac None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:17.197330 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:17.213310 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46decd-ab08-488f-b44a-022a99c0b7ac None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:17.246717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1251f35-676d-4c72-9aaa-1f507e878057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:17.247315 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1251f35-676d-4c72-9aaa-1f507e878057 None admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:17.247590 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1251f35-676d-4c72-9aaa-1f507e878057 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:17.247860 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1251f35-676d-4c72-9aaa-1f507e878057 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:17.248511 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1251f35-676d-4c72-9aaa-1f507e878057 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:17.249903 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1251f35-676d-4c72-9aaa-1f507e878057 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:17.356435 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 515/1027] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 07:57:17 2022] POST /identity/v3/endpoints => generated 334 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:57:17.999742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa0fed-f582-48cf-99d4-17c18a876176 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:18.000096 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa0fed-f582-48cf-99d4-17c18a876176 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:18.000310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa0fed-f582-48cf-99d4-17c18a876176 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:18.001694 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 513/1028] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:57:18.006878 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f80ad-870e-4ca2-a27c-e363b0769fa0 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:18.007230 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f80ad-870e-4ca2-a27c-e363b0769fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:18.007596 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f80ad-870e-4ca2-a27c-e363b0769fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:18.026465 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-cb0f80ad-870e-4ca2-a27c-e363b0769fa0 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:18.027639 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-cb0f80ad-870e-4ca2-a27c-e363b0769fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:18.100085 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 516/1029] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:57:18.371280 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920f2c9-df49-4af0-a5f5-94da887cf50b None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:18.371764 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920f2c9-df49-4af0-a5f5-94da887cf50b None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:18.371764 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920f2c9-df49-4af0-a5f5-94da887cf50b None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:18.373232 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 514/1030] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:57:18.378260 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4682b-95bd-4551-b054-cfef49e74655 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:18.378666 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920f2c9-df49-4af0-a5f5-94da887cf50b None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:18.378745 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4682b-95bd-4551-b054-cfef49e74655 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:18.378964 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4682b-95bd-4551-b054-cfef49e74655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:18.399467 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-37c4682b-95bd-4551-b054-cfef49e74655 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:18.400565 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-37c4682b-95bd-4551-b054-cfef49e74655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:18.465359 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:18.473332 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 517/1031] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:57:18.484485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920f2c9-df49-4af0-a5f5-94da887cf50b None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:18.515208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:18.520275 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f78c5f-8063-4fc5-932b-94c01a66a7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:18.520905 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f78c5f-8063-4fc5-932b-94c01a66a7fd None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:18.521187 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f78c5f-8063-4fc5-932b-94c01a66a7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:18.521462 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f78c5f-8063-4fc5-932b-94c01a66a7fd None admin] PATH_INFO: `/v3/services/image` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:18.522099 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f78c5f-8063-4fc5-932b-94c01a66a7fd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:18.524175 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f78c5f-8063-4fc5-932b-94c01a66a7fd None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:18.533574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-e2f78c5f-8063-4fc5-932b-94c01a66a7fd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 07:57:18.533574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:18.533574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:57:18.533574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:57:18.533574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:57:18.533574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:57:18.533574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:57:18.533574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:57:18.533574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 07:57:18.533574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:18.533574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:57:18.533574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:18.533574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:18.533574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:18.533574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:18.533574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:18.533574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:18.534704 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:18.534704 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:18.534704 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:18.534704 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:18.534704 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:18.534704 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:18.534704 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:57:18.534704 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:57:18.534704 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:57:18.534704 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:57:18.534704 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:18.534704 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:18.534704 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:18.534704 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:18.534704 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:18.534704 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:18.535545 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:18.535545 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:18.535545 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:18.535545 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:18.535545 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:18.535545 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:18.535545 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:18.535545 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:18.535545 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:18.535545 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:18.535545 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:57:18.535545 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:57:18.535545 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 07:57:18.535545 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:18.535545 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 515/1032] 10.222.0.57 () {56 vars in 1105 bytes} [Tue Aug 23 07:57:18 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:57:18.540994 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4682b-95bd-4551-b054-cfef49e74655 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:18.639593 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4682b-95bd-4551-b054-cfef49e74655 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:18.680126 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50dd20-b1d9-4afe-acf1-519d254c9802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:18.680732 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50dd20-b1d9-4afe-acf1-519d254c9802 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:18.681007 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50dd20-b1d9-4afe-acf1-519d254c9802 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:18.681276 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50dd20-b1d9-4afe-acf1-519d254c9802 None admin] PATH_INFO: `/v3/services` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:18.681897 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50dd20-b1d9-4afe-acf1-519d254c9802 None admin] RBAC: Adding query filter params (name=image) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:18.682197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50dd20-b1d9-4afe-acf1-519d254c9802 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:18.683579 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50dd20-b1d9-4afe-acf1-519d254c9802 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:18.693084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 518/1033] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:57:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:18.694680 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f78c5f-8063-4fc5-932b-94c01a66a7fd None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:18.743020 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50dd20-b1d9-4afe-acf1-519d254c9802 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:18.801439 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f78c5f-8063-4fc5-932b-94c01a66a7fd None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:18.805538 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:18.838164 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fffed7-4bfe-43ba-b6a4-e0c40b376304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:18.838803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fffed7-4bfe-43ba-b6a4-e0c40b376304 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:18.839085 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fffed7-4bfe-43ba-b6a4-e0c40b376304 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:18.839358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fffed7-4bfe-43ba-b6a4-e0c40b376304 None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:18.840033 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fffed7-4bfe-43ba-b6a4-e0c40b376304 None admin] RBAC: Adding query filter params (type=image) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:18.840279 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fffed7-4bfe-43ba-b6a4-e0c40b376304 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:18.841660 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fffed7-4bfe-43ba-b6a4-e0c40b376304 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:18.846816 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 516/1034] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:57:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:18.849890 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50dd20-b1d9-4afe-acf1-519d254c9802 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:18.853152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fffed7-4bfe-43ba-b6a4-e0c40b376304 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:18.887710 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6830e-f896-471c-956e-3bdc02c3703c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:18.888342 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6830e-f896-471c-956e-3bdc02c3703c None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:18.888616 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6830e-f896-471c-956e-3bdc02c3703c None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:18.888880 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6830e-f896-471c-956e-3bdc02c3703c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:18.891735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6830e-f896-471c-956e-3bdc02c3703c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:18.894480 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6830e-f896-471c-956e-3bdc02c3703c None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:18.897073 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 519/1035] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:57:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:57:18.902695 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6830e-f896-471c-956e-3bdc02c3703c None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:18.918453 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:18.959968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fffed7-4bfe-43ba-b6a4-e0c40b376304 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:19.002019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c9830-cb68-49fd-b1e2-0749598d26a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:19.002665 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c9830-cb68-49fd-b1e2-0749598d26a4 None admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:19.002943 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c9830-cb68-49fd-b1e2-0749598d26a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:19.003212 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c9830-cb68-49fd-b1e2-0749598d26a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:19.003865 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c9830-cb68-49fd-b1e2-0749598d26a4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:19.005231 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c9830-cb68-49fd-b1e2-0749598d26a4 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:19.007528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6830e-f896-471c-956e-3bdc02c3703c None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:19.034771 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:19.042462 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20230808-6dca-4ec0-a972-03d82608372f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:19.043111 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20230808-6dca-4ec0-a972-03d82608372f None admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:19.043387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20230808-6dca-4ec0-a972-03d82608372f None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:19.043678 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20230808-6dca-4ec0-a972-03d82608372f None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:19.044312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20230808-6dca-4ec0-a972-03d82608372f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:19.045733 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20230808-6dca-4ec0-a972-03d82608372f None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:19.098785 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 517/1036] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 07:57:18 2022] POST /identity/v3/endpoints => generated 327 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 07:57:19.210332 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 520/1037] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 23 07:57:18 2022] POST /identity/v3/users => generated 285 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 07:57:19.408517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe485b4-edb3-4d38-830d-a9e63e9567b7 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:19.409033 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe485b4-edb3-4d38-830d-a9e63e9567b7 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:19.409123 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe485b4-edb3-4d38-830d-a9e63e9567b7 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:19.410440 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 518/1038] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:57:19.416150 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b3b0f-0cc9-4da4-bc46-7b3389319ece None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:19.416580 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b3b0f-0cc9-4da4-bc46-7b3389319ece None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:19.416749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b3b0f-0cc9-4da4-bc46-7b3389319ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:19.436512 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-d94b3b0f-0cc9-4da4-bc46-7b3389319ece None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:19.437713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-d94b3b0f-0cc9-4da4-bc46-7b3389319ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:19.515514 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 521/1039] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:57:19.797703 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe485b4-edb3-4d38-830d-a9e63e9567b7 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:19.899560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe485b4-edb3-4d38-830d-a9e63e9567b7 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:19.916132 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:19.939305 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b164d73-e388-4431-8a9b-34d19d88d588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:19.948312 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b164d73-e388-4431-8a9b-34d19d88d588 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:19.948312 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b164d73-e388-4431-8a9b-34d19d88d588 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:19.948312 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b164d73-e388-4431-8a9b-34d19d88d588 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:19.951743 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b164d73-e388-4431-8a9b-34d19d88d588 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:57:19.956449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-4b164d73-e388-4431-8a9b-34d19d88d588 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 07:57:19.956449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:19.956449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:19.956449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:19.956449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:19.956449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:19.956449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:19.956449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:19.956449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:19.956449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:19.956449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:19.956449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:19.956449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:57:19.956449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:57:19.956449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:57:19.956449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:57:19.957419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:57:19.957419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:57:19.957419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:57:19.957419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:57:19.957419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:19.957419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:19.957419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:19.957419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:19.957419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:19.957419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:19.957419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:19.957419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:19.957419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:19.957419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:19.957419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:19.957419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:19.958695 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:19.958695 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:19.958695 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:19.958695 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:19.958695 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:57:19.958695 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:57:19.958695 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:57:19.958695 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:57:19.958695 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:57:19.958695 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:57:19.958695 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 07:57:19.958695 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:19.962378 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 519/1040] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Aug 23 07:57:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:19.964029 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b3b0f-0cc9-4da4-bc46-7b3389319ece None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:20.064548 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b3b0f-0cc9-4da4-bc46-7b3389319ece None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:20.076450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:20.099680 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17a86a-d08c-465f-84e2-1054afc0da80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:20.100562 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17a86a-d08c-465f-84e2-1054afc0da80 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:20.101028 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17a86a-d08c-465f-84e2-1054afc0da80 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:20.101484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17a86a-d08c-465f-84e2-1054afc0da80 None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:20.102562 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17a86a-d08c-465f-84e2-1054afc0da80 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:20.103128 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17a86a-d08c-465f-84e2-1054afc0da80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:20.104684 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17a86a-d08c-465f-84e2-1054afc0da80 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:20.119079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 522/1041] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Aug 23 07:57:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:57:20.121165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b164d73-e388-4431-8a9b-34d19d88d588 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:20.228566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b164d73-e388-4431-8a9b-34d19d88d588 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:20.267939 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052785a-eb23-48af-a5fb-93e5713ecbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:20.268417 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052785a-eb23-48af-a5fb-93e5713ecbc5 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:20.268703 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052785a-eb23-48af-a5fb-93e5713ecbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:20.268983 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052785a-eb23-48af-a5fb-93e5713ecbc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:20.283451 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052785a-eb23-48af-a5fb-93e5713ecbc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:20.284913 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052785a-eb23-48af-a5fb-93e5713ecbc5 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:20.299928 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-9052785a-eb23-48af-a5fb-93e5713ecbc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:57:20.299928 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:20.299928 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:20.299928 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:20.299928 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:20.299928 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:20.299928 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:20.299928 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:20.299928 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:20.299928 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:20.299928 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:20.299928 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:20.299928 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:57:20.299928 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:57:20.299928 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:57:20.299928 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:57:20.300893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:20.300893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:20.300893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:20.300893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:20.300893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:20.300893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:20.300893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:20.300893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:20.300893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:20.300893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:20.300893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:20.300893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:20.300893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:20.300893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:20.300893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:20.300893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:20.300893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:57:20.301821 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:57:20.301821 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:57:20.301821 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:20.306102 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 520/1042] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:57:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:20.307365 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17a86a-d08c-465f-84e2-1054afc0da80 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:20.411576 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17a86a-d08c-465f-84e2-1054afc0da80 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:20.443649 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0b85e-273b-4999-b2d5-df11a51ce4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:20.444322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0b85e-273b-4999-b2d5-df11a51ce4b5 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:20.444526 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0b85e-273b-4999-b2d5-df11a51ce4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:20.444795 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0b85e-273b-4999-b2d5-df11a51ce4b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:20.445981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0b85e-273b-4999-b2d5-df11a51ce4b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:20.446280 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0b85e-273b-4999-b2d5-df11a51ce4b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:20.447703 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0b85e-273b-4999-b2d5-df11a51ce4b5 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:20.465042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 523/1043] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:20.466942 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052785a-eb23-48af-a5fb-93e5713ecbc5 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:20.496577 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:20.568029 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052785a-eb23-48af-a5fb-93e5713ecbc5 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:20.602491 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228b6dc-b2ab-4a1e-a89a-87238a11576c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:20.603113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228b6dc-b2ab-4a1e-a89a-87238a11576c None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:20.603389 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228b6dc-b2ab-4a1e-a89a-87238a11576c None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:20.603656 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228b6dc-b2ab-4a1e-a89a-87238a11576c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:20.610719 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5228b6dc-b2ab-4a1e-a89a-87238a11576c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:20.612191 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5228b6dc-b2ab-4a1e-a89a-87238a11576c None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:20.624832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-5228b6dc-b2ab-4a1e-a89a-87238a11576c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:57:20.624832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:20.624832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:20.624832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:20.624832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:20.624832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:20.624832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:20.624832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:20.624832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:20.624832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:20.624832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:20.624832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:20.624832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:57:20.624832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:57:20.624832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:57:20.624832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:57:20.625841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:20.625841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:20.625841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:57:20.625841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:57:20.625841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:57:20.625841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:57:20.625841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:20.625841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:20.625841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:20.625841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:20.625841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:20.625841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:20.625841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:20.625841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:20.625841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:20.625841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:20.625841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:20.625841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:20.627267 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:20.627267 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:20.627267 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:57:20.627267 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:57:20.627267 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:57:20.627267 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:57:20.627267 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:57:20.627267 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:57:20.627267 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:57:20.627267 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:20.630611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 521/1044] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Aug 23 07:57:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:20.631887 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0b85e-273b-4999-b2d5-df11a51ce4b5 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:20.664261 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:20.735410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0b85e-273b-4999-b2d5-df11a51ce4b5 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:20.771934 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff58bac-c630-493b-b973-2a116cc40779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:20.772542 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff58bac-c630-493b-b973-2a116cc40779 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:20.772821 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff58bac-c630-493b-b973-2a116cc40779 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:20.773095 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff58bac-c630-493b-b973-2a116cc40779 None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:20.773883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff58bac-c630-493b-b973-2a116cc40779 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:20.774464 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff58bac-c630-493b-b973-2a116cc40779 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:20.775695 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff58bac-c630-493b-b973-2a116cc40779 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:20.798688 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 524/1045] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Aug 23 07:57:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:20.800224 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228b6dc-b2ab-4a1e-a89a-87238a11576c None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:20.889441 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:20.901871 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228b6dc-b2ab-4a1e-a89a-87238a11576c None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:20.936327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb125c-d045-4024-88e6-a8a31b78deeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:20.936852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb125c-d045-4024-88e6-a8a31b78deeb None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:20.937131 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb125c-d045-4024-88e6-a8a31b78deeb None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:20.937400 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb125c-d045-4024-88e6-a8a31b78deeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:21.009670 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb125c-d045-4024-88e6-a8a31b78deeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:21.011221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb125c-d045-4024-88e6-a8a31b78deeb None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:21.059272 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b978f-51f1-4559-9ab5-577b7a13fb9a None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:21.059605 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b978f-51f1-4559-9ab5-577b7a13fb9a None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:21.059842 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b978f-51f1-4559-9ab5-577b7a13fb9a None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:21.061343 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 525/1046] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:57:21.066021 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1343244-15e9-4d5f-9015-fdeac1abec5d None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:21.066319 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1343244-15e9-4d5f-9015-fdeac1abec5d None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:21.066596 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1343244-15e9-4d5f-9015-fdeac1abec5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:21.085410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-d1343244-15e9-4d5f-9015-fdeac1abec5d None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:21.086805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-d1343244-15e9-4d5f-9015-fdeac1abec5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:21.098097 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:21.116573 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 522/1047] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:57:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:57:21.118910 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb125c-d045-4024-88e6-a8a31b78deeb None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:21.160138 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 526/1048] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:57:21.219957 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb125c-d045-4024-88e6-a8a31b78deeb None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:21.235625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184744b-60ac-4de9-8274-89f0af8d29f8 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:21.235922 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184744b-60ac-4de9-8274-89f0af8d29f8 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:21.236205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184744b-60ac-4de9-8274-89f0af8d29f8 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:21.237763 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 527/1049] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:57:21.243983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9f871-1e09-4442-9320-50ea654c458c None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:21.244268 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9f871-1e09-4442-9320-50ea654c458c None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:21.244577 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9f871-1e09-4442-9320-50ea654c458c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:21.256968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade7137-ce9c-40fe-8dd8-24780277dfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:21.257606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade7137-ce9c-40fe-8dd8-24780277dfe8 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:21.257916 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade7137-ce9c-40fe-8dd8-24780277dfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:21.258190 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade7137-ce9c-40fe-8dd8-24780277dfe8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:21.265399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-c1b9f871-1e09-4442-9320-50ea654c458c None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:21.266640 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c1b9f871-1e09-4442-9320-50ea654c458c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:21.268958 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade7137-ce9c-40fe-8dd8-24780277dfe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:21.270575 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade7137-ce9c-40fe-8dd8-24780277dfe8 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:21.281213 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:21.286664 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-cade7137-ce9c-40fe-8dd8-24780277dfe8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:57:21.286664 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:21.286664 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:21.286664 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:21.286664 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:21.286664 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:21.286664 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:21.286664 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:21.286664 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:21.286664 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:21.286664 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:21.286664 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:21.286664 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:57:21.286664 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:57:21.286664 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:57:21.286664 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:57:21.287576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:21.287576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:21.287576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:21.287576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:21.287576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:21.287576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:21.287576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:21.287576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:21.287576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:21.287576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:21.287576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:21.287576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:21.287576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:21.287576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:21.287576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:21.287576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:21.287576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:57:21.289666 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:57:21.289666 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:57:21.289666 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:21.289666 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 523/1050] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:57:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:57:21.294005 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade7137-ce9c-40fe-8dd8-24780277dfe8 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:21.340899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 528/1051] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:57:21.342254 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:21.401017 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade7137-ce9c-40fe-8dd8-24780277dfe8 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:21.431506 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9f871-1e09-4442-9320-50ea654c458c None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:21.435113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530512da-9c0c-40ab-9385-86038c20b268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:21.435728 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530512da-9c0c-40ab-9385-86038c20b268 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:21.436004 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530512da-9c0c-40ab-9385-86038c20b268 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:21.436274 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530512da-9c0c-40ab-9385-86038c20b268 None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:21.436906 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530512da-9c0c-40ab-9385-86038c20b268 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:21.437205 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530512da-9c0c-40ab-9385-86038c20b268 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:21.438599 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530512da-9c0c-40ab-9385-86038c20b268 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:21.452316 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 524/1052] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:57:21.457622 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530512da-9c0c-40ab-9385-86038c20b268 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:21.540020 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9f871-1e09-4442-9320-50ea654c458c None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:21.559669 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:21.562831 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530512da-9c0c-40ab-9385-86038c20b268 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:21.578304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd775ee9-1e4e-4086-8f94-10f14d36eaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:21.579214 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd775ee9-1e4e-4086-8f94-10f14d36eaa6 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:21.579792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd775ee9-1e4e-4086-8f94-10f14d36eaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:21.580339 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd775ee9-1e4e-4086-8f94-10f14d36eaa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:21.598166 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4416dd2-4196-4d2d-bca7-3cf9013627e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:21.599162 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4416dd2-4196-4d2d-bca7-3cf9013627e6 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:21.599616 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4416dd2-4196-4d2d-bca7-3cf9013627e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:21.599897 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4416dd2-4196-4d2d-bca7-3cf9013627e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:21.601166 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:21.608985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4416dd2-4196-4d2d-bca7-3cf9013627e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:21.611485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4416dd2-4196-4d2d-bca7-3cf9013627e6 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:21.625552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-d4416dd2-4196-4d2d-bca7-3cf9013627e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:57:21.625552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:21.625552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:21.625552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:21.625552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:21.625552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:21.625552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:21.625552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:21.625552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:21.625552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:21.625552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:21.625552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:21.625552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:57:21.625552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:57:21.625552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:57:21.626675 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:57:21.626675 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:21.626675 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:21.626675 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:21.626675 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:21.626675 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:21.626675 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:21.626675 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:21.626675 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:21.626675 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:21.626675 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:21.626675 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:21.626675 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:21.626675 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:21.626675 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:21.626675 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:21.626675 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:21.627591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:57:21.627591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:57:21.627591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:57:21.627591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:57:21.627591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:57:21.627591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:57:21.627591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:57:21.627591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:21.627591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 525/1053] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:57:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:57:21.627591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4416dd2-4196-4d2d-bca7-3cf9013627e6 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:21.658620 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd775ee9-1e4e-4086-8f94-10f14d36eaa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:21.660090 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd775ee9-1e4e-4086-8f94-10f14d36eaa6 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:21.728147 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4416dd2-4196-4d2d-bca7-3cf9013627e6 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:21.757318 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 529/1054] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:57:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 07:57:21.758908 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd775ee9-1e4e-4086-8f94-10f14d36eaa6 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:21.761460 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17136b3-1056-4eaa-bd25-72ea75720674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:21.762087 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17136b3-1056-4eaa-bd25-72ea75720674 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:21.762396 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17136b3-1056-4eaa-bd25-72ea75720674 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:21.762762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17136b3-1056-4eaa-bd25-72ea75720674 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:21.773132 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17136b3-1056-4eaa-bd25-72ea75720674 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:57:21.778552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-f17136b3-1056-4eaa-bd25-72ea75720674 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:57:21.778552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:21.778552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:21.778552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:21.778552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:21.778552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:21.778552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:21.778552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:21.778552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:21.778552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:21.778552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:21.778552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:21.778552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:57:21.778552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:57:21.778552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:57:21.778552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:57:21.779584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:57:21.779584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:57:21.779584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:57:21.779584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:57:21.779584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:21.779584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:21.779584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:21.779584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:21.779584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:21.779584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:21.779584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:21.779584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:21.779584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:21.779584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:21.779584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:21.779584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:21.780429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:21.780429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:21.780429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:21.780429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:21.780429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:57:21.780429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:57:21.780429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:57:21.780429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:57:21.780429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:57:21.780429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:57:21.780429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:57:21.780429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:21.780429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 526/1055] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:57:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:21.780429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17136b3-1056-4eaa-bd25-72ea75720674 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:21.802103 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:21.810560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:21.860260 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd775ee9-1e4e-4086-8f94-10f14d36eaa6 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:21.879428 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17136b3-1056-4eaa-bd25-72ea75720674 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:21.897572 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fe297-26d0-4450-99de-3123dc68e347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:21.898168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fe297-26d0-4450-99de-3123dc68e347 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:21.898548 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fe297-26d0-4450-99de-3123dc68e347 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:21.899334 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fe297-26d0-4450-99de-3123dc68e347 None admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:21.900183 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fe297-26d0-4450-99de-3123dc68e347 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:21.900496 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fe297-26d0-4450-99de-3123dc68e347 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:21.901934 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fe297-26d0-4450-99de-3123dc68e347 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:21.913242 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 530/1056] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:57:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:21.914027 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fe297-26d0-4450-99de-3123dc68e347 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:21.918846 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81447f9a-57fb-4551-9884-010e99410cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:21.919481 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81447f9a-57fb-4551-9884-010e99410cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:21.919760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81447f9a-57fb-4551-9884-010e99410cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:21.920032 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81447f9a-57fb-4551-9884-010e99410cb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:21.929999 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81447f9a-57fb-4551-9884-010e99410cb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:21.931497 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81447f9a-57fb-4551-9884-010e99410cb3 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:21.946333 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-81447f9a-57fb-4551-9884-010e99410cb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:57:21.946333 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:21.946333 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:21.946333 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:21.946333 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:21.946333 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:21.946333 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:21.946333 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:21.946333 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:21.946333 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:21.946333 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:21.946333 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:21.946333 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:57:21.946333 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:57:21.946333 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:57:21.946333 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:57:21.947416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:21.947416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:21.947416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:21.947416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:21.947416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:21.947416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:21.947416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:21.947416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:21.947416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:21.947416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:21.947416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:21.947416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:21.947416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:21.947416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:21.947416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:21.947416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:21.947416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:57:21.948462 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:57:21.948462 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:57:21.948462 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:21.948462 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 527/1057] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:57:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:21.948462 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81447f9a-57fb-4551-9884-010e99410cb3 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:22.017155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:22.019693 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fe297-26d0-4450-99de-3123dc68e347 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:22.030448 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:22.047002 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81447f9a-57fb-4551-9884-010e99410cb3 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:22.053182 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422f9cd-04f3-444b-a431-6ba9aaeb37dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:22.053736 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422f9cd-04f3-444b-a431-6ba9aaeb37dd None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:22.054022 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422f9cd-04f3-444b-a431-6ba9aaeb37dd None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:22.054321 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422f9cd-04f3-444b-a431-6ba9aaeb37dd None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:22.055695 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422f9cd-04f3-444b-a431-6ba9aaeb37dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:22.056039 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422f9cd-04f3-444b-a431-6ba9aaeb37dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:22.057615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422f9cd-04f3-444b-a431-6ba9aaeb37dd None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:22.065878 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 531/1058] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:57:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:22.066700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422f9cd-04f3-444b-a431-6ba9aaeb37dd None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:22.081355 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddaec5e-003c-41a6-b001-f7df24511625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:22.081956 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddaec5e-003c-41a6-b001-f7df24511625 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:22.082229 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddaec5e-003c-41a6-b001-f7df24511625 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:22.082531 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddaec5e-003c-41a6-b001-f7df24511625 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:22.083243 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddaec5e-003c-41a6-b001-f7df24511625 None admin] RBAC: Adding query filter params (role.id=0c9e286fb47049feb93649dbd95342a1, scope.project.id=a80ab70ab6b9415c98017d05512c33eb, user.id=b5c55e5c1cea47f29d378ea457384a31) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:22.083547 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddaec5e-003c-41a6-b001-f7df24511625 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:22.084960 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddaec5e-003c-41a6-b001-f7df24511625 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:22.090425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 528/1059] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:57:21 2022] GET /identity/v3/role_assignments?user.id=b5c55e5c1cea47f29d378ea457384a31&scope.project.id=a80ab70ab6b9415c98017d05512c33eb&role.id=0c9e286fb47049feb93649dbd95342a1 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:22.091220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddaec5e-003c-41a6-b001-f7df24511625 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:22.192053 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422f9cd-04f3-444b-a431-6ba9aaeb37dd None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:22.210937 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddaec5e-003c-41a6-b001-f7df24511625 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:22.254732 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0de812-4dfb-4d77-bf7e-f9e9dd5ddac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:22.255173 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095b196-e958-4b45-a45f-a123638e4cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:22.255390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0de812-4dfb-4d77-bf7e-f9e9dd5ddac5 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:22.255639 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0de812-4dfb-4d77-bf7e-f9e9dd5ddac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:22.255807 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095b196-e958-4b45-a45f-a123638e4cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:22.255917 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0de812-4dfb-4d77-bf7e-f9e9dd5ddac5 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:22.256087 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095b196-e958-4b45-a45f-a123638e4cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:22.256362 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095b196-e958-4b45-a45f-a123638e4cb6 None admin] PATH_INFO: `/v3/users/8859a3c7342c4f28bc59a5943ce44dd4` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:22.256545 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0de812-4dfb-4d77-bf7e-f9e9dd5ddac5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:22.256887 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0de812-4dfb-4d77-bf7e-f9e9dd5ddac5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:22.259453 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0de812-4dfb-4d77-bf7e-f9e9dd5ddac5 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:22.260231 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:22.272858 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 532/1060] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:22.275277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095b196-e958-4b45-a45f-a123638e4cb6 None admin] RBAC: Authorizing `identity:get_user(user_id=8859a3c7342c4f28bc59a5943ce44dd4)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:22.276784 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095b196-e958-4b45-a45f-a123638e4cb6 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:22.283742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 529/1061] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:57:22 2022] GET /identity/v3/users/8859a3c7342c4f28bc59a5943ce44dd4 => generated 285 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:22.284893 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0de812-4dfb-4d77-bf7e-f9e9dd5ddac5 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:22.324225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:22.402712 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0de812-4dfb-4d77-bf7e-f9e9dd5ddac5 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:22.440015 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614323b-e5b2-42d2-b511-8261f40ad18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:22.440626 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614323b-e5b2-42d2-b511-8261f40ad18d None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:22.440911 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614323b-e5b2-42d2-b511-8261f40ad18d None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:22.441191 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614323b-e5b2-42d2-b511-8261f40ad18d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:22.514072 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614323b-e5b2-42d2-b511-8261f40ad18d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:22.515576 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614323b-e5b2-42d2-b511-8261f40ad18d None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:22.547582 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:22.618985 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 533/1062] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:57:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:57:22.624833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095b196-e958-4b45-a45f-a123638e4cb6 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:22.725606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095b196-e958-4b45-a45f-a123638e4cb6 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:22.759256 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2ebcd-fd3b-46a1-bad9-edf285ff77cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:22.759882 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2ebcd-fd3b-46a1-bad9-edf285ff77cb None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:22.760162 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2ebcd-fd3b-46a1-bad9-edf285ff77cb None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:22.760435 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2ebcd-fd3b-46a1-bad9-edf285ff77cb None admin] PATH_INFO: `/v3/projects/24c21f55704b49f296d13c907f680f9f` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:22.761532 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2ebcd-fd3b-46a1-bad9-edf285ff77cb None admin] RBAC: Authorizing `identity:get_project(project_id=24c21f55704b49f296d13c907f680f9f)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:22.763001 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2ebcd-fd3b-46a1-bad9-edf285ff77cb None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:22.764619 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 530/1063] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:57:22 2022] GET /identity/v3/projects/24c21f55704b49f296d13c907f680f9f => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:22.770753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614323b-e5b2-42d2-b511-8261f40ad18d None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:22.870264 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614323b-e5b2-42d2-b511-8261f40ad18d None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:22.899766 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:22.904863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd31ea3-88d2-42f2-8de6-e339e299e598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:22.905463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd31ea3-88d2-42f2-8de6-e339e299e598 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:22.905742 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd31ea3-88d2-42f2-8de6-e339e299e598 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:22.906016 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd31ea3-88d2-42f2-8de6-e339e299e598 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:22.906773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd31ea3-88d2-42f2-8de6-e339e299e598 None admin] RBAC: Adding query filter params (role.id=e905040849d04aadbb8da8b0d216c92c, scope.project.id=24c21f55704b49f296d13c907f680f9f, user.id=8859a3c7342c4f28bc59a5943ce44dd4) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:22.907082 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd31ea3-88d2-42f2-8de6-e339e299e598 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:22.908518 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd31ea3-88d2-42f2-8de6-e339e299e598 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:22.924826 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 534/1064] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:57:22 2022] GET /identity/v3/role_assignments?user.id=8859a3c7342c4f28bc59a5943ce44dd4&scope.project.id=24c21f55704b49f296d13c907f680f9f&role.id=e905040849d04aadbb8da8b0d216c92c => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:23.998114 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00428a9-78a7-4623-9ec1-2c16f9d374cb None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:23.998722 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00428a9-78a7-4623-9ec1-2c16f9d374cb None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:23.998722 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00428a9-78a7-4623-9ec1-2c16f9d374cb None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:24.000010 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 531/1065] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:57:24.005032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c7aa2-ebb6-4b06-b2f1-040f58c009e3 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:24.005410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c7aa2-ebb6-4b06-b2f1-040f58c009e3 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:24.005586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c7aa2-ebb6-4b06-b2f1-040f58c009e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:24.024543 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-b21c7aa2-ebb6-4b06-b2f1-040f58c009e3 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:24.025709 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-b21c7aa2-ebb6-4b06-b2f1-040f58c009e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:24.089899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 535/1066] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:57:24.372639 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00428a9-78a7-4623-9ec1-2c16f9d374cb None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:24.443891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:24.488616 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00428a9-78a7-4623-9ec1-2c16f9d374cb None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:24.528635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd3fd6-6964-43c8-a9f9-16014a2e9f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:24.529358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd3fd6-6964-43c8-a9f9-16014a2e9f7a None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:24.529613 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd3fd6-6964-43c8-a9f9-16014a2e9f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:24.529883 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd3fd6-6964-43c8-a9f9-16014a2e9f7a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:24.541750 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd3fd6-6964-43c8-a9f9-16014a2e9f7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:57:24.546588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-9dbd3fd6-6964-43c8-a9f9-16014a2e9f7a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 07:57:24.546588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:24.546588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:24.546588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:24.546588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:24.546588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:24.546588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:24.546588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:24.546588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:24.546588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:24.546588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:24.546588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:24.546588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:57:24.546588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:57:24.546588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:57:24.546588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:57:24.547748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:57:24.547748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:57:24.547748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:57:24.547748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:57:24.547748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:24.547748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:24.547748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:24.547748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:24.547748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:24.547748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:24.547748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:24.547748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:24.547748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:24.547748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:24.547748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:24.547748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:24.548896 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:24.548896 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:24.548896 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:24.548896 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:24.548896 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:57:24.548896 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:57:24.548896 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:57:24.548896 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:57:24.548896 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:57:24.548896 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:57:24.548896 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 07:57:24.548896 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:24.548896 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 532/1067] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Aug 23 07:57:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:24.555501 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c7aa2-ebb6-4b06-b2f1-040f58c009e3 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:24.680269 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c7aa2-ebb6-4b06-b2f1-040f58c009e3 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:24.708465 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:24.718140 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a859487-de10-462f-bafb-092279112e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:24.718832 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a859487-de10-462f-bafb-092279112e2c None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:24.723409 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a859487-de10-462f-bafb-092279112e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:24.723409 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a859487-de10-462f-bafb-092279112e2c None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:24.723409 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a859487-de10-462f-bafb-092279112e2c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:24.723409 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a859487-de10-462f-bafb-092279112e2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:24.723409 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a859487-de10-462f-bafb-092279112e2c None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:24.734239 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 536/1068] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Aug 23 07:57:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:24.740039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd3fd6-6964-43c8-a9f9-16014a2e9f7a None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:24.830549 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37be938-af3c-431c-8be0-15445df81f7f None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:24.830946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37be938-af3c-431c-8be0-15445df81f7f None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:24.831227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37be938-af3c-431c-8be0-15445df81f7f None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:24.832571 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 537/1069] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:57:24.838757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f572bf7-d5dd-43e4-99bd-d7053e0c820c None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:24.839145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f572bf7-d5dd-43e4-99bd-d7053e0c820c None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:24.839612 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f572bf7-d5dd-43e4-99bd-d7053e0c820c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:24.850100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd3fd6-6964-43c8-a9f9-16014a2e9f7a None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:24.862670 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-5f572bf7-d5dd-43e4-99bd-d7053e0c820c None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:24.863913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-5f572bf7-d5dd-43e4-99bd-d7053e0c820c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:24.872654 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:24.885004 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180087d-8bf4-40f0-b62d-0c3cf4118363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:24.885932 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180087d-8bf4-40f0-b62d-0c3cf4118363 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:24.886218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180087d-8bf4-40f0-b62d-0c3cf4118363 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:24.886587 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180087d-8bf4-40f0-b62d-0c3cf4118363 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:24.899404 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180087d-8bf4-40f0-b62d-0c3cf4118363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:24.901033 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180087d-8bf4-40f0-b62d-0c3cf4118363 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:24.917449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-7180087d-8bf4-40f0-b62d-0c3cf4118363 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:57:24.917449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:24.917449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:24.917449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:24.917449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:24.917449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:24.917449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:24.917449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:24.917449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:24.917449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:24.917449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:24.917449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:24.917449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:57:24.917449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:57:24.917449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:57:24.917449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:57:24.918802 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:24.918802 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:24.918802 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:24.918802 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:24.918802 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:24.918802 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:24.918802 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:24.918802 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:24.918802 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:24.918802 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:24.918802 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:24.918802 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:24.918802 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:24.918802 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:24.918802 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:24.918802 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:24.918802 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:57:24.919899 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:57:24.919899 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:57:24.919899 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:24.919899 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 533/1070] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:57:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:24.925198 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180087d-8bf4-40f0-b62d-0c3cf4118363 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:24.946300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 538/1071] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:57:25.043942 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180087d-8bf4-40f0-b62d-0c3cf4118363 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:25.081365 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f440b-8800-4a53-959e-c426ddae71d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:25.081970 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f440b-8800-4a53-959e-c426ddae71d4 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:25.082249 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f440b-8800-4a53-959e-c426ddae71d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:25.082548 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f440b-8800-4a53-959e-c426ddae71d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:25.083182 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f440b-8800-4a53-959e-c426ddae71d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:25.083483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f440b-8800-4a53-959e-c426ddae71d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:25.084859 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f440b-8800-4a53-959e-c426ddae71d4 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:25.098001 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 534/1072] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:57:25.103620 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f572bf7-d5dd-43e4-99bd-d7053e0c820c None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:25.217096 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f572bf7-d5dd-43e4-99bd-d7053e0c820c None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:25.235363 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:25.252426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdfa39-99ce-4dcd-bacf-6b7c81178526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:25.253060 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdfa39-99ce-4dcd-bacf-6b7c81178526 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:25.253337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdfa39-99ce-4dcd-bacf-6b7c81178526 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:25.253605 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdfa39-99ce-4dcd-bacf-6b7c81178526 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:25.261915 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f440b-8800-4a53-959e-c426ddae71d4 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:25.262837 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bdfa39-99ce-4dcd-bacf-6b7c81178526 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:25.264511 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bdfa39-99ce-4dcd-bacf-6b7c81178526 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:25.276633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-01bdfa39-99ce-4dcd-bacf-6b7c81178526 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:57:25.276633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:25.276633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:25.276633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:25.276633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:25.276633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:25.276633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:25.276633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:25.276633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:25.276633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:25.276633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:25.276633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:25.276633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:57:25.276633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:57:25.276633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:57:25.276633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:57:25.277637 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:25.277637 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:25.277637 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:57:25.277637 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:57:25.277637 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:57:25.277637 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:57:25.277637 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:25.277637 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:25.277637 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:25.277637 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:25.277637 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:25.277637 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:25.277637 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:25.277637 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:25.277637 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:25.277637 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:25.277637 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:25.277637 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:25.278639 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:25.278639 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:25.278639 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:57:25.278639 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:57:25.278639 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:57:25.278639 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:57:25.278639 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:57:25.278639 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:57:25.278639 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:57:25.278639 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:25.282492 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 539/1073] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Aug 23 07:57:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:25.283447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdfa39-99ce-4dcd-bacf-6b7c81178526 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:25.308537 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:25.375186 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f440b-8800-4a53-959e-c426ddae71d4 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:25.385102 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdfa39-99ce-4dcd-bacf-6b7c81178526 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:25.409400 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb21011-411e-4f86-8a6f-b267d50f51d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:25.410223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb21011-411e-4f86-8a6f-b267d50f51d9 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:25.410534 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb21011-411e-4f86-8a6f-b267d50f51d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:25.410806 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb21011-411e-4f86-8a6f-b267d50f51d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:25.418032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3615646-3652-42cf-a713-227aea3aa8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:25.418750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3615646-3652-42cf-a713-227aea3aa8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:25.419033 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3615646-3652-42cf-a713-227aea3aa8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:25.419312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3615646-3652-42cf-a713-227aea3aa8c5 None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:25.420036 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3615646-3652-42cf-a713-227aea3aa8c5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:25.420340 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3615646-3652-42cf-a713-227aea3aa8c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:25.421003 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb21011-411e-4f86-8a6f-b267d50f51d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:57:25.421771 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3615646-3652-42cf-a713-227aea3aa8c5 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:25.425636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-9fb21011-411e-4f86-8a6f-b267d50f51d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:57:25.425636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:25.425636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:25.425636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:25.425636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:25.425636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:25.425636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:25.425636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:25.425636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:25.425636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:25.425636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:25.425636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:25.425636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:57:25.425636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:57:25.425636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:57:25.425636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:57:25.426730 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:57:25.426730 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:57:25.426730 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:57:25.426730 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:57:25.426730 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:25.426730 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:25.426730 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:25.426730 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:25.426730 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:25.426730 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:25.426730 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:25.426730 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:25.426730 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:25.426730 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:25.426730 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:25.426730 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:25.427715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:25.427715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:25.427715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:25.427715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:25.427715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:57:25.427715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:57:25.427715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:57:25.427715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:57:25.427715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:57:25.427715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:57:25.427715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:57:25.427715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:25.427715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 535/1074] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:57:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:57:25.434209 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb21011-411e-4f86-8a6f-b267d50f51d9 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:25.447295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 540/1075] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Aug 23 07:57:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:25.448303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3615646-3652-42cf-a713-227aea3aa8c5 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:25.483384 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:25.527902 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:25.534727 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb21011-411e-4f86-8a6f-b267d50f51d9 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:25.549167 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3615646-3652-42cf-a713-227aea3aa8c5 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:25.568796 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc30e43-716a-4fdb-b44c-5e359bad2a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:25.569394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc30e43-716a-4fdb-b44c-5e359bad2a17 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:25.569686 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc30e43-716a-4fdb-b44c-5e359bad2a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:25.569948 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc30e43-716a-4fdb-b44c-5e359bad2a17 None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:25.571143 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc30e43-716a-4fdb-b44c-5e359bad2a17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:25.571441 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc30e43-716a-4fdb-b44c-5e359bad2a17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:25.572812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc30e43-716a-4fdb-b44c-5e359bad2a17 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:25.581712 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 536/1076] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:57:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:57:25.585413 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd23de2-2a6f-4336-9c6d-8647ae35a0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:25.586713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd23de2-2a6f-4336-9c6d-8647ae35a0d1 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:25.587022 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd23de2-2a6f-4336-9c6d-8647ae35a0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:25.587259 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd23de2-2a6f-4336-9c6d-8647ae35a0d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:25.588415 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc30e43-716a-4fdb-b44c-5e359bad2a17 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:25.602259 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd23de2-2a6f-4336-9c6d-8647ae35a0d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:25.604019 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd23de2-2a6f-4336-9c6d-8647ae35a0d1 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:25.620476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-cdd23de2-2a6f-4336-9c6d-8647ae35a0d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:57:25.620476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:25.620476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:25.620476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:25.620476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:25.620476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:25.620476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:25.620476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:25.620476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:25.620476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:25.620476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:25.620476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:25.620476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:57:25.620476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:57:25.620476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:57:25.620476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:57:25.621482 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:25.621482 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:25.621482 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:25.621482 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:25.621482 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:25.621482 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:25.621482 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:25.621482 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:25.621482 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:25.621482 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:25.621482 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:25.621482 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:25.621482 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:25.621482 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:25.621482 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:25.621482 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:25.621482 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:57:25.622388 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:57:25.622388 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:57:25.622388 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:25.622388 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 541/1077] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:57:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:57:25.627477 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd23de2-2a6f-4336-9c6d-8647ae35a0d1 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:25.693138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc30e43-716a-4fdb-b44c-5e359bad2a17 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:25.716213 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:25.725429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ade3ab-27c3-4ade-bd76-fcf929c24fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:25.726049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ade3ab-27c3-4ade-bd76-fcf929c24fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:25.726350 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ade3ab-27c3-4ade-bd76-fcf929c24fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:25.727171 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ade3ab-27c3-4ade-bd76-fcf929c24fc1 None admin] PATH_INFO: `/v3/users/8859a3c7342c4f28bc59a5943ce44dd4` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:25.729167 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ade3ab-27c3-4ade-bd76-fcf929c24fc1 None admin] RBAC: Authorizing `identity:get_user(user_id=8859a3c7342c4f28bc59a5943ce44dd4)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:25.729295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd23de2-2a6f-4336-9c6d-8647ae35a0d1 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:25.729805 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ade3ab-27c3-4ade-bd76-fcf929c24fc1 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:25.731424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 537/1078] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:57:25 2022] GET /identity/v3/users/8859a3c7342c4f28bc59a5943ce44dd4 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:57:25.737131 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ade3ab-27c3-4ade-bd76-fcf929c24fc1 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:25.761870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:25.763391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95515c-248b-4035-b61c-73fe15ed64b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:25.763991 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95515c-248b-4035-b61c-73fe15ed64b0 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:25.764266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95515c-248b-4035-b61c-73fe15ed64b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:25.764533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95515c-248b-4035-b61c-73fe15ed64b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:25.765157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95515c-248b-4035-b61c-73fe15ed64b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:25.765453 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95515c-248b-4035-b61c-73fe15ed64b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:25.766844 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95515c-248b-4035-b61c-73fe15ed64b0 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:25.778525 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 542/1079] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:57:25.784151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95515c-248b-4035-b61c-73fe15ed64b0 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:25.839003 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ade3ab-27c3-4ade-bd76-fcf929c24fc1 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:25.875391 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54970b08-44ff-4333-9d68-64f03db0a35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:25.876017 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54970b08-44ff-4333-9d68-64f03db0a35f None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:25.876299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54970b08-44ff-4333-9d68-64f03db0a35f None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:25.876571 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54970b08-44ff-4333-9d68-64f03db0a35f None admin] PATH_INFO: `/v3/projects/24c21f55704b49f296d13c907f680f9f` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:25.877676 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54970b08-44ff-4333-9d68-64f03db0a35f None admin] RBAC: Authorizing `identity:get_project(project_id=24c21f55704b49f296d13c907f680f9f)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:25.879153 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54970b08-44ff-4333-9d68-64f03db0a35f None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:25.885580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 538/1080] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:57:25 2022] GET /identity/v3/projects/24c21f55704b49f296d13c907f680f9f => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:57:25.886687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54970b08-44ff-4333-9d68-64f03db0a35f None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:25.890148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95515c-248b-4035-b61c-73fe15ed64b0 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:25.927352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644b51a-4a9f-4893-892d-c200842f9026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:25.927992 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644b51a-4a9f-4893-892d-c200842f9026 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:25.928273 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644b51a-4a9f-4893-892d-c200842f9026 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:25.928549 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644b51a-4a9f-4893-892d-c200842f9026 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:25.935944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644b51a-4a9f-4893-892d-c200842f9026 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:25.937391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644b51a-4a9f-4893-892d-c200842f9026 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:25.949171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-d644b51a-4a9f-4893-892d-c200842f9026 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:57:25.949171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:25.949171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:25.949171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:25.949171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:25.949171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:25.949171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:25.949171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:25.949171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:25.949171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:25.949171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:25.949171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:25.949171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:57:25.949171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:57:25.949171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:57:25.950208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:57:25.950208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:25.950208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:25.950208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:25.950208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:25.950208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:25.950208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:25.950208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:25.950208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:25.950208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:25.950208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:25.950208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:25.950208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:25.950208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:25.950208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:25.950208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:25.950208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:25.951385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:57:25.951385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:57:25.951385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:57:25.951385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:57:25.951385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:57:25.951385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:57:25.951385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:57:25.951385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:25.951385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 543/1081] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:57:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:57:25.956055 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644b51a-4a9f-4893-892d-c200842f9026 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:25.967017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:25.982954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:25.991490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54970b08-44ff-4333-9d68-64f03db0a35f None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:26.025351 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54e994-7d33-4ebc-9960-5d883cac6d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:26.026002 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54e994-7d33-4ebc-9960-5d883cac6d71 None admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:26.026278 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54e994-7d33-4ebc-9960-5d883cac6d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:26.026578 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54e994-7d33-4ebc-9960-5d883cac6d71 None admin] PATH_INFO: `/v3/projects/24c21f55704b49f296d13c907f680f9f/users/8859a3c7342c4f28bc59a5943ce44dd4/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:26.028475 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54e994-7d33-4ebc-9960-5d883cac6d71 None admin] RBAC: Authorizing `identity:create_grant(project_id=24c21f55704b49f296d13c907f680f9f, user_id=8859a3c7342c4f28bc59a5943ce44dd4, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:26.029903 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54e994-7d33-4ebc-9960-5d883cac6d71 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:26.053543 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644b51a-4a9f-4893-892d-c200842f9026 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:26.086709 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05cb6c-17a3-4429-909e-233d9bd794cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:26.087293 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05cb6c-17a3-4429-909e-233d9bd794cc None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:26.087568 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05cb6c-17a3-4429-909e-233d9bd794cc None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:26.087834 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05cb6c-17a3-4429-909e-233d9bd794cc None admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:26.088502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05cb6c-17a3-4429-909e-233d9bd794cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:26.088801 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05cb6c-17a3-4429-909e-233d9bd794cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:26.090204 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05cb6c-17a3-4429-909e-233d9bd794cc None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:26.097609 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 539/1082] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 23 07:57:25 2022] PUT /identity/v3/projects/24c21f55704b49f296d13c907f680f9f/users/8859a3c7342c4f28bc59a5943ce44dd4/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 07:57:26.104053 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 544/1083] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:57:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:57:26.110540 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54e994-7d33-4ebc-9960-5d883cac6d71 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:26.214619 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54e994-7d33-4ebc-9960-5d883cac6d71 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:26.254385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef25af-682e-41a8-8708-255916579bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:26.254973 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef25af-682e-41a8-8708-255916579bf5 None admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:26.255254 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef25af-682e-41a8-8708-255916579bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:26.255528 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef25af-682e-41a8-8708-255916579bf5 None admin] PATH_INFO: `/v3/projects/a80ab70ab6b9415c98017d05512c33eb/users/b5c55e5c1cea47f29d378ea457384a31/roles/0c9e286fb47049feb93649dbd95342a1` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:26.258220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef25af-682e-41a8-8708-255916579bf5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a80ab70ab6b9415c98017d05512c33eb, user_id=b5c55e5c1cea47f29d378ea457384a31, role_id=0c9e286fb47049feb93649dbd95342a1)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:26.259714 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef25af-682e-41a8-8708-255916579bf5 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:26.332358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 540/1084] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 23 07:57:26 2022] PUT /identity/v3/projects/a80ab70ab6b9415c98017d05512c33eb/users/b5c55e5c1cea47f29d378ea457384a31/roles/0c9e286fb47049feb93649dbd95342a1 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:57:27.987728 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158773a-cf72-4f14-b4d0-dbcc9470f55f None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:27.988262 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158773a-cf72-4f14-b4d0-dbcc9470f55f None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:27.988262 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158773a-cf72-4f14-b4d0-dbcc9470f55f None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:27.989599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 545/1085] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:57:27.995690 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a3de9-62b6-441d-98f8-a3eee2ea0dcb None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:27.996104 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a3de9-62b6-441d-98f8-a3eee2ea0dcb None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:27.996254 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a3de9-62b6-441d-98f8-a3eee2ea0dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:28.014443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-345a3de9-62b6-441d-98f8-a3eee2ea0dcb None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:28.015635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-345a3de9-62b6-441d-98f8-a3eee2ea0dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:28.022855 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:28.082196 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 541/1086] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:57:28.235697 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed8547-b146-4973-b3cd-a381254a6e5d None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:28.236014 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed8547-b146-4973-b3cd-a381254a6e5d None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:28.236296 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed8547-b146-4973-b3cd-a381254a6e5d None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:28.237672 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 546/1087] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:57:28.243545 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c45351-c31c-4cb2-9c12-53cfe2c92320 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:28.243775 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c45351-c31c-4cb2-9c12-53cfe2c92320 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:28.244055 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c45351-c31c-4cb2-9c12-53cfe2c92320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:28.262619 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-b3c45351-c31c-4cb2-9c12-53cfe2c92320 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:28.263809 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-b3c45351-c31c-4cb2-9c12-53cfe2c92320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:28.338451 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 542/1088] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:57:28.345915 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed8547-b146-4973-b3cd-a381254a6e5d None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:28.412975 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:28.447154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed8547-b146-4973-b3cd-a381254a6e5d None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:28.480401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b84912-a039-480b-99f9-fb86c9816a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:28.481022 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b84912-a039-480b-99f9-fb86c9816a0b None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:28.481298 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b84912-a039-480b-99f9-fb86c9816a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:28.481569 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b84912-a039-480b-99f9-fb86c9816a0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:28.491257 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b84912-a039-480b-99f9-fb86c9816a0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:57:28.496743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-e6b84912-a039-480b-99f9-fb86c9816a0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:57:28.496743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:28.496743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:28.496743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:28.496743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:28.496743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:28.496743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:28.496743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:28.496743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:28.496743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:28.496743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:28.496743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:28.496743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:57:28.496743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:57:28.496743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:57:28.496743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:57:28.497846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:57:28.497846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:57:28.497846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:57:28.497846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:57:28.497846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:28.497846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:28.497846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:28.497846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:28.497846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:28.497846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:28.497846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:28.497846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:28.497846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:28.497846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:28.497846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:28.497846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:28.499007 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:28.499007 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:28.499007 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:28.499007 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:28.499007 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:57:28.499007 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:57:28.499007 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:57:28.499007 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:57:28.499007 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:57:28.499007 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:57:28.499007 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:57:28.499007 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:28.499007 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 547/1089] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:57:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:28.503754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c45351-c31c-4cb2-9c12-53cfe2c92320 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:28.575246 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:28.604521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c45351-c31c-4cb2-9c12-53cfe2c92320 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:28.612839 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b84912-a039-480b-99f9-fb86c9816a0b None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:28.637355 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942312a-f3ad-4584-aa59-b0580ec8623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:28.637954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942312a-f3ad-4584-aa59-b0580ec8623b None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:28.638235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942312a-f3ad-4584-aa59-b0580ec8623b None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:28.638535 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942312a-f3ad-4584-aa59-b0580ec8623b None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:28.639183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942312a-f3ad-4584-aa59-b0580ec8623b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:28.639481 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942312a-f3ad-4584-aa59-b0580ec8623b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:28.640846 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942312a-f3ad-4584-aa59-b0580ec8623b None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:28.649875 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 543/1090] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:57:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:28.655649 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942312a-f3ad-4584-aa59-b0580ec8623b None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:28.715656 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b84912-a039-480b-99f9-fb86c9816a0b None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:28.741388 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:28.750118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738de1e2-069d-460a-88ff-3594e30068a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:28.750340 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738de1e2-069d-460a-88ff-3594e30068a4 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:28.750576 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738de1e2-069d-460a-88ff-3594e30068a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:28.750832 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738de1e2-069d-460a-88ff-3594e30068a4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:28.756236 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942312a-f3ad-4584-aa59-b0580ec8623b None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:28.761158 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738de1e2-069d-460a-88ff-3594e30068a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:57:28.765863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-738de1e2-069d-460a-88ff-3594e30068a4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 07:57:28.765863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:28.765863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:28.765863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:28.765863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:28.765863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:28.765863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:28.765863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:28.765863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:28.765863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:28.765863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:28.765863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:28.765863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:57:28.765863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:57:28.765863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:57:28.765863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:57:28.766837 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:57:28.766837 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:57:28.766837 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:57:28.766837 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:57:28.766837 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:28.766837 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:28.766837 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:28.766837 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:28.766837 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:28.766837 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:28.766837 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:28.766837 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:28.766837 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:28.766837 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:28.766837 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:28.766837 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:28.767690 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:28.767690 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:28.767690 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:28.767690 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:28.767690 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:57:28.767690 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:57:28.767690 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:57:28.767690 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:57:28.767690 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:57:28.767690 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:57:28.767690 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 07:57:28.767690 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:28.767690 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 548/1091] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Aug 23 07:57:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:57:28.772997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738de1e2-069d-460a-88ff-3594e30068a4 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:28.791232 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384afb6-7081-4423-94a3-43436ae20e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:28.791860 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384afb6-7081-4423-94a3-43436ae20e28 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:28.792138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384afb6-7081-4423-94a3-43436ae20e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:28.792411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384afb6-7081-4423-94a3-43436ae20e28 None admin] PATH_INFO: `/v3/users/8859a3c7342c4f28bc59a5943ce44dd4` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:28.793540 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384afb6-7081-4423-94a3-43436ae20e28 None admin] RBAC: Authorizing `identity:get_user(user_id=8859a3c7342c4f28bc59a5943ce44dd4)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:28.795021 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384afb6-7081-4423-94a3-43436ae20e28 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:28.801481 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 544/1092] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:57:28 2022] GET /identity/v3/users/8859a3c7342c4f28bc59a5943ce44dd4 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:57:28.802468 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384afb6-7081-4423-94a3-43436ae20e28 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:28.806469 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:28.878850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738de1e2-069d-460a-88ff-3594e30068a4 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:28.899559 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384afb6-7081-4423-94a3-43436ae20e28 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:28.912379 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4355ba4-bf86-4078-b135-0de4f225002d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:28.912971 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4355ba4-bf86-4078-b135-0de4f225002d None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:28.913247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4355ba4-bf86-4078-b135-0de4f225002d None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:28.913516 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4355ba4-bf86-4078-b135-0de4f225002d None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:28.914835 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4355ba4-bf86-4078-b135-0de4f225002d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:28.915134 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4355ba4-bf86-4078-b135-0de4f225002d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:28.916492 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4355ba4-bf86-4078-b135-0de4f225002d None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:28.924232 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 549/1093] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Aug 23 07:57:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:57:28.929827 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4355ba4-bf86-4078-b135-0de4f225002d None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:28.933042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c0646-077e-44f6-a6f3-c08c06854f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:28.933647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c0646-077e-44f6-a6f3-c08c06854f29 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:28.933928 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c0646-077e-44f6-a6f3-c08c06854f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:28.934201 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c0646-077e-44f6-a6f3-c08c06854f29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:28.978131 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:28.999989 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c0646-077e-44f6-a6f3-c08c06854f29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:29.001490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c0646-077e-44f6-a6f3-c08c06854f29 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:29.003297 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:29.028394 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4355ba4-bf86-4078-b135-0de4f225002d None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:29.061882 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40134a-cf13-4541-8f72-d9bcb38c3f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:29.066694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40134a-cf13-4541-8f72-d9bcb38c3f9c None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:29.066694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40134a-cf13-4541-8f72-d9bcb38c3f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:29.066694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40134a-cf13-4541-8f72-d9bcb38c3f9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:29.073226 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40134a-cf13-4541-8f72-d9bcb38c3f9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:29.074957 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40134a-cf13-4541-8f72-d9bcb38c3f9c None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:29.089986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-6d40134a-cf13-4541-8f72-d9bcb38c3f9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:57:29.089986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:29.089986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:29.089986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:29.089986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:29.089986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:29.089986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:29.089986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:29.089986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:29.089986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:29.089986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:29.089986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:29.089986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:57:29.089986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:57:29.089986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:57:29.089986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:57:29.095979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:29.095979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:29.095979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:29.095979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:29.095979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:29.095979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:29.095979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:29.095979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:29.095979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:29.095979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:29.095979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:29.095979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:29.095979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:29.095979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:29.095979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:29.095979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:29.095979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:57:29.096887 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:57:29.096887 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:57:29.096887 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:29.096887 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 550/1094] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:57:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:57:29.096887 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40134a-cf13-4541-8f72-d9bcb38c3f9c None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:29.109353 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 545/1095] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:57:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 07:57:29.110493 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c0646-077e-44f6-a6f3-c08c06854f29 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:29.198143 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40134a-cf13-4541-8f72-d9bcb38c3f9c None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:29.199931 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:29.207892 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c0646-077e-44f6-a6f3-c08c06854f29 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:29.209383 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:29.231801 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228af83-481c-4af3-8038-aff4c33059c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:29.232398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228af83-481c-4af3-8038-aff4c33059c1 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:29.232672 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228af83-481c-4af3-8038-aff4c33059c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:29.232939 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228af83-481c-4af3-8038-aff4c33059c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:29.233566 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228af83-481c-4af3-8038-aff4c33059c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:29.233863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228af83-481c-4af3-8038-aff4c33059c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:29.235247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228af83-481c-4af3-8038-aff4c33059c1 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:29.240994 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c4c29-775c-4e05-8195-3da8e7e35606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:29.241648 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c4c29-775c-4e05-8195-3da8e7e35606 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:29.242013 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c4c29-775c-4e05-8195-3da8e7e35606 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:29.242348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c4c29-775c-4e05-8195-3da8e7e35606 None admin] PATH_INFO: `/v3/projects/24c21f55704b49f296d13c907f680f9f` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:29.243467 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c4c29-775c-4e05-8195-3da8e7e35606 None admin] RBAC: Authorizing `identity:get_project(project_id=24c21f55704b49f296d13c907f680f9f)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:29.244901 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c4c29-775c-4e05-8195-3da8e7e35606 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:29.246568 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 546/1096] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:57:29 2022] GET /identity/v3/projects/24c21f55704b49f296d13c907f680f9f => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:57:29.247096 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 551/1097] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:57:29.252443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c4c29-775c-4e05-8195-3da8e7e35606 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:29.252741 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228af83-481c-4af3-8038-aff4c33059c1 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:29.351704 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c4c29-775c-4e05-8195-3da8e7e35606 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:29.353108 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228af83-481c-4af3-8038-aff4c33059c1 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:29.384429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e1539-20ea-4e24-b91c-b38bd828e7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:29.385046 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e1539-20ea-4e24-b91c-b38bd828e7dd None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:29.385323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e1539-20ea-4e24-b91c-b38bd828e7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:29.385592 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e1539-20ea-4e24-b91c-b38bd828e7dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:29.386531 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0ee37-bc80-41ba-b4d8-75b2706177c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:29.387133 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0ee37-bc80-41ba-b4d8-75b2706177c4 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:29.387531 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0ee37-bc80-41ba-b4d8-75b2706177c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:29.387804 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0ee37-bc80-41ba-b4d8-75b2706177c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:29.388562 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0ee37-bc80-41ba-b4d8-75b2706177c4 None admin] RBAC: Adding query filter params (role.id=e905040849d04aadbb8da8b0d216c92c, scope.project.id=24c21f55704b49f296d13c907f680f9f, user.id=8859a3c7342c4f28bc59a5943ce44dd4) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:29.388873 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0ee37-bc80-41ba-b4d8-75b2706177c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:29.390321 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0ee37-bc80-41ba-b4d8-75b2706177c4 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:29.392819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e1539-20ea-4e24-b91c-b38bd828e7dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:29.394248 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e1539-20ea-4e24-b91c-b38bd828e7dd None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:29.396172 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 552/1098] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:57:29 2022] GET /identity/v3/role_assignments?user.id=8859a3c7342c4f28bc59a5943ce44dd4&scope.project.id=24c21f55704b49f296d13c907f680f9f&role.id=e905040849d04aadbb8da8b0d216c92c => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:57:29.406071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-668e1539-20ea-4e24-b91c-b38bd828e7dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:57:29.406071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:29.406071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:29.406071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:29.406071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:29.406071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:29.406071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:29.406071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:29.406071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:29.406071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:29.406071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:29.406071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:29.406071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:57:29.406071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:57:29.406071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:57:29.406071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:57:29.407306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:29.407306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:29.407306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:57:29.407306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:57:29.407306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:57:29.407306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:57:29.407306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:29.407306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:29.407306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:29.407306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:29.407306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:29.407306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:29.407306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:29.407306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:29.407306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:29.407306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:29.407306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:29.407306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:29.408811 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:29.408811 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:29.408811 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:57:29.408811 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:57:29.408811 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:57:29.408811 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:57:29.408811 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:57:29.408811 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:57:29.408811 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:57:29.408811 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:29.408811 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 547/1099] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Aug 23 07:57:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:29.413374 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0ee37-bc80-41ba-b4d8-75b2706177c4 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:29.443044 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:29.522232 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0ee37-bc80-41ba-b4d8-75b2706177c4 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:29.557894 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734abc9-492d-45f1-9fe9-8567c1bdc08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:29.558600 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734abc9-492d-45f1-9fe9-8567c1bdc08c None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:29.558882 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734abc9-492d-45f1-9fe9-8567c1bdc08c None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:29.559156 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734abc9-492d-45f1-9fe9-8567c1bdc08c None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:29.559883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734abc9-492d-45f1-9fe9-8567c1bdc08c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:29.560183 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734abc9-492d-45f1-9fe9-8567c1bdc08c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:29.561601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734abc9-492d-45f1-9fe9-8567c1bdc08c None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:29.579925 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 553/1100] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Aug 23 07:57:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:29.585954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e1539-20ea-4e24-b91c-b38bd828e7dd None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:29.616267 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:29.687915 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e1539-20ea-4e24-b91c-b38bd828e7dd None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:29.720935 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4aa9d-0e1e-40db-9d43-5c48a9dd50b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:29.721540 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4aa9d-0e1e-40db-9d43-5c48a9dd50b5 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:29.721817 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4aa9d-0e1e-40db-9d43-5c48a9dd50b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:29.722087 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4aa9d-0e1e-40db-9d43-5c48a9dd50b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:29.786418 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4aa9d-0e1e-40db-9d43-5c48a9dd50b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:29.787784 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4aa9d-0e1e-40db-9d43-5c48a9dd50b5 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:29.815335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:29.883199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 548/1101] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:57:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:57:29.888920 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734abc9-492d-45f1-9fe9-8567c1bdc08c None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:29.971557 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:29.987346 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734abc9-492d-45f1-9fe9-8567c1bdc08c None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:30.021482 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedeec1-c5b6-4a31-8af8-9f83e48ba00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:30.022105 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedeec1-c5b6-4a31-8af8-9f83e48ba00f None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:30.022413 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedeec1-c5b6-4a31-8af8-9f83e48ba00f None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:30.022688 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedeec1-c5b6-4a31-8af8-9f83e48ba00f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:30.032684 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedeec1-c5b6-4a31-8af8-9f83e48ba00f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:30.034118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedeec1-c5b6-4a31-8af8-9f83e48ba00f None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:30.048746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-5aedeec1-c5b6-4a31-8af8-9f83e48ba00f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:57:30.048746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:30.048746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:30.048746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:30.048746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:30.048746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:30.048746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:30.048746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:30.048746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:30.048746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:30.048746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:30.048746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:30.048746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:57:30.048746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:57:30.048746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:57:30.048746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:57:30.049899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:30.049899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:30.049899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:30.049899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:30.049899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:30.049899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:30.049899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:30.049899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:30.049899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:30.049899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:30.049899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:30.049899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:30.049899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:30.049899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:30.049899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:30.049899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:30.049899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:57:30.051555 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:57:30.051555 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:57:30.051555 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:30.055040 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 554/1102] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:57:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:30.056042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4aa9d-0e1e-40db-9d43-5c48a9dd50b5 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:30.152567 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4aa9d-0e1e-40db-9d43-5c48a9dd50b5 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:30.179207 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:30.185402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905f477-1d62-4afe-b757-6ffd21b936d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:30.188250 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905f477-1d62-4afe-b757-6ffd21b936d9 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:30.188250 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905f477-1d62-4afe-b757-6ffd21b936d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:30.188250 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905f477-1d62-4afe-b757-6ffd21b936d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:30.188250 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905f477-1d62-4afe-b757-6ffd21b936d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:30.188250 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905f477-1d62-4afe-b757-6ffd21b936d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:30.188889 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905f477-1d62-4afe-b757-6ffd21b936d9 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:30.200597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 549/1103] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:57:30.206313 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedeec1-c5b6-4a31-8af8-9f83e48ba00f None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:30.302590 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedeec1-c5b6-4a31-8af8-9f83e48ba00f None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:30.336455 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb010ba3-f906-4f51-9107-abaa20af9258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:30.337079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb010ba3-f906-4f51-9107-abaa20af9258 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:30.337362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb010ba3-f906-4f51-9107-abaa20af9258 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:30.337635 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb010ba3-f906-4f51-9107-abaa20af9258 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:30.340356 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:30.344762 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb010ba3-f906-4f51-9107-abaa20af9258 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:30.346215 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb010ba3-f906-4f51-9107-abaa20af9258 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:30.359087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-cb010ba3-f906-4f51-9107-abaa20af9258 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:57:30.359087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:30.359087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:30.359087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:30.359087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:30.359087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:30.359087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:30.359087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:30.359087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:30.359087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:30.359087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:30.359087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:30.359087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:57:30.359087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:57:30.359087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:57:30.371002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:57:30.371002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:30.371002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:30.371002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:30.371002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:30.371002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:30.371002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:30.371002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:30.371002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:30.371002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:30.371002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:30.371002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:30.371002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:30.371002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:30.371002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:30.371002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:30.371002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:30.372107 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:57:30.372107 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:57:30.372107 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:57:30.372107 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:57:30.372107 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:57:30.372107 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:57:30.372107 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:57:30.372107 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:30.372107 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 555/1104] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:57:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:57:30.372699 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905f477-1d62-4afe-b757-6ffd21b936d9 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:30.465653 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905f477-1d62-4afe-b757-6ffd21b936d9 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:30.499069 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647e72b-075b-4ecd-abaa-46a6ce118e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:30.502953 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647e72b-075b-4ecd-abaa-46a6ce118e6c None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:30.502953 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647e72b-075b-4ecd-abaa-46a6ce118e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:30.502953 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647e72b-075b-4ecd-abaa-46a6ce118e6c None admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:30.502953 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647e72b-075b-4ecd-abaa-46a6ce118e6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:30.502953 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647e72b-075b-4ecd-abaa-46a6ce118e6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:30.502953 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647e72b-075b-4ecd-abaa-46a6ce118e6c None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:30.515068 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 550/1105] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:57:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:30.521706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb010ba3-f906-4f51-9107-abaa20af9258 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:30.620559 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb010ba3-f906-4f51-9107-abaa20af9258 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:30.653490 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388aee7-fa2f-48f1-b307-d9bf01c0c6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:30.654093 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388aee7-fa2f-48f1-b307-d9bf01c0c6d8 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:30.654407 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388aee7-fa2f-48f1-b307-d9bf01c0c6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:30.654682 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388aee7-fa2f-48f1-b307-d9bf01c0c6d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:30.655400 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388aee7-fa2f-48f1-b307-d9bf01c0c6d8 None admin] RBAC: Adding query filter params (role.id=0c9e286fb47049feb93649dbd95342a1, scope.project.id=a80ab70ab6b9415c98017d05512c33eb, user.id=b5c55e5c1cea47f29d378ea457384a31) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:30.655705 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388aee7-fa2f-48f1-b307-d9bf01c0c6d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:30.657160 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388aee7-fa2f-48f1-b307-d9bf01c0c6d8 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:30.665922 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 556/1106] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:57:30 2022] GET /identity/v3/role_assignments?user.id=b5c55e5c1cea47f29d378ea457384a31&scope.project.id=a80ab70ab6b9415c98017d05512c33eb&role.id=0c9e286fb47049feb93649dbd95342a1 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:31.348412 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86582e4e-288f-4959-ad3d-0d5e0b60b91e None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:31.348932 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86582e4e-288f-4959-ad3d-0d5e0b60b91e None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:31.348932 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86582e4e-288f-4959-ad3d-0d5e0b60b91e None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:31.350310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 551/1107] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:57:31.356009 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d1e39-d9e5-44ea-965c-c845b45e4ef8 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:31.356445 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d1e39-d9e5-44ea-965c-c845b45e4ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:31.356686 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d1e39-d9e5-44ea-965c-c845b45e4ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:31.376048 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-421d1e39-d9e5-44ea-965c-c845b45e4ef8 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:31.377346 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-421d1e39-d9e5-44ea-965c-c845b45e4ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:31.433185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:31.444175 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 557/1108] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:57:31.715201 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86582e4e-288f-4959-ad3d-0d5e0b60b91e None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:31.764768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:31.814235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86582e4e-288f-4959-ad3d-0d5e0b60b91e None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:31.846493 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e56b79-5261-4af2-9451-9d6607962707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:31.847097 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e56b79-5261-4af2-9451-9d6607962707 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:31.847373 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e56b79-5261-4af2-9451-9d6607962707 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:31.847639 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e56b79-5261-4af2-9451-9d6607962707 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:31.848719 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e56b79-5261-4af2-9451-9d6607962707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:31.850169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e56b79-5261-4af2-9451-9d6607962707 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:31.851762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 552/1109] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:57:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:31.857455 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d1e39-d9e5-44ea-965c-c845b45e4ef8 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:31.954517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d1e39-d9e5-44ea-965c-c845b45e4ef8 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:31.986484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f423342-d082-4475-bcb3-108da2eed6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:31.987076 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f423342-d082-4475-bcb3-108da2eed6d1 None admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:31.987355 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f423342-d082-4475-bcb3-108da2eed6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:31.987626 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f423342-d082-4475-bcb3-108da2eed6d1 None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:31.988265 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f423342-d082-4475-bcb3-108da2eed6d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:31.989685 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f423342-d082-4475-bcb3-108da2eed6d1 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:32.091272 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 558/1110] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 23 07:57:31 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:57:34.002144 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c14a20-0604-4d3d-b648-4205b3e41471 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:34.002736 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c14a20-0604-4d3d-b648-4205b3e41471 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:34.002736 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c14a20-0604-4d3d-b648-4205b3e41471 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:34.004054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 553/1111] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:57:34.009430 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01d461-6230-4230-b800-03d614a57bae None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:34.009848 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01d461-6230-4230-b800-03d614a57bae None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:34.009984 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01d461-6230-4230-b800-03d614a57bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:34.027505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-6a01d461-6230-4230-b800-03d614a57bae None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:34.028695 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-6a01d461-6230-4230-b800-03d614a57bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:34.069767 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:34.093885 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 559/1112] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:57:34.363681 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c14a20-0604-4d3d-b648-4205b3e41471 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:34.477508 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c14a20-0604-4d3d-b648-4205b3e41471 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:34.494832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:34.512163 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e01c19-ee87-461c-b896-cd3791b8e7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:34.512792 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e01c19-ee87-461c-b896-cd3791b8e7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:34.513070 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e01c19-ee87-461c-b896-cd3791b8e7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:34.513341 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e01c19-ee87-461c-b896-cd3791b8e7a9 None admin] PATH_INFO: `/v3/roles/4e9a14889d764731b59323f764f1bb85` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:34.514724 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e01c19-ee87-461c-b896-cd3791b8e7a9 None admin] RBAC: Authorizing `identity:get_role(role_id=4e9a14889d764731b59323f764f1bb85)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:34.516105 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e01c19-ee87-461c-b896-cd3791b8e7a9 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:34.517469 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 554/1113] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:57:34 2022] GET /identity/v3/roles/4e9a14889d764731b59323f764f1bb85 => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:34.524157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01d461-6230-4230-b800-03d614a57bae None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:34.619711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01d461-6230-4230-b800-03d614a57bae None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:34.653524 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d871dd4-02b4-4bf7-9624-130c17de580b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:34.654153 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d871dd4-02b4-4bf7-9624-130c17de580b None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:34.654487 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d871dd4-02b4-4bf7-9624-130c17de580b None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:34.654763 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d871dd4-02b4-4bf7-9624-130c17de580b None admin] PATH_INFO: `/v3/users/628c9f49d88b4f21b63c59c502206640` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:34.668112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d871dd4-02b4-4bf7-9624-130c17de580b None admin] RBAC: Authorizing `identity:get_user(user_id=628c9f49d88b4f21b63c59c502206640)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:34.669551 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d871dd4-02b4-4bf7-9624-130c17de580b None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:34.671251 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 560/1114] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:57:34 2022] GET /identity/v3/users/628c9f49d88b4f21b63c59c502206640 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:34.677130 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e01c19-ee87-461c-b896-cd3791b8e7a9 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:34.774522 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e01c19-ee87-461c-b896-cd3791b8e7a9 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:34.806581 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a84bff-3d17-4ce5-9994-fdfd7f5fd615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:34.807176 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a84bff-3d17-4ce5-9994-fdfd7f5fd615 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:34.807456 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a84bff-3d17-4ce5-9994-fdfd7f5fd615 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:34.807725 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a84bff-3d17-4ce5-9994-fdfd7f5fd615 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:34.858610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:34.871490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a84bff-3d17-4ce5-9994-fdfd7f5fd615 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:34.872858 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a84bff-3d17-4ce5-9994-fdfd7f5fd615 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:34.966444 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 555/1115] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:57:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:57:34.972534 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d871dd4-02b4-4bf7-9624-130c17de580b None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:35.005322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:35.076015 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d871dd4-02b4-4bf7-9624-130c17de580b None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:35.108020 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4838c6f-c731-4e2b-a774-0b86e47dddcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:35.108632 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4838c6f-c731-4e2b-a774-0b86e47dddcb None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:35.108908 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4838c6f-c731-4e2b-a774-0b86e47dddcb None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:35.109178 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4838c6f-c731-4e2b-a774-0b86e47dddcb None admin] PATH_INFO: `/v3/projects/24c21f55704b49f296d13c907f680f9f` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:35.110264 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4838c6f-c731-4e2b-a774-0b86e47dddcb None admin] RBAC: Authorizing `identity:get_project(project_id=24c21f55704b49f296d13c907f680f9f)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:35.111713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4838c6f-c731-4e2b-a774-0b86e47dddcb None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:35.113321 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 561/1116] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:57:34 2022] GET /identity/v3/projects/24c21f55704b49f296d13c907f680f9f => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:35.120118 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a84bff-3d17-4ce5-9994-fdfd7f5fd615 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:35.201548 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:35.215459 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a84bff-3d17-4ce5-9994-fdfd7f5fd615 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:35.248727 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed8f42-015b-4bc6-b849-854d6c746118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:35.249317 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed8f42-015b-4bc6-b849-854d6c746118 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:35.249595 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed8f42-015b-4bc6-b849-854d6c746118 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:35.249866 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed8f42-015b-4bc6-b849-854d6c746118 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:35.250598 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed8f42-015b-4bc6-b849-854d6c746118 None admin] RBAC: Adding query filter params (role.id=4e9a14889d764731b59323f764f1bb85, scope.project.id=24c21f55704b49f296d13c907f680f9f, user.id=628c9f49d88b4f21b63c59c502206640) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:35.250902 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed8f42-015b-4bc6-b849-854d6c746118 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:35.252321 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed8f42-015b-4bc6-b849-854d6c746118 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:35.257485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 556/1117] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:57:35 2022] GET /identity/v3/role_assignments?user.id=628c9f49d88b4f21b63c59c502206640&scope.project.id=24c21f55704b49f296d13c907f680f9f&role.id=4e9a14889d764731b59323f764f1bb85 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:37.128843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096725f-8e3d-4c2d-8e85-07445c624b52 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:37.129439 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096725f-8e3d-4c2d-8e85-07445c624b52 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:37.129439 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096725f-8e3d-4c2d-8e85-07445c624b52 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:37.130751 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 562/1118] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:57:37.136853 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202d8aa-04f5-46ad-89ca-8cc6b7484780 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:37.137309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202d8aa-04f5-46ad-89ca-8cc6b7484780 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:37.137414 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202d8aa-04f5-46ad-89ca-8cc6b7484780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:37.155175 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-8202d8aa-04f5-46ad-89ca-8cc6b7484780 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:37.156343 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-8202d8aa-04f5-46ad-89ca-8cc6b7484780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:37.220616 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 557/1119] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:57:37.492183 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096725f-8e3d-4c2d-8e85-07445c624b52 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:37.591259 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096725f-8e3d-4c2d-8e85-07445c624b52 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:37.592785 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:37.623455 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdc915-8d51-49d8-9469-9f99589e3464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:37.624066 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdc915-8d51-49d8-9469-9f99589e3464 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:37.624346 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdc915-8d51-49d8-9469-9f99589e3464 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:37.624614 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdc915-8d51-49d8-9469-9f99589e3464 None admin] PATH_INFO: `/v3/roles/4e9a14889d764731b59323f764f1bb85` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:37.625981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bdc915-8d51-49d8-9469-9f99589e3464 None admin] RBAC: Authorizing `identity:get_role(role_id=4e9a14889d764731b59323f764f1bb85)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:37.627383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bdc915-8d51-49d8-9469-9f99589e3464 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:37.628688 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 563/1120] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:57:37 2022] GET /identity/v3/roles/4e9a14889d764731b59323f764f1bb85 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:37.635277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202d8aa-04f5-46ad-89ca-8cc6b7484780 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:37.714026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:37.732003 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202d8aa-04f5-46ad-89ca-8cc6b7484780 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:37.764467 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776ec7c-a149-46c6-8ee9-a775dd59646c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:37.765025 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776ec7c-a149-46c6-8ee9-a775dd59646c None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:37.765303 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776ec7c-a149-46c6-8ee9-a775dd59646c None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:37.765575 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776ec7c-a149-46c6-8ee9-a775dd59646c None admin] PATH_INFO: `/v3/users/628c9f49d88b4f21b63c59c502206640` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:37.766704 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776ec7c-a149-46c6-8ee9-a775dd59646c None admin] RBAC: Authorizing `identity:get_user(user_id=628c9f49d88b4f21b63c59c502206640)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:37.768145 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776ec7c-a149-46c6-8ee9-a775dd59646c None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:37.770011 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 558/1121] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:57:37 2022] GET /identity/v3/users/628c9f49d88b4f21b63c59c502206640 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:37.776207 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdc915-8d51-49d8-9469-9f99589e3464 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:37.871972 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdc915-8d51-49d8-9469-9f99589e3464 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:37.904726 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513a9e3-c6cc-4e2f-898f-1bcff2aca05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:37.905338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513a9e3-c6cc-4e2f-898f-1bcff2aca05f None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:37.905616 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513a9e3-c6cc-4e2f-898f-1bcff2aca05f None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:37.905886 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513a9e3-c6cc-4e2f-898f-1bcff2aca05f None admin] PATH_INFO: `/v3/projects/24c21f55704b49f296d13c907f680f9f` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:37.906997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513a9e3-c6cc-4e2f-898f-1bcff2aca05f None admin] RBAC: Authorizing `identity:get_project(project_id=24c21f55704b49f296d13c907f680f9f)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:37.908424 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513a9e3-c6cc-4e2f-898f-1bcff2aca05f None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:37.910010 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 564/1122] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:57:37 2022] GET /identity/v3/projects/24c21f55704b49f296d13c907f680f9f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:37.916103 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776ec7c-a149-46c6-8ee9-a775dd59646c None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:38.013811 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776ec7c-a149-46c6-8ee9-a775dd59646c None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:38.046114 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217ec70-6510-471e-9b94-4c9c6a68785e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:38.046730 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217ec70-6510-471e-9b94-4c9c6a68785e None admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:38.047013 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217ec70-6510-471e-9b94-4c9c6a68785e None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:38.047286 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217ec70-6510-471e-9b94-4c9c6a68785e None admin] PATH_INFO: `/v3/projects/24c21f55704b49f296d13c907f680f9f/users/628c9f49d88b4f21b63c59c502206640/roles/4e9a14889d764731b59323f764f1bb85` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:38.049400 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217ec70-6510-471e-9b94-4c9c6a68785e None admin] RBAC: Authorizing `identity:create_grant(project_id=24c21f55704b49f296d13c907f680f9f, user_id=628c9f49d88b4f21b63c59c502206640, role_id=4e9a14889d764731b59323f764f1bb85)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:38.050861 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217ec70-6510-471e-9b94-4c9c6a68785e None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:38.123530 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 559/1123] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 23 07:57:37 2022] PUT /identity/v3/projects/24c21f55704b49f296d13c907f680f9f/users/628c9f49d88b4f21b63c59c502206640/roles/4e9a14889d764731b59323f764f1bb85 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:57:40.003728 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202bf92-773c-4174-90c4-3482246278f0 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:40.004276 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202bf92-773c-4174-90c4-3482246278f0 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:40.004276 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202bf92-773c-4174-90c4-3482246278f0 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:40.005595 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 565/1124] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:57:40.011245 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77229e2a-d027-4b17-aad8-bdec11d856f7 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:40.011630 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77229e2a-d027-4b17-aad8-bdec11d856f7 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:40.011797 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77229e2a-d027-4b17-aad8-bdec11d856f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:40.029975 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-77229e2a-d027-4b17-aad8-bdec11d856f7 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:40.031186 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-77229e2a-d027-4b17-aad8-bdec11d856f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:40.033088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:40.096188 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 560/1125] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:57:40.367617 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202bf92-773c-4174-90c4-3482246278f0 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:40.408195 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:40.467288 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202bf92-773c-4174-90c4-3482246278f0 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:40.500843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7aba41-a4bd-4200-a89c-de9ef5b7da7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:40.501463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aba41-a4bd-4200-a89c-de9ef5b7da7b None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:40.501744 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aba41-a4bd-4200-a89c-de9ef5b7da7b None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:40.502017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aba41-a4bd-4200-a89c-de9ef5b7da7b None admin] PATH_INFO: `/v3/roles/4e9a14889d764731b59323f764f1bb85` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:40.503420 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7aba41-a4bd-4200-a89c-de9ef5b7da7b None admin] RBAC: Authorizing `identity:get_role(role_id=4e9a14889d764731b59323f764f1bb85)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:40.504793 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7aba41-a4bd-4200-a89c-de9ef5b7da7b None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:40.506108 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 566/1126] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:57:40 2022] GET /identity/v3/roles/4e9a14889d764731b59323f764f1bb85 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:40.512018 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77229e2a-d027-4b17-aad8-bdec11d856f7 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:40.606347 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77229e2a-d027-4b17-aad8-bdec11d856f7 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:40.646582 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb65ec9-88bb-4f56-95f2-8d8a00dbc9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:40.647147 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb65ec9-88bb-4f56-95f2-8d8a00dbc9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:40.647429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb65ec9-88bb-4f56-95f2-8d8a00dbc9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:40.647811 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb65ec9-88bb-4f56-95f2-8d8a00dbc9b6 None admin] PATH_INFO: `/v3/users/628c9f49d88b4f21b63c59c502206640` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:40.649331 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb65ec9-88bb-4f56-95f2-8d8a00dbc9b6 None admin] RBAC: Authorizing `identity:get_user(user_id=628c9f49d88b4f21b63c59c502206640)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:40.650406 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb65ec9-88bb-4f56-95f2-8d8a00dbc9b6 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:40.652012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 561/1127] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:57:40 2022] GET /identity/v3/users/628c9f49d88b4f21b63c59c502206640 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:40.657776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7aba41-a4bd-4200-a89c-de9ef5b7da7b None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:40.754625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7aba41-a4bd-4200-a89c-de9ef5b7da7b None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:40.761800 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:40.787087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf47f8-2b99-4fc6-a46d-b6fd05097eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:40.787689 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf47f8-2b99-4fc6-a46d-b6fd05097eaa None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:40.787970 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf47f8-2b99-4fc6-a46d-b6fd05097eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:40.788796 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf47f8-2b99-4fc6-a46d-b6fd05097eaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:40.854587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf47f8-2b99-4fc6-a46d-b6fd05097eaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:40.856033 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf47f8-2b99-4fc6-a46d-b6fd05097eaa None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:40.951009 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 567/1128] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:57:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:57:40.957103 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb65ec9-88bb-4f56-95f2-8d8a00dbc9b6 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:40.969476 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:41.059780 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb65ec9-88bb-4f56-95f2-8d8a00dbc9b6 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:41.092135 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da0d8fb-820d-4de2-b5bf-fb7c3ed4b539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:41.092760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0d8fb-820d-4de2-b5bf-fb7c3ed4b539 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:41.093044 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0d8fb-820d-4de2-b5bf-fb7c3ed4b539 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:41.093319 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da0d8fb-820d-4de2-b5bf-fb7c3ed4b539 None admin] PATH_INFO: `/v3/projects/24c21f55704b49f296d13c907f680f9f` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:41.094450 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da0d8fb-820d-4de2-b5bf-fb7c3ed4b539 None admin] RBAC: Authorizing `identity:get_project(project_id=24c21f55704b49f296d13c907f680f9f)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:41.095893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da0d8fb-820d-4de2-b5bf-fb7c3ed4b539 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:41.097522 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 562/1129] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:57:40 2022] GET /identity/v3/projects/24c21f55704b49f296d13c907f680f9f => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:41.104651 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf47f8-2b99-4fc6-a46d-b6fd05097eaa None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:41.112498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:41.199340 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf47f8-2b99-4fc6-a46d-b6fd05097eaa None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:41.231548 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5acf3-93aa-4750-a76c-8f8411cd2d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:41.232077 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5acf3-93aa-4750-a76c-8f8411cd2d98 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:41.232353 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5acf3-93aa-4750-a76c-8f8411cd2d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:41.232622 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5acf3-93aa-4750-a76c-8f8411cd2d98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:41.233329 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5acf3-93aa-4750-a76c-8f8411cd2d98 None admin] RBAC: Adding query filter params (role.id=4e9a14889d764731b59323f764f1bb85, scope.project.id=24c21f55704b49f296d13c907f680f9f, user.id=628c9f49d88b4f21b63c59c502206640) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:41.233637 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5acf3-93aa-4750-a76c-8f8411cd2d98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:41.235070 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5acf3-93aa-4750-a76c-8f8411cd2d98 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:41.240532 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 568/1130] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:57:41 2022] GET /identity/v3/role_assignments?user.id=628c9f49d88b4f21b63c59c502206640&scope.project.id=24c21f55704b49f296d13c907f680f9f&role.id=4e9a14889d764731b59323f764f1bb85 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:43.146032 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c4824-c841-4713-877a-9ed36ea5a1f4 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:43.146602 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c4824-c841-4713-877a-9ed36ea5a1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:43.146602 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c4824-c841-4713-877a-9ed36ea5a1f4 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:43.148696 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 563/1131] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:57:43.153878 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86dd6d-a464-412f-854e-5b7000ee0ee2 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:43.154331 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86dd6d-a464-412f-854e-5b7000ee0ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:43.154483 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86dd6d-a464-412f-854e-5b7000ee0ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:43.172619 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-7a86dd6d-a464-412f-854e-5b7000ee0ee2 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:43.173802 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-7a86dd6d-a464-412f-854e-5b7000ee0ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:43.234555 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:43.239030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 569/1132] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:57:43.509410 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c4824-c841-4713-877a-9ed36ea5a1f4 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:43.583625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:43.608292 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c4824-c841-4713-877a-9ed36ea5a1f4 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:43.640603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1570f-b76d-4f2d-ade0-4874be12ecf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:43.641213 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1570f-b76d-4f2d-ade0-4874be12ecf4 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:43.641491 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1570f-b76d-4f2d-ade0-4874be12ecf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:43.641764 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1570f-b76d-4f2d-ade0-4874be12ecf4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:43.642859 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1570f-b76d-4f2d-ade0-4874be12ecf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:43.644305 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1570f-b76d-4f2d-ade0-4874be12ecf4 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:43.645900 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 564/1133] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:57:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:43.652005 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86dd6d-a464-412f-854e-5b7000ee0ee2 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:43.747996 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86dd6d-a464-412f-854e-5b7000ee0ee2 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:43.780249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b4c82-7484-45a5-b835-33cb362a92f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:43.780792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b4c82-7484-45a5-b835-33cb362a92f7 None admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:43.781076 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b4c82-7484-45a5-b835-33cb362a92f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:43.781352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b4c82-7484-45a5-b835-33cb362a92f7 None admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:43.781986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b4c82-7484-45a5-b835-33cb362a92f7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:43.783461 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b4c82-7484-45a5-b835-33cb362a92f7 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:43.941889 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 570/1134] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 23 07:57:43 2022] POST /identity/v3/projects => generated 311 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:57:45.871347 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbd5af-e973-49ac-a1fd-70ab051da647 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:45.871922 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbd5af-e973-49ac-a1fd-70ab051da647 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:45.871922 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbd5af-e973-49ac-a1fd-70ab051da647 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:45.873240 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 565/1135] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:57:45.878703 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d1401-1971-4da9-9d9f-8ce65027d9bc None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:45.879112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d1401-1971-4da9-9d9f-8ce65027d9bc None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:45.879265 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d1401-1971-4da9-9d9f-8ce65027d9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:45.897927 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-bc1d1401-1971-4da9-9d9f-8ce65027d9bc None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:45.899196 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-bc1d1401-1971-4da9-9d9f-8ce65027d9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:45.943626 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:45.964374 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 571/1136] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:57:46.234316 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbd5af-e973-49ac-a1fd-70ab051da647 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:46.330928 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbd5af-e973-49ac-a1fd-70ab051da647 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:46.362828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b832d1-afb7-4037-b25e-b967a67130bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:46.363429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b832d1-afb7-4037-b25e-b967a67130bf None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:46.363702 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b832d1-afb7-4037-b25e-b967a67130bf None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:46.363969 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b832d1-afb7-4037-b25e-b967a67130bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:46.365050 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b832d1-afb7-4037-b25e-b967a67130bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:46.367177 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b832d1-afb7-4037-b25e-b967a67130bf None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:46.368723 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 566/1137] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:57:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:46.374777 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d1401-1971-4da9-9d9f-8ce65027d9bc None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:46.471035 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d1401-1971-4da9-9d9f-8ce65027d9bc None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:46.505539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a55c66-0e5f-4bcf-9a05-862161ed173a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:46.505539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a55c66-0e5f-4bcf-9a05-862161ed173a None admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:46.505759 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a55c66-0e5f-4bcf-9a05-862161ed173a None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:46.506030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a55c66-0e5f-4bcf-9a05-862161ed173a None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:46.506718 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a55c66-0e5f-4bcf-9a05-862161ed173a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:46.508149 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a55c66-0e5f-4bcf-9a05-862161ed173a None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:46.605621 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 572/1138] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 23 07:57:46 2022] POST /identity/v3/users => generated 286 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:57:48.558917 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7543ec3-2f5b-47a3-bb48-a95a45042e55 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:48.559561 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7543ec3-2f5b-47a3-bb48-a95a45042e55 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:48.559561 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7543ec3-2f5b-47a3-bb48-a95a45042e55 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:48.560788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 567/1139] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:57:48.566115 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59f61e-a848-42f3-bb5b-7274e8feb679 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:48.566582 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59f61e-a848-42f3-bb5b-7274e8feb679 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:48.566684 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59f61e-a848-42f3-bb5b-7274e8feb679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:48.584952 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-8b59f61e-a848-42f3-bb5b-7274e8feb679 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:48.586120 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-8b59f61e-a848-42f3-bb5b-7274e8feb679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:48.613919 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:48.651454 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 573/1140] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:57:48.921363 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7543ec3-2f5b-47a3-bb48-a95a45042e55 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:48.933915 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:49.019114 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7543ec3-2f5b-47a3-bb48-a95a45042e55 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:49.051839 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70d561-a440-4f64-8167-58027cc0d01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:49.052452 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70d561-a440-4f64-8167-58027cc0d01b None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:49.052731 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70d561-a440-4f64-8167-58027cc0d01b None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:49.053002 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70d561-a440-4f64-8167-58027cc0d01b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:49.063336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e70d561-a440-4f64-8167-58027cc0d01b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:57:49.067960 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-1e70d561-a440-4f64-8167-58027cc0d01b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:57:49.067960 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:49.067960 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:49.067960 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:49.067960 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:49.067960 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:49.067960 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:49.067960 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:49.067960 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:49.067960 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:49.067960 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:49.067960 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:49.067960 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:57:49.067960 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:57:49.067960 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:57:49.067960 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:57:49.069221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:57:49.069221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:57:49.069221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:57:49.069221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:57:49.069221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:49.069221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:49.069221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:49.069221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:49.069221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:49.069221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:49.069221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:49.069221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:49.069221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:49.069221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:49.069221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:49.069221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:49.070334 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:49.070334 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:49.070334 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:49.070334 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:49.070334 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:57:49.070334 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:57:49.070334 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:57:49.070334 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:57:49.070334 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:57:49.070334 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:57:49.070334 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:57:49.070334 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:49.070334 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 568/1141] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:57:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:49.075378 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59f61e-a848-42f3-bb5b-7274e8feb679 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:49.170626 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59f61e-a848-42f3-bb5b-7274e8feb679 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:49.202572 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c56226-0d72-4a13-9a4f-e0342e75e990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:49.203159 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c56226-0d72-4a13-9a4f-e0342e75e990 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:49.203434 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c56226-0d72-4a13-9a4f-e0342e75e990 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:49.203701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c56226-0d72-4a13-9a4f-e0342e75e990 None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:49.204352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c56226-0d72-4a13-9a4f-e0342e75e990 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:49.204650 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c56226-0d72-4a13-9a4f-e0342e75e990 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:49.206008 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c56226-0d72-4a13-9a4f-e0342e75e990 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:49.214221 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 574/1142] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:57:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:49.219912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70d561-a440-4f64-8167-58027cc0d01b None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:49.286021 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:49.315046 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70d561-a440-4f64-8167-58027cc0d01b None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:49.347759 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975243e-885e-4e4b-b610-bbac4a029eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:49.348377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975243e-885e-4e4b-b610-bbac4a029eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:49.348659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975243e-885e-4e4b-b610-bbac4a029eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:49.348934 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975243e-885e-4e4b-b610-bbac4a029eb5 None admin] PATH_INFO: `/v3/users/b81ff72f9b9f4117b11a9075a53ed0fe` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:49.362053 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975243e-885e-4e4b-b610-bbac4a029eb5 None admin] RBAC: Authorizing `identity:get_user(user_id=b81ff72f9b9f4117b11a9075a53ed0fe)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:49.363633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975243e-885e-4e4b-b610-bbac4a029eb5 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:49.365208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 569/1143] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:57:49 2022] GET /identity/v3/users/b81ff72f9b9f4117b11a9075a53ed0fe => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:49.371738 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c56226-0d72-4a13-9a4f-e0342e75e990 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:49.401700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:49.468010 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c56226-0d72-4a13-9a4f-e0342e75e990 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:49.500782 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af2541-3679-4554-8b36-862d5b3d47db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:49.501368 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af2541-3679-4554-8b36-862d5b3d47db None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:49.501643 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af2541-3679-4554-8b36-862d5b3d47db None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:49.501909 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af2541-3679-4554-8b36-862d5b3d47db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:49.565697 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af2541-3679-4554-8b36-862d5b3d47db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:49.567159 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af2541-3679-4554-8b36-862d5b3d47db None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:49.594703 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:49.660768 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 575/1144] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:57:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:57:49.667242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975243e-885e-4e4b-b610-bbac4a029eb5 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:49.763983 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975243e-885e-4e4b-b610-bbac4a029eb5 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:49.789308 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:49.796667 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48817d0a-1396-4844-9749-6cbd19c810cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:49.801957 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48817d0a-1396-4844-9749-6cbd19c810cd None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:49.801957 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48817d0a-1396-4844-9749-6cbd19c810cd None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:49.801957 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48817d0a-1396-4844-9749-6cbd19c810cd None admin] PATH_INFO: `/v3/projects/5e91061241124bdf9684443392fa998d` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:49.801957 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48817d0a-1396-4844-9749-6cbd19c810cd None admin] RBAC: Authorizing `identity:get_project(project_id=5e91061241124bdf9684443392fa998d)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:49.801957 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48817d0a-1396-4844-9749-6cbd19c810cd None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:49.802401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 570/1145] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:57:49 2022] GET /identity/v3/projects/5e91061241124bdf9684443392fa998d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:49.809005 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af2541-3679-4554-8b36-862d5b3d47db None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:49.905449 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af2541-3679-4554-8b36-862d5b3d47db None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:49.933250 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:49.938753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ac85c-3d15-4878-b8d1-a19dfc8da33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:49.939337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ac85c-3d15-4878-b8d1-a19dfc8da33b None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:49.939615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ac85c-3d15-4878-b8d1-a19dfc8da33b None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:49.939882 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ac85c-3d15-4878-b8d1-a19dfc8da33b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:49.940591 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ac85c-3d15-4878-b8d1-a19dfc8da33b None admin] RBAC: Adding query filter params (role.id=e905040849d04aadbb8da8b0d216c92c, scope.project.id=5e91061241124bdf9684443392fa998d, user.id=b81ff72f9b9f4117b11a9075a53ed0fe) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:49.940894 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ac85c-3d15-4878-b8d1-a19dfc8da33b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:49.942353 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ac85c-3d15-4878-b8d1-a19dfc8da33b None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:49.948027 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 576/1146] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:57:49 2022] GET /identity/v3/role_assignments?user.id=b81ff72f9b9f4117b11a9075a53ed0fe&scope.project.id=5e91061241124bdf9684443392fa998d&role.id=e905040849d04aadbb8da8b0d216c92c => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:51.837273 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd6f33-3b24-4a2b-9f75-dd5811c6f223 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:51.837790 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd6f33-3b24-4a2b-9f75-dd5811c6f223 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:51.837790 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd6f33-3b24-4a2b-9f75-dd5811c6f223 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:51.839170 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 571/1147] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:57:51.844195 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196e85b-8be9-4c1b-9b56-1ebc9b160a76 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:51.844567 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196e85b-8be9-4c1b-9b56-1ebc9b160a76 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:51.844748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196e85b-8be9-4c1b-9b56-1ebc9b160a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:51.862408 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-2196e85b-8be9-4c1b-9b56-1ebc9b160a76 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:51.863598 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-2196e85b-8be9-4c1b-9b56-1ebc9b160a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:51.928040 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 577/1148] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:57:52.206339 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd6f33-3b24-4a2b-9f75-dd5811c6f223 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:52.304853 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd6f33-3b24-4a2b-9f75-dd5811c6f223 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:52.337659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5992268-9bd4-4e3a-a435-9b6dfe1d5f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:52.338265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5992268-9bd4-4e3a-a435-9b6dfe1d5f93 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:52.338635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5992268-9bd4-4e3a-a435-9b6dfe1d5f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:52.338905 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5992268-9bd4-4e3a-a435-9b6dfe1d5f93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:52.348621 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5992268-9bd4-4e3a-a435-9b6dfe1d5f93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:57:52.353299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-a5992268-9bd4-4e3a-a435-9b6dfe1d5f93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:57:52.353299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:52.353299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:52.353299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:52.353299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:52.353299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:52.353299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:52.353299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:52.353299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:52.353299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:52.353299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:52.353299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:52.353299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:57:52.353299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:57:52.353299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:57:52.353299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:57:52.354402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:57:52.354402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:57:52.354402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:57:52.354402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:57:52.354402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:52.354402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:52.354402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:52.354402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:52.354402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:52.354402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:52.354402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:52.354402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:52.354402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:52.354402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:52.354402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:52.354402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:52.355591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:52.355591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:52.355591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:52.355591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:52.355591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:57:52.355591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:57:52.355591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:57:52.355591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:57:52.355591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:57:52.355591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:57:52.355591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:57:52.355591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:52.355591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 572/1149] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:57:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:52.360336 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196e85b-8be9-4c1b-9b56-1ebc9b160a76 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:52.465792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196e85b-8be9-4c1b-9b56-1ebc9b160a76 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:52.489467 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:52.500270 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c552f90-a809-4267-8a23-7ba47eb5291c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:52.500868 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c552f90-a809-4267-8a23-7ba47eb5291c None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:52.501143 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c552f90-a809-4267-8a23-7ba47eb5291c None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:52.501410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c552f90-a809-4267-8a23-7ba47eb5291c None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:52.502057 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c552f90-a809-4267-8a23-7ba47eb5291c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:52.502380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c552f90-a809-4267-8a23-7ba47eb5291c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:52.503731 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c552f90-a809-4267-8a23-7ba47eb5291c None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:52.511556 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 578/1150] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:57:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:52.517427 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5992268-9bd4-4e3a-a435-9b6dfe1d5f93 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:52.572689 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:52.614388 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5992268-9bd4-4e3a-a435-9b6dfe1d5f93 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:52.646257 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4037aac-bc1f-4b69-8688-295400990692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:52.646912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4037aac-bc1f-4b69-8688-295400990692 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:52.647191 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4037aac-bc1f-4b69-8688-295400990692 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:52.647467 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4037aac-bc1f-4b69-8688-295400990692 None admin] PATH_INFO: `/v3/users/b81ff72f9b9f4117b11a9075a53ed0fe` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:52.648596 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4037aac-bc1f-4b69-8688-295400990692 None admin] RBAC: Authorizing `identity:get_user(user_id=b81ff72f9b9f4117b11a9075a53ed0fe)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:52.650082 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4037aac-bc1f-4b69-8688-295400990692 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:52.651720 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 573/1151] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:57:52 2022] GET /identity/v3/users/b81ff72f9b9f4117b11a9075a53ed0fe => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:52.657383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c552f90-a809-4267-8a23-7ba47eb5291c None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:52.759704 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c552f90-a809-4267-8a23-7ba47eb5291c None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:52.791985 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd49b8-d115-48c9-af35-ef405888e5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:52.792605 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd49b8-d115-48c9-af35-ef405888e5bd None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:52.792885 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd49b8-d115-48c9-af35-ef405888e5bd None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:52.793159 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd49b8-d115-48c9-af35-ef405888e5bd None admin] PATH_INFO: `/v3/projects/5e91061241124bdf9684443392fa998d` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:52.794249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd49b8-d115-48c9-af35-ef405888e5bd None admin] RBAC: Authorizing `identity:get_project(project_id=5e91061241124bdf9684443392fa998d)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:52.795715 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd49b8-d115-48c9-af35-ef405888e5bd None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:52.797334 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 579/1152] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:57:52 2022] GET /identity/v3/projects/5e91061241124bdf9684443392fa998d => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:52.804019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4037aac-bc1f-4b69-8688-295400990692 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:52.899543 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4037aac-bc1f-4b69-8688-295400990692 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:52.921245 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:52.932102 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0fe23-c256-48fe-a92a-eb62b757ce2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:52.932747 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0fe23-c256-48fe-a92a-eb62b757ce2e None admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:52.933033 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0fe23-c256-48fe-a92a-eb62b757ce2e None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:52.933901 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0fe23-c256-48fe-a92a-eb62b757ce2e None admin] PATH_INFO: `/v3/projects/5e91061241124bdf9684443392fa998d/users/b81ff72f9b9f4117b11a9075a53ed0fe/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:52.935253 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0fe23-c256-48fe-a92a-eb62b757ce2e None admin] RBAC: Authorizing `identity:create_grant(project_id=5e91061241124bdf9684443392fa998d, user_id=b81ff72f9b9f4117b11a9075a53ed0fe, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:52.936680 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0fe23-c256-48fe-a92a-eb62b757ce2e None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:53.031447 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 574/1153] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 23 07:57:52 2022] PUT /identity/v3/projects/5e91061241124bdf9684443392fa998d/users/b81ff72f9b9f4117b11a9075a53ed0fe/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:57:54.975937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6cba5-31b4-4c05-b4a7-25af7ae6049f None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:54.978417 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6cba5-31b4-4c05-b4a7-25af7ae6049f None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:54.978417 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6cba5-31b4-4c05-b4a7-25af7ae6049f None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:54.978417 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 580/1154] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:57:54.983074 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7cddf-4f9c-4dd6-b939-1d845a263e00 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:54.983491 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7cddf-4f9c-4dd6-b939-1d845a263e00 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:54.983631 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7cddf-4f9c-4dd6-b939-1d845a263e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:55.001218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-9cf7cddf-4f9c-4dd6-b939-1d845a263e00 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:55.002435 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-9cf7cddf-4f9c-4dd6-b939-1d845a263e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:55.067044 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 575/1155] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:57:55.335279 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6cba5-31b4-4c05-b4a7-25af7ae6049f None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:55.390525 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:55.433089 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6cba5-31b4-4c05-b4a7-25af7ae6049f None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:55.466132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5266497-6611-458e-abdb-a3b0a4571975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:55.466770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5266497-6611-458e-abdb-a3b0a4571975 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:55.467047 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5266497-6611-458e-abdb-a3b0a4571975 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:55.467318 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5266497-6611-458e-abdb-a3b0a4571975 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:55.477890 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5266497-6611-458e-abdb-a3b0a4571975 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:57:55.482586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-d5266497-6611-458e-abdb-a3b0a4571975 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:57:55.482586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:55.482586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:55.482586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:55.482586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:55.482586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:55.482586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:55.482586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:55.482586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:55.482586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:55.482586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:55.482586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:55.482586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:57:55.482586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:57:55.482586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:57:55.482586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:57:55.483677 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:57:55.483677 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:57:55.483677 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:57:55.483677 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:57:55.483677 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:55.483677 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:55.483677 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:55.483677 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:55.483677 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:55.483677 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:55.483677 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:55.483677 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:55.483677 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:55.483677 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:55.483677 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:55.483677 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:55.484831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:55.484831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:55.484831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:55.484831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:55.484831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:57:55.484831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:57:55.484831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:57:55.484831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:57:55.484831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:57:55.484831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:57:55.484831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:57:55.484831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:57:55.484831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 581/1156] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:57:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:55.489856 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7cddf-4f9c-4dd6-b939-1d845a263e00 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:55.583048 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7cddf-4f9c-4dd6-b939-1d845a263e00 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:55.597862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:55.616319 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf9eee-9f89-46f9-9373-6f5bf9af3095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:55.616907 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf9eee-9f89-46f9-9373-6f5bf9af3095 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:55.617182 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf9eee-9f89-46f9-9373-6f5bf9af3095 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:55.617453 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf9eee-9f89-46f9-9373-6f5bf9af3095 None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:55.618097 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf9eee-9f89-46f9-9373-6f5bf9af3095 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:55.618422 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf9eee-9f89-46f9-9373-6f5bf9af3095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:55.619789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf9eee-9f89-46f9-9373-6f5bf9af3095 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:55.627306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 576/1157] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:57:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:55.633175 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5266497-6611-458e-abdb-a3b0a4571975 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:55.731637 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5266497-6611-458e-abdb-a3b0a4571975 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:55.745315 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:55.764679 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0716e-b3ef-4791-99f5-c523e0d2936c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:55.765303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0716e-b3ef-4791-99f5-c523e0d2936c None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:55.765583 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0716e-b3ef-4791-99f5-c523e0d2936c None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:55.765855 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0716e-b3ef-4791-99f5-c523e0d2936c None admin] PATH_INFO: `/v3/users/b81ff72f9b9f4117b11a9075a53ed0fe` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:55.766980 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0716e-b3ef-4791-99f5-c523e0d2936c None admin] RBAC: Authorizing `identity:get_user(user_id=b81ff72f9b9f4117b11a9075a53ed0fe)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:55.768416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0716e-b3ef-4791-99f5-c523e0d2936c None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:55.769979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 582/1158] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:57:55 2022] GET /identity/v3/users/b81ff72f9b9f4117b11a9075a53ed0fe => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:55.775983 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf9eee-9f89-46f9-9373-6f5bf9af3095 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:55.878728 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf9eee-9f89-46f9-9373-6f5bf9af3095 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:55.909961 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed5ecd-0f91-4937-b0c5-cc22f4b12844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:55.910581 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed5ecd-0f91-4937-b0c5-cc22f4b12844 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:55.910862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed5ecd-0f91-4937-b0c5-cc22f4b12844 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:55.911133 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed5ecd-0f91-4937-b0c5-cc22f4b12844 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:55.953400 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:55.974991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed5ecd-0f91-4937-b0c5-cc22f4b12844 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:55.976432 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed5ecd-0f91-4937-b0c5-cc22f4b12844 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:56.069722 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 577/1159] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:57:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:57:56.075907 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0716e-b3ef-4791-99f5-c523e0d2936c None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:56.174655 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0716e-b3ef-4791-99f5-c523e0d2936c None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:56.207630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e141409-6fc6-4aba-93d8-e8ca17d75b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:56.208244 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e141409-6fc6-4aba-93d8-e8ca17d75b69 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:56.208523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e141409-6fc6-4aba-93d8-e8ca17d75b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:56.208796 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e141409-6fc6-4aba-93d8-e8ca17d75b69 None admin] PATH_INFO: `/v3/projects/5e91061241124bdf9684443392fa998d` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:56.210180 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e141409-6fc6-4aba-93d8-e8ca17d75b69 None admin] RBAC: Authorizing `identity:get_project(project_id=5e91061241124bdf9684443392fa998d)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:56.211634 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e141409-6fc6-4aba-93d8-e8ca17d75b69 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:56.213242 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 583/1160] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:57:56 2022] GET /identity/v3/projects/5e91061241124bdf9684443392fa998d => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:56.219524 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed5ecd-0f91-4937-b0c5-cc22f4b12844 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:56.293797 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:56.316252 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed5ecd-0f91-4937-b0c5-cc22f4b12844 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:56.349777 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bf7d9-4ba7-4281-afd1-a46a13e0f6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:56.351381 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bf7d9-4ba7-4281-afd1-a46a13e0f6ac None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:56.351669 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bf7d9-4ba7-4281-afd1-a46a13e0f6ac None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:56.351948 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bf7d9-4ba7-4281-afd1-a46a13e0f6ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:56.352665 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77bf7d9-4ba7-4281-afd1-a46a13e0f6ac None admin] RBAC: Adding query filter params (role.id=e905040849d04aadbb8da8b0d216c92c, scope.project.id=5e91061241124bdf9684443392fa998d, user.id=b81ff72f9b9f4117b11a9075a53ed0fe) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:56.352975 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77bf7d9-4ba7-4281-afd1-a46a13e0f6ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:56.354441 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77bf7d9-4ba7-4281-afd1-a46a13e0f6ac None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:56.360052 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 578/1161] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:57:56 2022] GET /identity/v3/role_assignments?user.id=b81ff72f9b9f4117b11a9075a53ed0fe&scope.project.id=5e91061241124bdf9684443392fa998d&role.id=e905040849d04aadbb8da8b0d216c92c => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:57:58.262298 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f4ac6-4d1a-4747-9b01-47284c315718 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:58.262858 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f4ac6-4d1a-4747-9b01-47284c315718 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:58.263002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f4ac6-4d1a-4747-9b01-47284c315718 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:58.264352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 584/1162] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:57:58.269457 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9a354-7185-476e-bea6-6b5a91091b93 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:58.269840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9a354-7185-476e-bea6-6b5a91091b93 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:58.270005 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9a354-7185-476e-bea6-6b5a91091b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:58.288448 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-36d9a354-7185-476e-bea6-6b5a91091b93 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:57:58.289616 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-36d9a354-7185-476e-bea6-6b5a91091b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:57:58.352461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 579/1163] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:57:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:57:58.616507 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f4ac6-4d1a-4747-9b01-47284c315718 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:58.671694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:58.723158 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f4ac6-4d1a-4747-9b01-47284c315718 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:58.754955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97431b5-07a0-49de-9709-5a2adc89788e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:58.755619 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97431b5-07a0-49de-9709-5a2adc89788e None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:58.755899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97431b5-07a0-49de-9709-5a2adc89788e None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:58.756842 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97431b5-07a0-49de-9709-5a2adc89788e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:58.821655 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97431b5-07a0-49de-9709-5a2adc89788e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:58.823129 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97431b5-07a0-49de-9709-5a2adc89788e None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:58.869763 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:58.918256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 585/1164] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:57:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:57:58.924116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9a354-7185-476e-bea6-6b5a91091b93 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:58.990147 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:57:59.020241 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9a354-7185-476e-bea6-6b5a91091b93 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:59.051742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fdc1c-63f7-486f-aed8-cf866946aaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:59.052356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fdc1c-63f7-486f-aed8-cf866946aaec None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:59.052637 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fdc1c-63f7-486f-aed8-cf866946aaec None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:59.053466 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fdc1c-63f7-486f-aed8-cf866946aaec None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:59.059993 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fdc1c-63f7-486f-aed8-cf866946aaec None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:59.061425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fdc1c-63f7-486f-aed8-cf866946aaec None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:59.073026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-af6fdc1c-63f7-486f-aed8-cf866946aaec None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 23 07:57:59.073026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:59.073026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 23 07:57:59.073026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 23 07:57:59.073026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:57:59.073026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:57:59.073026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:57:59.073026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:57:59.073026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 23 07:57:59.073026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:59.073026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:57:59.073026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:59.073026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:57:59.073026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:57:59.073026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:57:59.073026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:57:59.073026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:57:59.074623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:57:59.074623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:57:59.074623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:57:59.074623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:57:59.074623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:57:59.074623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:57:59.074623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:57:59.074623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:57:59.074623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:57:59.074623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:57:59.074623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:57:59.074623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:57:59.074623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:57:59.074623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:57:59.074623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:57:59.074623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:57:59.075767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:57:59.075767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:57:59.075767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:57:59.075767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:57:59.075767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:57:59.075767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:57:59.075767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:57:59.075767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:57:59.075767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:57:59.075767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:57:59.075767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 23 07:57:59.075767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:57:59.075767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 23 07:57:59.075767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:57:59.075767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 580/1165] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 23 07:57:58 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:57:59.080313 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97431b5-07a0-49de-9709-5a2adc89788e None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:57:59.174680 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97431b5-07a0-49de-9709-5a2adc89788e None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:57:59.208036 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279ad5c-7331-4338-be8a-8a7dcbcfca39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:57:59.208630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279ad5c-7331-4338-be8a-8a7dcbcfca39 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:57:59.208908 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279ad5c-7331-4338-be8a-8a7dcbcfca39 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:57:59.209247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279ad5c-7331-4338-be8a-8a7dcbcfca39 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:57:59.209873 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279ad5c-7331-4338-be8a-8a7dcbcfca39 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:57:59.210168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279ad5c-7331-4338-be8a-8a7dcbcfca39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:57:59.211557 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279ad5c-7331-4338-be8a-8a7dcbcfca39 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:57:59.218544 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 586/1166] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Aug 23 07:57:59 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:58:01.082891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd51e2-6bd2-4ee9-ac2b-f1e7728f302b None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:01.083424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd51e2-6bd2-4ee9-ac2b-f1e7728f302b None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:01.083424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd51e2-6bd2-4ee9-ac2b-f1e7728f302b None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:01.085288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 581/1167] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:58:01.090459 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf42d4-aa50-4b35-8aa0-826e5fc59a78 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:01.090865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf42d4-aa50-4b35-8aa0-826e5fc59a78 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:01.091010 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf42d4-aa50-4b35-8aa0-826e5fc59a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:01.109068 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-7baf42d4-aa50-4b35-8aa0-826e5fc59a78 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:58:01.110228 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-7baf42d4-aa50-4b35-8aa0-826e5fc59a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:58:01.119177 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:58:01.174153 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 587/1168] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:58:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:58:01.447906 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd51e2-6bd2-4ee9-ac2b-f1e7728f302b None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:58:01.546818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd51e2-6bd2-4ee9-ac2b-f1e7728f302b None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:58:01.574080 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:58:01.579329 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d59701-d93a-4a82-94e8-f3ff48547b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:58:01.579921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d59701-d93a-4a82-94e8-f3ff48547b45 None admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:01.580199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d59701-d93a-4a82-94e8-f3ff48547b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:01.580469 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d59701-d93a-4a82-94e8-f3ff48547b45 None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:01.581160 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d59701-d93a-4a82-94e8-f3ff48547b45 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:58:01.582549 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d59701-d93a-4a82-94e8-f3ff48547b45 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:58:01.712754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 582/1169] 10.222.0.57 () {60 vars in 1138 bytes} [Tue Aug 23 07:58:01 2022] POST /identity/v3/domains => generated 267 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:58:03.614353 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aeec89-a505-4c92-abc3-525b7ba3dc97 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:03.614912 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aeec89-a505-4c92-abc3-525b7ba3dc97 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:03.614912 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aeec89-a505-4c92-abc3-525b7ba3dc97 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:03.616784 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 588/1170] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:58:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:58:03.621948 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f886862-10db-49b3-a5b5-983687619911 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:03.622345 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f886862-10db-49b3-a5b5-983687619911 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:03.622577 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f886862-10db-49b3-a5b5-983687619911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:03.640927 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-2f886862-10db-49b3-a5b5-983687619911 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:58:03.642118 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-2f886862-10db-49b3-a5b5-983687619911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:58:03.707948 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 583/1171] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:58:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:58:03.974014 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aeec89-a505-4c92-abc3-525b7ba3dc97 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:58:04.072466 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aeec89-a505-4c92-abc3-525b7ba3dc97 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:58:04.105527 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507b88e-58e8-43de-8979-3ced4d423411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:58:04.106138 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507b88e-58e8-43de-8979-3ced4d423411 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:04.106446 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507b88e-58e8-43de-8979-3ced4d423411 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:04.106725 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507b88e-58e8-43de-8979-3ced4d423411 None admin] PATH_INFO: `/v3/domains/9541337ad3a84244a0e6ab40f9d5bde6` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:04.116649 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507b88e-58e8-43de-8979-3ced4d423411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9541337ad3a84244a0e6ab40f9d5bde6)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:58:04.118076 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507b88e-58e8-43de-8979-3ced4d423411 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:58:04.119664 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 589/1172] 10.222.0.57 () {56 vars in 1183 bytes} [Tue Aug 23 07:58:03 2022] GET /identity/v3/domains/9541337ad3a84244a0e6ab40f9d5bde6 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:58:04.125459 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f886862-10db-49b3-a5b5-983687619911 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:58:04.222684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f886862-10db-49b3-a5b5-983687619911 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:58:04.242484 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:58:04.255447 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf2b3d-2b5a-4860-9de8-9949a5f779de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:58:04.256138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf2b3d-2b5a-4860-9de8-9949a5f779de None admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:04.256416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf2b3d-2b5a-4860-9de8-9949a5f779de None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:04.259600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf2b3d-2b5a-4860-9de8-9949a5f779de None admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:04.259600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf2b3d-2b5a-4860-9de8-9949a5f779de None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:58:04.259600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf2b3d-2b5a-4860-9de8-9949a5f779de None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:58:04.363145 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 584/1173] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 23 07:58:04 2022] POST /identity/v3/projects => generated 361 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:58:06.338545 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0a9d5-5fc5-42a8-afa1-fc7997ecac52 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:06.339070 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0a9d5-5fc5-42a8-afa1-fc7997ecac52 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:06.339070 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0a9d5-5fc5-42a8-afa1-fc7997ecac52 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:06.340432 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 590/1174] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:58:06.345724 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e0f9f-0669-45df-885c-6c9e9a8957e4 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:06.346150 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e0f9f-0669-45df-885c-6c9e9a8957e4 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:06.346303 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e0f9f-0669-45df-885c-6c9e9a8957e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:06.365169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-6c0e0f9f-0669-45df-885c-6c9e9a8957e4 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:58:06.366374 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-6c0e0f9f-0669-45df-885c-6c9e9a8957e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:58:06.431623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 585/1175] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:58:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:58:06.710592 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0a9d5-5fc5-42a8-afa1-fc7997ecac52 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:58:06.714468 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:58:06.808389 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0a9d5-5fc5-42a8-afa1-fc7997ecac52 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:58:06.841321 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650affb6-ee77-4712-91ee-0a6ec3e7b684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:58:06.841943 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650affb6-ee77-4712-91ee-0a6ec3e7b684 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:06.842226 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650affb6-ee77-4712-91ee-0a6ec3e7b684 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:06.842528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650affb6-ee77-4712-91ee-0a6ec3e7b684 None admin] PATH_INFO: `/v3/domains/9541337ad3a84244a0e6ab40f9d5bde6` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:06.843618 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650affb6-ee77-4712-91ee-0a6ec3e7b684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9541337ad3a84244a0e6ab40f9d5bde6)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:58:06.845044 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650affb6-ee77-4712-91ee-0a6ec3e7b684 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:58:06.846623 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 591/1176] 10.222.0.57 () {56 vars in 1183 bytes} [Tue Aug 23 07:58:06 2022] GET /identity/v3/domains/9541337ad3a84244a0e6ab40f9d5bde6 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:58:06.852425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e0f9f-0669-45df-885c-6c9e9a8957e4 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:58:06.946451 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e0f9f-0669-45df-885c-6c9e9a8957e4 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:58:06.947857 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:58:06.979278 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a98aa-ed33-4dc1-9f41-d809031fbf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:58:06.979871 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a98aa-ed33-4dc1-9f41-d809031fbf3d None admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:06.980151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a98aa-ed33-4dc1-9f41-d809031fbf3d None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:06.980426 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a98aa-ed33-4dc1-9f41-d809031fbf3d None admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:06.981061 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a98aa-ed33-4dc1-9f41-d809031fbf3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:58:06.982512 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a98aa-ed33-4dc1-9f41-d809031fbf3d None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:58:07.105519 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 586/1177] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 23 07:58:06 2022] POST /identity/v3/users => generated 311 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:58:09.025903 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd28c5-ab95-4044-97cf-013533104915 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:09.026474 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd28c5-ab95-4044-97cf-013533104915 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:09.026474 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd28c5-ab95-4044-97cf-013533104915 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:09.027842 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 592/1178] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:58:09.033034 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf31bc-f8d5-43ed-8953-426b480dafc7 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:09.033411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf31bc-f8d5-43ed-8953-426b480dafc7 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:09.033583 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf31bc-f8d5-43ed-8953-426b480dafc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:09.050968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-fcaf31bc-f8d5-43ed-8953-426b480dafc7 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:58:09.052143 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-fcaf31bc-f8d5-43ed-8953-426b480dafc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:58:09.116027 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 587/1179] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:58:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:58:09.383389 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd28c5-ab95-4044-97cf-013533104915 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:58:09.453111 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:58:09.483287 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd28c5-ab95-4044-97cf-013533104915 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:58:09.526444 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c954d-b008-49a5-9c74-1c1a1342ec33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:58:09.527355 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c954d-b008-49a5-9c74-1c1a1342ec33 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:09.527773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c954d-b008-49a5-9c74-1c1a1342ec33 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:09.528183 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c954d-b008-49a5-9c74-1c1a1342ec33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:09.541854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c954d-b008-49a5-9c74-1c1a1342ec33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:58:09.548958 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-6a2c954d-b008-49a5-9c74-1c1a1342ec33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:58:09.548958 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:58:09.548958 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:58:09.548958 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:58:09.548958 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:58:09.548958 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:58:09.548958 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:58:09.548958 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:58:09.548958 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:58:09.548958 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:58:09.548958 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:58:09.548958 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:58:09.548958 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:58:09.548958 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:58:09.548958 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:58:09.548958 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:58:09.550148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:58:09.550148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:58:09.550148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:58:09.550148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:58:09.550148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:58:09.550148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:58:09.550148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:58:09.550148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:58:09.550148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:58:09.550148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:58:09.550148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:58:09.550148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:58:09.550148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:58:09.550148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:58:09.550148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:58:09.550148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:58:09.551123 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:58:09.551123 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:58:09.551123 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:58:09.551123 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:58:09.551123 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:58:09.551123 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:58:09.551123 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:58:09.551123 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:58:09.551123 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:58:09.551123 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:58:09.551123 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:58:09.551123 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:58:09.551123 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 593/1180] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:58:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:58:09.558473 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf31bc-f8d5-43ed-8953-426b480dafc7 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:58:09.647928 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:58:09.659313 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf31bc-f8d5-43ed-8953-426b480dafc7 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:58:09.691570 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5deeb-2f9f-4b61-a21c-3c4d2d2be077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:58:09.692169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5deeb-2f9f-4b61-a21c-3c4d2d2be077 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:09.692450 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5deeb-2f9f-4b61-a21c-3c4d2d2be077 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:09.692724 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5deeb-2f9f-4b61-a21c-3c4d2d2be077 None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:09.693937 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5deeb-2f9f-4b61-a21c-3c4d2d2be077 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:58:09.694236 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5deeb-2f9f-4b61-a21c-3c4d2d2be077 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:58:09.695627 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5deeb-2f9f-4b61-a21c-3c4d2d2be077 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:58:09.703537 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 588/1181] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:58:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:58:09.710020 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c954d-b008-49a5-9c74-1c1a1342ec33 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:58:09.805185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c954d-b008-49a5-9c74-1c1a1342ec33 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:58:09.832983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:58:09.837701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7fca7-aa87-41bd-baf8-498d1ac620fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:58:09.838341 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7fca7-aa87-41bd-baf8-498d1ac620fb None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:09.838625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7fca7-aa87-41bd-baf8-498d1ac620fb None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:09.838898 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7fca7-aa87-41bd-baf8-498d1ac620fb None admin] PATH_INFO: `/v3/users/db87275005f0478ebe9f8ef367f27942` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:09.852138 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7fca7-aa87-41bd-baf8-498d1ac620fb None admin] RBAC: Authorizing `identity:get_user(user_id=db87275005f0478ebe9f8ef367f27942)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:58:09.853589 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7fca7-aa87-41bd-baf8-498d1ac620fb None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:58:09.855226 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 594/1182] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:58:09 2022] GET /identity/v3/users/db87275005f0478ebe9f8ef367f27942 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:58:09.861627 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5deeb-2f9f-4b61-a21c-3c4d2d2be077 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:58:09.961007 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5deeb-2f9f-4b61-a21c-3c4d2d2be077 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:58:09.993072 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9cae7-c179-4eb3-847e-8625128805b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:58:09.993664 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9cae7-c179-4eb3-847e-8625128805b8 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:09.993943 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9cae7-c179-4eb3-847e-8625128805b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:09.994214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9cae7-c179-4eb3-847e-8625128805b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:10.011480 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:58:10.057360 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9cae7-c179-4eb3-847e-8625128805b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:58:10.058826 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9cae7-c179-4eb3-847e-8625128805b8 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:58:10.150364 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 589/1183] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:58:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:58:10.156443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7fca7-aa87-41bd-baf8-498d1ac620fb None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:58:10.253707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7fca7-aa87-41bd-baf8-498d1ac620fb None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:58:10.286016 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e757c-81a9-493a-b2f4-1b1e5065c3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:58:10.286728 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e757c-81a9-493a-b2f4-1b1e5065c3bf None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:10.287616 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e757c-81a9-493a-b2f4-1b1e5065c3bf None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:10.287890 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e757c-81a9-493a-b2f4-1b1e5065c3bf None admin] PATH_INFO: `/v3/projects/7bffdefb443740409972c4d98763ed24` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:10.288976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e757c-81a9-493a-b2f4-1b1e5065c3bf None admin] RBAC: Authorizing `identity:get_project(project_id=7bffdefb443740409972c4d98763ed24)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:58:10.290434 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e757c-81a9-493a-b2f4-1b1e5065c3bf None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:58:10.292034 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 595/1184] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:58:10 2022] GET /identity/v3/projects/7bffdefb443740409972c4d98763ed24 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:58:10.298340 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9cae7-c179-4eb3-847e-8625128805b8 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:58:10.345649 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:58:10.393099 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9cae7-c179-4eb3-847e-8625128805b8 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:58:10.424779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07667f6c-eaa6-413c-bc97-6a66a50f46d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:58:10.425363 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07667f6c-eaa6-413c-bc97-6a66a50f46d1 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:10.425641 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07667f6c-eaa6-413c-bc97-6a66a50f46d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:10.425909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07667f6c-eaa6-413c-bc97-6a66a50f46d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:10.426638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07667f6c-eaa6-413c-bc97-6a66a50f46d1 None admin] RBAC: Adding query filter params (role.id=e905040849d04aadbb8da8b0d216c92c, scope.project.id=7bffdefb443740409972c4d98763ed24, user.id=db87275005f0478ebe9f8ef367f27942) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:58:10.426941 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07667f6c-eaa6-413c-bc97-6a66a50f46d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:58:10.428897 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07667f6c-eaa6-413c-bc97-6a66a50f46d1 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:58:10.433971 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 590/1185] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:58:10 2022] GET /identity/v3/role_assignments?user.id=db87275005f0478ebe9f8ef367f27942&scope.project.id=7bffdefb443740409972c4d98763ed24&role.id=e905040849d04aadbb8da8b0d216c92c => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:58:12.299507 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b5ae8-8f23-48a1-92e6-ba8af650b1cc None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:12.300063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b5ae8-8f23-48a1-92e6-ba8af650b1cc None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:12.300063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b5ae8-8f23-48a1-92e6-ba8af650b1cc None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:12.301370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 596/1186] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:58:12.307147 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071d0f1-7a12-4abe-a8dc-d4bf71d6fe66 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:12.307522 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071d0f1-7a12-4abe-a8dc-d4bf71d6fe66 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:12.307702 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071d0f1-7a12-4abe-a8dc-d4bf71d6fe66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:12.325803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-a071d0f1-7a12-4abe-a8dc-d4bf71d6fe66 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:58:12.327025 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a071d0f1-7a12-4abe-a8dc-d4bf71d6fe66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:58:12.390703 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 591/1187] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:58:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:58:12.657920 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b5ae8-8f23-48a1-92e6-ba8af650b1cc None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:58:12.716834 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:58:12.756914 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b5ae8-8f23-48a1-92e6-ba8af650b1cc None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:58:12.789876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21ab1c-7541-4a12-82ab-8a6dc0530759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:58:12.790512 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21ab1c-7541-4a12-82ab-8a6dc0530759 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:12.790791 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21ab1c-7541-4a12-82ab-8a6dc0530759 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:12.791060 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21ab1c-7541-4a12-82ab-8a6dc0530759 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:12.800658 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21ab1c-7541-4a12-82ab-8a6dc0530759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:58:12.805282 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-4e21ab1c-7541-4a12-82ab-8a6dc0530759 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:58:12.805282 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:58:12.805282 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:58:12.805282 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:58:12.805282 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:58:12.805282 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:58:12.805282 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:58:12.805282 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:58:12.805282 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:58:12.805282 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:58:12.805282 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:58:12.805282 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:58:12.805282 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:58:12.805282 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:58:12.805282 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:58:12.805282 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:58:12.806401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:58:12.806401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:58:12.806401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:58:12.806401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:58:12.806401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:58:12.806401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:58:12.806401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:58:12.806401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:58:12.806401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:58:12.806401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:58:12.806401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:58:12.806401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:58:12.806401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:58:12.806401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:58:12.806401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:58:12.806401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:58:12.807392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:58:12.807392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:58:12.807392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:58:12.807392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:58:12.807392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:58:12.807392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:58:12.807392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:58:12.807392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:58:12.807392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:58:12.807392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:58:12.807392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:58:12.807392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:58:12.807392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 597/1188] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:58:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:58:12.812350 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071d0f1-7a12-4abe-a8dc-d4bf71d6fe66 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:58:12.857056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:58:12.909247 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071d0f1-7a12-4abe-a8dc-d4bf71d6fe66 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:58:12.941332 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17da2ed-91d7-41ef-85da-11f54b2d9d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:58:12.941929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17da2ed-91d7-41ef-85da-11f54b2d9d3f None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:12.942217 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17da2ed-91d7-41ef-85da-11f54b2d9d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:12.942519 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17da2ed-91d7-41ef-85da-11f54b2d9d3f None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:12.943758 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17da2ed-91d7-41ef-85da-11f54b2d9d3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:58:12.944064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17da2ed-91d7-41ef-85da-11f54b2d9d3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:58:12.945432 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17da2ed-91d7-41ef-85da-11f54b2d9d3f None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:58:12.953439 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 592/1189] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:58:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:58:12.959816 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21ab1c-7541-4a12-82ab-8a6dc0530759 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:58:13.055872 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21ab1c-7541-4a12-82ab-8a6dc0530759 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:58:13.073807 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:58:13.089751 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e1896-f83e-45ba-96f0-ec9c726ef4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:58:13.090390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e1896-f83e-45ba-96f0-ec9c726ef4b6 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:13.090683 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e1896-f83e-45ba-96f0-ec9c726ef4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:13.090959 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e1896-f83e-45ba-96f0-ec9c726ef4b6 None admin] PATH_INFO: `/v3/users/db87275005f0478ebe9f8ef367f27942` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:13.092060 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e1896-f83e-45ba-96f0-ec9c726ef4b6 None admin] RBAC: Authorizing `identity:get_user(user_id=db87275005f0478ebe9f8ef367f27942)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:58:13.093492 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e1896-f83e-45ba-96f0-ec9c726ef4b6 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:58:13.095071 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 598/1190] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:58:12 2022] GET /identity/v3/users/db87275005f0478ebe9f8ef367f27942 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:58:13.101002 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17da2ed-91d7-41ef-85da-11f54b2d9d3f None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:58:13.223149 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17da2ed-91d7-41ef-85da-11f54b2d9d3f None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:58:13.230033 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:58:13.256631 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6557f-d564-40b8-b680-12f3a7558279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:58:13.257251 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6557f-d564-40b8-b680-12f3a7558279 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:13.257528 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6557f-d564-40b8-b680-12f3a7558279 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:13.257799 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6557f-d564-40b8-b680-12f3a7558279 None admin] PATH_INFO: `/v3/projects/7bffdefb443740409972c4d98763ed24` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:13.258954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6557f-d564-40b8-b680-12f3a7558279 None admin] RBAC: Authorizing `identity:get_project(project_id=7bffdefb443740409972c4d98763ed24)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:58:13.260393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6557f-d564-40b8-b680-12f3a7558279 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:58:13.262017 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 593/1191] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:58:13 2022] GET /identity/v3/projects/7bffdefb443740409972c4d98763ed24 => generated 361 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:58:13.268162 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e1896-f83e-45ba-96f0-ec9c726ef4b6 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:58:13.363047 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e1896-f83e-45ba-96f0-ec9c726ef4b6 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:58:13.396491 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a707f9-1cc9-4661-9566-7a55da54b2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:58:13.397133 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a707f9-1cc9-4661-9566-7a55da54b2ce None admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:13.397411 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a707f9-1cc9-4661-9566-7a55da54b2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:13.397684 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a707f9-1cc9-4661-9566-7a55da54b2ce None admin] PATH_INFO: `/v3/projects/7bffdefb443740409972c4d98763ed24/users/db87275005f0478ebe9f8ef367f27942/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:13.399580 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a707f9-1cc9-4661-9566-7a55da54b2ce None admin] RBAC: Authorizing `identity:create_grant(project_id=7bffdefb443740409972c4d98763ed24, user_id=db87275005f0478ebe9f8ef367f27942, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:58:13.401009 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a707f9-1cc9-4661-9566-7a55da54b2ce None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:58:13.508291 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 599/1192] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 23 07:58:13 2022] PUT /identity/v3/projects/7bffdefb443740409972c4d98763ed24/users/db87275005f0478ebe9f8ef367f27942/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:58:15.372032 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346a304-d1fc-4d4e-89c4-22b4d1021da9 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:15.372562 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346a304-d1fc-4d4e-89c4-22b4d1021da9 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:15.372673 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346a304-d1fc-4d4e-89c4-22b4d1021da9 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:15.373937 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 594/1193] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:58:15.379147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112a0ad-505f-4971-9faa-fda00757f813 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:15.379526 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112a0ad-505f-4971-9faa-fda00757f813 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:15.379689 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112a0ad-505f-4971-9faa-fda00757f813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:15.397728 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-3112a0ad-505f-4971-9faa-fda00757f813 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:58:15.398924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-3112a0ad-505f-4971-9faa-fda00757f813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:58:15.438751 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:58:15.462536 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 600/1194] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:58:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:58:15.728703 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346a304-d1fc-4d4e-89c4-22b4d1021da9 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:58:15.825145 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346a304-d1fc-4d4e-89c4-22b4d1021da9 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:58:15.857315 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23022233-833a-40f6-b3f9-7ab52aac95a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:58:15.857923 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23022233-833a-40f6-b3f9-7ab52aac95a3 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:15.858199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23022233-833a-40f6-b3f9-7ab52aac95a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:15.858496 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23022233-833a-40f6-b3f9-7ab52aac95a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:15.868672 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23022233-833a-40f6-b3f9-7ab52aac95a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:58:15.873316 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-23022233-833a-40f6-b3f9-7ab52aac95a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:58:15.873316 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:58:15.873316 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:58:15.873316 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:58:15.873316 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:58:15.873316 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:58:15.873316 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:58:15.873316 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:58:15.873316 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:58:15.873316 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:58:15.873316 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:58:15.873316 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:58:15.873316 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:58:15.873316 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:58:15.873316 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:58:15.873316 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:58:15.878335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:58:15.878335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:58:15.878335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:58:15.878335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:58:15.878335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:58:15.878335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:58:15.878335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:58:15.878335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:58:15.878335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:58:15.878335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:58:15.878335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:58:15.878335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:58:15.878335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:58:15.878335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:58:15.878335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:58:15.878335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:58:15.879403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:58:15.879403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:58:15.879403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:58:15.879403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:58:15.879403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:58:15.879403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:58:15.879403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:58:15.879403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:58:15.879403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:58:15.879403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:58:15.879403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:58:15.879403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:58:15.879403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 595/1195] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:58:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:58:15.880396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112a0ad-505f-4971-9faa-fda00757f813 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:58:15.975178 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112a0ad-505f-4971-9faa-fda00757f813 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:58:16.007825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655be0d3-3b3e-4061-8232-b5b1c6143e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:58:16.008406 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655be0d3-3b3e-4061-8232-b5b1c6143e03 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:16.008682 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655be0d3-3b3e-4061-8232-b5b1c6143e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:16.008971 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655be0d3-3b3e-4061-8232-b5b1c6143e03 None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:16.009621 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655be0d3-3b3e-4061-8232-b5b1c6143e03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:58:16.009917 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655be0d3-3b3e-4061-8232-b5b1c6143e03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:58:16.011340 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655be0d3-3b3e-4061-8232-b5b1c6143e03 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:58:16.019053 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 601/1196] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:58:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:58:16.024920 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23022233-833a-40f6-b3f9-7ab52aac95a3 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:58:16.059076 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:58:16.125279 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23022233-833a-40f6-b3f9-7ab52aac95a3 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:58:16.158205 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0179eed-2789-496c-a721-40dd9b2a5b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:58:16.158858 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0179eed-2789-496c-a721-40dd9b2a5b92 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:16.159142 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0179eed-2789-496c-a721-40dd9b2a5b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:16.159415 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0179eed-2789-496c-a721-40dd9b2a5b92 None admin] PATH_INFO: `/v3/users/db87275005f0478ebe9f8ef367f27942` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:16.160528 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0179eed-2789-496c-a721-40dd9b2a5b92 None admin] RBAC: Authorizing `identity:get_user(user_id=db87275005f0478ebe9f8ef367f27942)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:58:16.162714 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0179eed-2789-496c-a721-40dd9b2a5b92 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:58:16.164290 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 596/1197] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 23 07:58:16 2022] GET /identity/v3/users/db87275005f0478ebe9f8ef367f27942 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:58:16.170169 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655be0d3-3b3e-4061-8232-b5b1c6143e03 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:58:16.208703 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:58:16.266600 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655be0d3-3b3e-4061-8232-b5b1c6143e03 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:58:16.299057 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28aace-6fdb-4138-8fc8-82bb61e6cc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:58:16.299645 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28aace-6fdb-4138-8fc8-82bb61e6cc2c None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:16.299920 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28aace-6fdb-4138-8fc8-82bb61e6cc2c None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:16.300189 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28aace-6fdb-4138-8fc8-82bb61e6cc2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:16.364725 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28aace-6fdb-4138-8fc8-82bb61e6cc2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:58:16.366166 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28aace-6fdb-4138-8fc8-82bb61e6cc2c None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:58:16.402593 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:58:16.461284 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 602/1198] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:58:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:58:16.467360 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0179eed-2789-496c-a721-40dd9b2a5b92 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:58:16.563790 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0179eed-2789-496c-a721-40dd9b2a5b92 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:58:16.565196 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:58:16.596767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cd9aa-3bee-42c7-a091-4b1cc95ac587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:58:16.597375 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cd9aa-3bee-42c7-a091-4b1cc95ac587 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:16.597652 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cd9aa-3bee-42c7-a091-4b1cc95ac587 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:16.597921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cd9aa-3bee-42c7-a091-4b1cc95ac587 None admin] PATH_INFO: `/v3/projects/7bffdefb443740409972c4d98763ed24` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:16.599077 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2cd9aa-3bee-42c7-a091-4b1cc95ac587 None admin] RBAC: Authorizing `identity:get_project(project_id=7bffdefb443740409972c4d98763ed24)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:58:16.600601 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2cd9aa-3bee-42c7-a091-4b1cc95ac587 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:58:16.602448 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 597/1199] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 23 07:58:16 2022] GET /identity/v3/projects/7bffdefb443740409972c4d98763ed24 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:58:16.608473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28aace-6fdb-4138-8fc8-82bb61e6cc2c None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:58:16.704510 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28aace-6fdb-4138-8fc8-82bb61e6cc2c None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:58:16.736618 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653f18c-9273-40ee-b734-6c7f247c027f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:58:16.737202 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653f18c-9273-40ee-b734-6c7f247c027f None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:58:16.737476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653f18c-9273-40ee-b734-6c7f247c027f None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:58:16.737743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653f18c-9273-40ee-b734-6c7f247c027f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:58:16.738479 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653f18c-9273-40ee-b734-6c7f247c027f None admin] RBAC: Adding query filter params (role.id=e905040849d04aadbb8da8b0d216c92c, scope.project.id=7bffdefb443740409972c4d98763ed24, user.id=db87275005f0478ebe9f8ef367f27942) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:58:16.738782 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653f18c-9273-40ee-b734-6c7f247c027f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:58:16.740215 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653f18c-9273-40ee-b734-6c7f247c027f None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:58:16.745714 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 603/1200] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:58:16 2022] GET /identity/v3/role_assignments?user.id=db87275005f0478ebe9f8ef367f27942&scope.project.id=7bffdefb443740409972c4d98763ed24&role.id=e905040849d04aadbb8da8b0d216c92c => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:58:26.603471 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=15 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:58:26.743223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:35.501768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dea85d-989f-40bf-acec-d7f9fe353d0e None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:35.502418 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dea85d-989f-40bf-acec-d7f9fe353d0e None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:35.502418 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dea85d-989f-40bf-acec-d7f9fe353d0e None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:35.503715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 598/1201] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:59:35.508945 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448f178-77bd-4414-a251-5546cfc43516 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:35.509382 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448f178-77bd-4414-a251-5546cfc43516 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:35.509484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448f178-77bd-4414-a251-5546cfc43516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:35.527365 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-3448f178-77bd-4414-a251-5546cfc43516 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:59:35.528543 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-3448f178-77bd-4414-a251-5546cfc43516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:59:35.594627 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 604/1202] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:59:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:59:35.865266 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dea85d-989f-40bf-acec-d7f9fe353d0e None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:35.963598 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dea85d-989f-40bf-acec-d7f9fe353d0e None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:35.996395 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753c888-1b38-42d3-b84e-b73e805f504e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:35.997007 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753c888-1b38-42d3-b84e-b73e805f504e None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:35.997282 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753c888-1b38-42d3-b84e-b73e805f504e None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:35.997545 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753c888-1b38-42d3-b84e-b73e805f504e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:36.007698 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753c888-1b38-42d3-b84e-b73e805f504e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:36.009131 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753c888-1b38-42d3-b84e-b73e805f504e None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:36.024100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-a753c888-1b38-42d3-b84e-b73e805f504e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:59:36.024100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:59:36.024100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:59:36.024100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:59:36.024100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:59:36.024100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:59:36.024100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:59:36.024100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:59:36.024100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:59:36.024100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:59:36.024100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:59:36.024100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:59:36.024100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:59:36.024100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:59:36.024100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:59:36.024100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:59:36.025309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:59:36.025309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:59:36.025309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:59:36.025309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:59:36.025309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:59:36.025309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:59:36.025309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:59:36.025309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:59:36.025309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:59:36.025309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:59:36.025309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:59:36.025309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:59:36.025309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:59:36.025309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:59:36.025309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:59:36.025309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:59:36.025309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:59:36.026534 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:59:36.026534 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:59:36.026534 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:59:36.026534 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 599/1203] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:59:36.031188 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448f178-77bd-4414-a251-5546cfc43516 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:36.126928 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448f178-77bd-4414-a251-5546cfc43516 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:36.155038 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:36.160614 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4025832-3e06-4f76-bc67-87c574c6bc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:36.161808 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4025832-3e06-4f76-bc67-87c574c6bc6a None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:36.162152 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4025832-3e06-4f76-bc67-87c574c6bc6a None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:36.162396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4025832-3e06-4f76-bc67-87c574c6bc6a None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:36.163034 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4025832-3e06-4f76-bc67-87c574c6bc6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:36.163334 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4025832-3e06-4f76-bc67-87c574c6bc6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:36.164700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4025832-3e06-4f76-bc67-87c574c6bc6a None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:36.175519 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 605/1204] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:36.183008 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753c888-1b38-42d3-b84e-b73e805f504e None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:36.232528 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:36.277747 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753c888-1b38-42d3-b84e-b73e805f504e None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:36.309223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706aecb-579f-4d50-8b94-5d9c5c4a8b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:36.309809 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706aecb-579f-4d50-8b94-5d9c5c4a8b26 None admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:36.310086 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706aecb-579f-4d50-8b94-5d9c5c4a8b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:36.310383 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706aecb-579f-4d50-8b94-5d9c5c4a8b26 None admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:36.310995 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706aecb-579f-4d50-8b94-5d9c5c4a8b26 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:36.319680 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706aecb-579f-4d50-8b94-5d9c5c4a8b26 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:36.412403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 600/1205] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 23 07:59:36 2022] POST /identity/v3/users => generated 251 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 07:59:38.346070 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63705049-e514-4b92-9473-a06f0d586fcc None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:38.346658 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63705049-e514-4b92-9473-a06f0d586fcc None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:38.346949 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63705049-e514-4b92-9473-a06f0d586fcc None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:38.348595 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 606/1206] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:59:38.353726 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792f82e-14be-4c38-9315-e36294dd8e8e None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:38.354161 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792f82e-14be-4c38-9315-e36294dd8e8e None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:38.354373 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792f82e-14be-4c38-9315-e36294dd8e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:38.372788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-9792f82e-14be-4c38-9315-e36294dd8e8e None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:59:38.373978 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-9792f82e-14be-4c38-9315-e36294dd8e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:59:38.439384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 601/1207] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:59:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:59:38.714464 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63705049-e514-4b92-9473-a06f0d586fcc None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:38.815070 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63705049-e514-4b92-9473-a06f0d586fcc None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:38.849130 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707bf1d-e878-4aab-83d1-cbce65803c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:38.850575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707bf1d-e878-4aab-83d1-cbce65803c1a None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:38.850575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707bf1d-e878-4aab-83d1-cbce65803c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:38.850575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707bf1d-e878-4aab-83d1-cbce65803c1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:38.860815 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707bf1d-e878-4aab-83d1-cbce65803c1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:59:38.866009 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-a707bf1d-e878-4aab-83d1-cbce65803c1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:59:38.866009 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:59:38.866009 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:59:38.866009 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:59:38.866009 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:59:38.866009 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:59:38.866009 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:59:38.866009 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:59:38.866009 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:59:38.866009 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:59:38.866009 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:59:38.866009 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:59:38.866009 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:59:38.866009 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:59:38.866009 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:59:38.866009 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:59:38.867223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:59:38.867223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:59:38.867223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:59:38.867223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:59:38.867223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:59:38.867223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:59:38.867223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:59:38.867223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:59:38.867223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:59:38.867223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:59:38.867223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:59:38.867223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:59:38.867223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:59:38.867223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:59:38.867223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:59:38.867223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:59:38.868380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:59:38.868380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:59:38.868380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:59:38.868380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:59:38.868380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:59:38.868380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:59:38.868380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:59:38.868380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:59:38.868380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:59:38.868380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:59:38.868380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:59:38.868380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:59:38.868380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 607/1208] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 23 07:59:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:59:38.873216 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792f82e-14be-4c38-9315-e36294dd8e8e None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:38.911690 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:38.969642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792f82e-14be-4c38-9315-e36294dd8e8e None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:39.005527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724b91a-59b6-4369-ad26-abcef7e704a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:39.011506 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724b91a-59b6-4369-ad26-abcef7e704a2 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:39.011506 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724b91a-59b6-4369-ad26-abcef7e704a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:39.011506 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724b91a-59b6-4369-ad26-abcef7e704a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:39.011506 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724b91a-59b6-4369-ad26-abcef7e704a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:39.011506 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724b91a-59b6-4369-ad26-abcef7e704a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:39.011506 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724b91a-59b6-4369-ad26-abcef7e704a2 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:39.019209 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 602/1209] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 23 07:59:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:39.025282 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707bf1d-e878-4aab-83d1-cbce65803c1a None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:39.075624 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:39.124976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707bf1d-e878-4aab-83d1-cbce65803c1a None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:39.157087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2babe-3e93-4fd7-8544-fac16816c21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:39.157698 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2babe-3e93-4fd7-8544-fac16816c21a None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:39.157974 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2babe-3e93-4fd7-8544-fac16816c21a None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:39.158245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2babe-3e93-4fd7-8544-fac16816c21a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:39.168595 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2babe-3e93-4fd7-8544-fac16816c21a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:39.169994 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2babe-3e93-4fd7-8544-fac16816c21a None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:39.184116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-58c2babe-3e93-4fd7-8544-fac16816c21a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:59:39.184116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:59:39.184116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:59:39.184116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:59:39.184116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:59:39.184116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:59:39.184116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:59:39.184116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:59:39.184116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:59:39.184116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:59:39.184116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:59:39.184116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:59:39.184116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:59:39.184116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:59:39.184116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:59:39.184116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:59:39.185247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:59:39.185247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:59:39.185247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:59:39.185247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:59:39.185247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:59:39.185247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:59:39.185247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:59:39.185247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:59:39.185247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:59:39.185247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:59:39.185247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:59:39.185247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:59:39.185247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:59:39.185247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:59:39.185247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:59:39.185247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:59:39.185247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:59:39.186157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:59:39.186157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:59:39.186157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:59:39.186157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 608/1210] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:59:39.191100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724b91a-59b6-4369-ad26-abcef7e704a2 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:39.287667 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:39.290481 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724b91a-59b6-4369-ad26-abcef7e704a2 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:39.322740 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28c1c2-e9df-47fc-b585-044f82b5bbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:39.323591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28c1c2-e9df-47fc-b585-044f82b5bbfd None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:39.323867 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28c1c2-e9df-47fc-b585-044f82b5bbfd None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:39.324135 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28c1c2-e9df-47fc-b585-044f82b5bbfd None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:39.324754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28c1c2-e9df-47fc-b585-044f82b5bbfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:39.325049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28c1c2-e9df-47fc-b585-044f82b5bbfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:39.326448 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28c1c2-e9df-47fc-b585-044f82b5bbfd None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:39.337603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 603/1211] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:39.343307 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2babe-3e93-4fd7-8544-fac16816c21a None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:39.439887 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2babe-3e93-4fd7-8544-fac16816c21a None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:39.441329 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:39.472756 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e544f7-ff09-4706-990d-bfa4eed5df5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:39.473375 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e544f7-ff09-4706-990d-bfa4eed5df5b None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:39.473786 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e544f7-ff09-4706-990d-bfa4eed5df5b None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:39.474035 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e544f7-ff09-4706-990d-bfa4eed5df5b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:39.481539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e544f7-ff09-4706-990d-bfa4eed5df5b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:39.483062 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e544f7-ff09-4706-990d-bfa4eed5df5b None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:39.493997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-45e544f7-ff09-4706-990d-bfa4eed5df5b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 07:59:39.493997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:59:39.493997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:59:39.493997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:59:39.493997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:59:39.493997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:59:39.493997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:59:39.493997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:59:39.493997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:59:39.493997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:59:39.493997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:59:39.493997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:59:39.493997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:59:39.493997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:59:39.493997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:59:39.493997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:59:39.495147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:59:39.495147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:59:39.495147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:59:39.495147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:59:39.495147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:59:39.495147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:59:39.495147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:59:39.495147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:59:39.495147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:59:39.495147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:59:39.495147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:59:39.495147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:59:39.495147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:59:39.495147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:59:39.495147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:59:39.495147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:59:39.495147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:59:39.495147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:59:39.496383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:59:39.496383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:59:39.496383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:59:39.496383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:59:39.496383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:59:39.496383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:59:39.496383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:59:39.496383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:59:39.496383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 07:59:39.496383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:59:39.496383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 609/1212] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:59:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:59:39.501072 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28c1c2-e9df-47fc-b585-044f82b5bbfd None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:39.599338 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28c1c2-e9df-47fc-b585-044f82b5bbfd None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:39.632044 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0034e-1cf0-4a2f-ad6e-cc419b32ee8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:39.632643 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0034e-1cf0-4a2f-ad6e-cc419b32ee8e None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:39.632926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0034e-1cf0-4a2f-ad6e-cc419b32ee8e None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:39.633193 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0034e-1cf0-4a2f-ad6e-cc419b32ee8e None admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:39.633906 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0034e-1cf0-4a2f-ad6e-cc419b32ee8e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:39.634207 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0034e-1cf0-4a2f-ad6e-cc419b32ee8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:39.635655 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0034e-1cf0-4a2f-ad6e-cc419b32ee8e None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:39.652342 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 604/1213] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Aug 23 07:59:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:39.658167 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e544f7-ff09-4706-990d-bfa4eed5df5b None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:39.756725 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e544f7-ff09-4706-990d-bfa4eed5df5b None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:39.788573 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad94ea-479f-4b14-87ef-50f8bcb82f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:39.789160 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad94ea-479f-4b14-87ef-50f8bcb82f7e None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:39.789438 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad94ea-479f-4b14-87ef-50f8bcb82f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:39.789711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad94ea-479f-4b14-87ef-50f8bcb82f7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:39.819458 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:39.854925 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad94ea-479f-4b14-87ef-50f8bcb82f7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:39.856376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad94ea-479f-4b14-87ef-50f8bcb82f7e None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:39.953622 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 610/1214] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:59:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:59:39.959479 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0034e-1cf0-4a2f-ad6e-cc419b32ee8e None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:39.978522 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:40.058316 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0034e-1cf0-4a2f-ad6e-cc419b32ee8e None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:40.091177 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1510ebb-e42e-4d80-89c4-f502c2767a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:40.091794 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1510ebb-e42e-4d80-89c4-f502c2767a51 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:40.092069 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1510ebb-e42e-4d80-89c4-f502c2767a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:40.092339 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1510ebb-e42e-4d80-89c4-f502c2767a51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:40.102383 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1510ebb-e42e-4d80-89c4-f502c2767a51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:40.103811 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1510ebb-e42e-4d80-89c4-f502c2767a51 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:40.118212 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-d1510ebb-e42e-4d80-89c4-f502c2767a51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:59:40.118212 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:59:40.118212 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:59:40.118212 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:59:40.118212 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:59:40.118212 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:59:40.118212 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:59:40.118212 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:59:40.118212 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:59:40.118212 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:59:40.118212 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:59:40.118212 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:59:40.118212 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:59:40.118212 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:59:40.118212 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:59:40.118212 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:59:40.124035 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:59:40.124035 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:59:40.124035 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:59:40.124035 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:59:40.124035 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:59:40.124035 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:59:40.124035 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:59:40.124035 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:59:40.124035 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:59:40.124035 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:59:40.124035 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:59:40.124035 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:59:40.124035 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:59:40.124035 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:59:40.124035 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:59:40.124035 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:59:40.124035 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:59:40.125206 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:59:40.125206 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:59:40.125206 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:59:40.125206 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 605/1215] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:59:40.125483 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad94ea-479f-4b14-87ef-50f8bcb82f7e None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:40.185167 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:40.222426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad94ea-479f-4b14-87ef-50f8bcb82f7e None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:40.257261 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc345486-2bcf-417e-a99e-acefbb98d051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:40.257862 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc345486-2bcf-417e-a99e-acefbb98d051 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:40.258139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc345486-2bcf-417e-a99e-acefbb98d051 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:40.258450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc345486-2bcf-417e-a99e-acefbb98d051 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:40.259080 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc345486-2bcf-417e-a99e-acefbb98d051 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:40.259381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc345486-2bcf-417e-a99e-acefbb98d051 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:40.260742 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc345486-2bcf-417e-a99e-acefbb98d051 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:40.272042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 611/1216] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:40.278130 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1510ebb-e42e-4d80-89c4-f502c2767a51 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:40.353230 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:40.382966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1510ebb-e42e-4d80-89c4-f502c2767a51 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:40.416882 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2b97f-ead0-40a8-bff4-34f23ed4b797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:40.417506 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2b97f-ead0-40a8-bff4-34f23ed4b797 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:40.417788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2b97f-ead0-40a8-bff4-34f23ed4b797 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:40.418069 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2b97f-ead0-40a8-bff4-34f23ed4b797 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:40.424517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2b97f-ead0-40a8-bff4-34f23ed4b797 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:40.425979 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2b97f-ead0-40a8-bff4-34f23ed4b797 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:40.437615 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-64f2b97f-ead0-40a8-bff4-34f23ed4b797 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:59:40.437615 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:59:40.437615 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:59:40.437615 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:59:40.437615 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:59:40.437615 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:59:40.437615 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:59:40.437615 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:59:40.437615 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:59:40.437615 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:59:40.437615 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:59:40.437615 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:59:40.437615 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:59:40.437615 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:59:40.437615 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:59:40.441551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:59:40.441551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:59:40.441551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:59:40.441551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:59:40.441551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:59:40.441551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:59:40.441551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:59:40.441551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:59:40.441551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:59:40.441551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:59:40.441551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:59:40.441551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:59:40.441551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:59:40.441551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:59:40.441551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:59:40.441551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:59:40.441551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:59:40.442684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:59:40.442684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:59:40.442684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:59:40.442684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:59:40.442684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:59:40.442684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:59:40.442684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:59:40.442684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:59:40.442684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 606/1217] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:59:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:59:40.445042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc345486-2bcf-417e-a99e-acefbb98d051 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:40.543733 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc345486-2bcf-417e-a99e-acefbb98d051 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:40.566688 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:40.577908 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55875e1e-37a8-4f6f-ac24-d49ace609538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:40.578586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55875e1e-37a8-4f6f-ac24-d49ace609538 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:40.578841 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55875e1e-37a8-4f6f-ac24-d49ace609538 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:40.579113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55875e1e-37a8-4f6f-ac24-d49ace609538 None admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:40.579793 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55875e1e-37a8-4f6f-ac24-d49ace609538 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:40.580089 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55875e1e-37a8-4f6f-ac24-d49ace609538 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:40.581493 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55875e1e-37a8-4f6f-ac24-d49ace609538 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:40.594158 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 612/1218] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:59:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:40.601259 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2b97f-ead0-40a8-bff4-34f23ed4b797 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:40.701402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2b97f-ead0-40a8-bff4-34f23ed4b797 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:40.729881 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:40.735647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6558a-331e-441f-aa8c-d397e3180961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:40.736246 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6558a-331e-441f-aa8c-d397e3180961 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:40.736527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6558a-331e-441f-aa8c-d397e3180961 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:40.736797 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6558a-331e-441f-aa8c-d397e3180961 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:40.737512 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6558a-331e-441f-aa8c-d397e3180961 None admin] RBAC: Adding query filter params (role.id=e005fb4b59104519a433fc31da70f47e, scope.project.id=a80ab70ab6b9415c98017d05512c33eb, user.id=8e92560dd9da4c7cbcac5a84bcaca483) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:40.737819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6558a-331e-441f-aa8c-d397e3180961 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:40.739345 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6558a-331e-441f-aa8c-d397e3180961 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:40.744524 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 607/1219] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:59:40 2022] GET /identity/v3/role_assignments?user.id=8e92560dd9da4c7cbcac5a84bcaca483&scope.project.id=a80ab70ab6b9415c98017d05512c33eb&role.id=e005fb4b59104519a433fc31da70f47e => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:42.643750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1328260-a947-48fd-b7c9-a98ccc847ca3 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:42.644321 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1328260-a947-48fd-b7c9-a98ccc847ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:42.644497 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1328260-a947-48fd-b7c9-a98ccc847ca3 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:42.647123 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 613/1220] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:59:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:59:42.653605 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d7b40-126c-4c1c-83f9-80f2a8c3777c None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:42.654008 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d7b40-126c-4c1c-83f9-80f2a8c3777c None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:42.654153 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d7b40-126c-4c1c-83f9-80f2a8c3777c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:42.672875 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-029d7b40-126c-4c1c-83f9-80f2a8c3777c None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:59:42.674055 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-029d7b40-126c-4c1c-83f9-80f2a8c3777c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:59:42.738999 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 608/1221] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:59:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:59:43.015423 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1328260-a947-48fd-b7c9-a98ccc847ca3 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:43.115641 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1328260-a947-48fd-b7c9-a98ccc847ca3 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:43.150397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfb9bf-db09-4dea-8355-196d4734faf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:43.151017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfb9bf-db09-4dea-8355-196d4734faf5 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:43.151292 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfb9bf-db09-4dea-8355-196d4734faf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:43.151560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfb9bf-db09-4dea-8355-196d4734faf5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:43.161822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bfb9bf-db09-4dea-8355-196d4734faf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:59:43.166607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-e0bfb9bf-db09-4dea-8355-196d4734faf5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:59:43.166607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:59:43.166607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:59:43.166607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:59:43.166607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:59:43.166607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:59:43.166607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:59:43.166607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:59:43.166607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:59:43.166607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:59:43.166607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:59:43.166607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:59:43.166607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:59:43.166607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:59:43.166607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:59:43.166607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:59:43.167776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:59:43.167776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:59:43.167776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:59:43.167776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:59:43.167776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:59:43.167776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:59:43.167776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:59:43.167776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:59:43.167776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:59:43.167776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:59:43.167776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:59:43.167776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:59:43.167776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:59:43.167776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:59:43.167776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:59:43.167776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:59:43.168701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:59:43.168701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:59:43.168701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:59:43.168701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:59:43.168701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:59:43.168701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:59:43.168701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:59:43.168701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:59:43.168701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:59:43.168701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:59:43.168701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:59:43.168701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:59:43.168701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 614/1222] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 23 07:59:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:59:43.173746 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d7b40-126c-4c1c-83f9-80f2a8c3777c None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:43.269766 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d7b40-126c-4c1c-83f9-80f2a8c3777c None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:43.292455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:43.302761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06529d9-9eb1-4018-82c0-04c587958e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:43.303365 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06529d9-9eb1-4018-82c0-04c587958e2f None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:43.307931 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06529d9-9eb1-4018-82c0-04c587958e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:43.307931 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06529d9-9eb1-4018-82c0-04c587958e2f None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:43.307931 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06529d9-9eb1-4018-82c0-04c587958e2f None admin] RBAC: Adding query filter params (name=service) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:43.307931 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06529d9-9eb1-4018-82c0-04c587958e2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:43.307931 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06529d9-9eb1-4018-82c0-04c587958e2f None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:43.313647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 609/1223] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 23 07:59:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:43.319968 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfb9bf-db09-4dea-8355-196d4734faf5 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:43.363572 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:43.418183 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfb9bf-db09-4dea-8355-196d4734faf5 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:43.451602 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6f9a0-a594-40d9-a36c-4fb36bde9bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:43.452214 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6f9a0-a594-40d9-a36c-4fb36bde9bac None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:43.452498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6f9a0-a594-40d9-a36c-4fb36bde9bac None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:43.452765 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6f9a0-a594-40d9-a36c-4fb36bde9bac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:43.462490 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6f9a0-a594-40d9-a36c-4fb36bde9bac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:43.463925 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6f9a0-a594-40d9-a36c-4fb36bde9bac None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:43.477752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-4dc6f9a0-a594-40d9-a36c-4fb36bde9bac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:59:43.477752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:59:43.477752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:59:43.477752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:59:43.477752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:59:43.477752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:59:43.477752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:59:43.477752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:59:43.477752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:59:43.477752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:59:43.477752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:59:43.477752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:59:43.477752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:59:43.477752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:59:43.477752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:59:43.477752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:59:43.479179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:59:43.479179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:59:43.479179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:59:43.479179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:59:43.479179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:59:43.479179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:59:43.479179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:59:43.479179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:59:43.479179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:59:43.479179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:59:43.479179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:59:43.479179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:59:43.479179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:59:43.479179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:59:43.479179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:59:43.479179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:59:43.479179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:59:43.480260 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:59:43.480260 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:59:43.480260 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:59:43.480260 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 615/1224] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:59:43.484678 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06529d9-9eb1-4018-82c0-04c587958e2f None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:43.582635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06529d9-9eb1-4018-82c0-04c587958e2f None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:43.616084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2425f0-8c12-4555-8b9d-c7dfaff7a916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:43.616680 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2425f0-8c12-4555-8b9d-c7dfaff7a916 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:43.616962 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2425f0-8c12-4555-8b9d-c7dfaff7a916 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:43.617234 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2425f0-8c12-4555-8b9d-c7dfaff7a916 None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:43.617860 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2425f0-8c12-4555-8b9d-c7dfaff7a916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:43.618158 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2425f0-8c12-4555-8b9d-c7dfaff7a916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:43.619558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2425f0-8c12-4555-8b9d-c7dfaff7a916 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:43.631565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 610/1225] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:43.637426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6f9a0-a594-40d9-a36c-4fb36bde9bac None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:43.732026 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:43.738611 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6f9a0-a594-40d9-a36c-4fb36bde9bac None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:43.771732 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131390f-c47b-4166-9a44-a1a399181943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:43.772381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131390f-c47b-4166-9a44-a1a399181943 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:43.772662 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131390f-c47b-4166-9a44-a1a399181943 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:43.772937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131390f-c47b-4166-9a44-a1a399181943 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:43.780163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131390f-c47b-4166-9a44-a1a399181943 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:43.781644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131390f-c47b-4166-9a44-a1a399181943 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:43.792883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-e131390f-c47b-4166-9a44-a1a399181943 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 07:59:43.792883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:59:43.792883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:59:43.792883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:59:43.792883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:59:43.792883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:59:43.792883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:59:43.792883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:59:43.792883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:59:43.792883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:59:43.792883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:59:43.792883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:59:43.792883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:59:43.792883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:59:43.792883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:59:43.792883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:59:43.795084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:59:43.795084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:59:43.795084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:59:43.795084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:59:43.795084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:59:43.795084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:59:43.795084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:59:43.795084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:59:43.795084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:59:43.795084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:59:43.795084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:59:43.795084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:59:43.795084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:59:43.795084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:59:43.795084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:59:43.795084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:59:43.795084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:59:43.795084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:59:43.796410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:59:43.796410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:59:43.796410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:59:43.796410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:59:43.796410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:59:43.796410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:59:43.796410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:59:43.796410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:59:43.796410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 07:59:43.796410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:59:43.796410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 616/1226] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:59:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:59:43.800142 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2425f0-8c12-4555-8b9d-c7dfaff7a916 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:43.846418 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:43.897350 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2425f0-8c12-4555-8b9d-c7dfaff7a916 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:43.929929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14eb250-48cc-49cd-9900-2847c1350c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:43.930558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14eb250-48cc-49cd-9900-2847c1350c15 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:43.930843 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14eb250-48cc-49cd-9900-2847c1350c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:43.931120 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14eb250-48cc-49cd-9900-2847c1350c15 None admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:43.931844 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14eb250-48cc-49cd-9900-2847c1350c15 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:43.932149 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14eb250-48cc-49cd-9900-2847c1350c15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:43.933576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14eb250-48cc-49cd-9900-2847c1350c15 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:43.951265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 611/1227] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Aug 23 07:59:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:43.957448 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131390f-c47b-4166-9a44-a1a399181943 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:44.062536 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131390f-c47b-4166-9a44-a1a399181943 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:44.095438 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc1706-40af-45c7-b085-6d4d3ebddbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:44.096052 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc1706-40af-45c7-b085-6d4d3ebddbd4 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:44.096329 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc1706-40af-45c7-b085-6d4d3ebddbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:44.096652 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc1706-40af-45c7-b085-6d4d3ebddbd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:44.108021 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc1706-40af-45c7-b085-6d4d3ebddbd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:44.109470 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc1706-40af-45c7-b085-6d4d3ebddbd4 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:44.123085 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-01fc1706-40af-45c7-b085-6d4d3ebddbd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:59:44.123085 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:59:44.123085 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:59:44.123085 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:59:44.123085 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:59:44.123085 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:59:44.123085 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:59:44.123085 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:59:44.123085 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:59:44.123085 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:59:44.123085 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:59:44.123085 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:59:44.123085 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:59:44.123085 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:59:44.123085 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:59:44.123085 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:59:44.124229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:59:44.124229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:59:44.124229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:59:44.124229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:59:44.124229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:59:44.124229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:59:44.124229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:59:44.124229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:59:44.124229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:59:44.124229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:59:44.124229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:59:44.124229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:59:44.124229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:59:44.124229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:59:44.124229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:59:44.124229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:59:44.124229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:59:44.125227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:59:44.125227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:59:44.125227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:59:44.125227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 617/1228] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:59:44.130263 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14eb250-48cc-49cd-9900-2847c1350c15 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:44.228055 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14eb250-48cc-49cd-9900-2847c1350c15 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:44.230364 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:44.262822 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7edae-cc61-403d-b276-5302d4ba46e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:44.263435 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7edae-cc61-403d-b276-5302d4ba46e7 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:44.263715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7edae-cc61-403d-b276-5302d4ba46e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:44.263987 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7edae-cc61-403d-b276-5302d4ba46e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:44.264626 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7edae-cc61-403d-b276-5302d4ba46e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:44.264926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7edae-cc61-403d-b276-5302d4ba46e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:44.266356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7edae-cc61-403d-b276-5302d4ba46e7 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:44.278661 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 612/1229] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:44.284448 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc1706-40af-45c7-b085-6d4d3ebddbd4 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:44.296114 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:44.385197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc1706-40af-45c7-b085-6d4d3ebddbd4 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:44.419793 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b00ad-cafb-4269-9d08-aaad559b9295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:44.420413 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b00ad-cafb-4269-9d08-aaad559b9295 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:44.420695 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b00ad-cafb-4269-9d08-aaad559b9295 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:44.420970 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b00ad-cafb-4269-9d08-aaad559b9295 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:44.427602 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b00ad-cafb-4269-9d08-aaad559b9295 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:44.429504 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b00ad-cafb-4269-9d08-aaad559b9295 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:44.439999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-e46b00ad-cafb-4269-9d08-aaad559b9295 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:59:44.439999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:59:44.439999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:59:44.439999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:59:44.439999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:59:44.439999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:59:44.439999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:59:44.439999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:59:44.439999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:59:44.439999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:59:44.439999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:59:44.439999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:59:44.439999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:59:44.439999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:59:44.439999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:59:44.441093 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:59:44.441093 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:59:44.441093 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:59:44.441093 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:59:44.441093 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:59:44.441093 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:59:44.441093 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:59:44.441093 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:59:44.441093 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:59:44.441093 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:59:44.441093 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:59:44.441093 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:59:44.441093 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:59:44.441093 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:59:44.441093 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:59:44.441093 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:59:44.441093 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:59:44.442017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:59:44.442017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:59:44.442017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:59:44.442017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:59:44.442017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:59:44.442017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:59:44.442017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:59:44.442017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:59:44.442017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 618/1230] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:59:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:59:44.447862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7edae-cc61-403d-b276-5302d4ba46e7 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:44.544378 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7edae-cc61-403d-b276-5302d4ba46e7 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:44.578410 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4c3b6-2560-4d42-9afb-49d66be2a0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:44.579013 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4c3b6-2560-4d42-9afb-49d66be2a0c6 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:44.579291 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4c3b6-2560-4d42-9afb-49d66be2a0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:44.579563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4c3b6-2560-4d42-9afb-49d66be2a0c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:44.580238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4c3b6-2560-4d42-9afb-49d66be2a0c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:44.580539 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4c3b6-2560-4d42-9afb-49d66be2a0c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:44.581959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4c3b6-2560-4d42-9afb-49d66be2a0c6 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:44.594777 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 613/1231] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:59:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:44.600937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b00ad-cafb-4269-9d08-aaad559b9295 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:44.666228 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:44.700286 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b00ad-cafb-4269-9d08-aaad559b9295 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:44.732100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246778a-4384-428b-af54-c0acdb00774a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:44.732747 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246778a-4384-428b-af54-c0acdb00774a None admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:44.733024 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246778a-4384-428b-af54-c0acdb00774a None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:44.733297 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246778a-4384-428b-af54-c0acdb00774a None admin] PATH_INFO: `/v3/projects/a80ab70ab6b9415c98017d05512c33eb/users/8e92560dd9da4c7cbcac5a84bcaca483/roles/e005fb4b59104519a433fc31da70f47e` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:44.747171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246778a-4384-428b-af54-c0acdb00774a None admin] RBAC: Authorizing `identity:create_grant(project_id=a80ab70ab6b9415c98017d05512c33eb, user_id=8e92560dd9da4c7cbcac5a84bcaca483, role_id=e005fb4b59104519a433fc31da70f47e)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:44.752832 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246778a-4384-428b-af54-c0acdb00774a None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:44.943907 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 619/1232] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 23 07:59:44 2022] PUT /identity/v3/projects/a80ab70ab6b9415c98017d05512c33eb/users/8e92560dd9da4c7cbcac5a84bcaca483/roles/e005fb4b59104519a433fc31da70f47e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:59:46.810063 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be30f78-6832-4c85-8d76-61ffc4ba9370 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:46.810625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be30f78-6832-4c85-8d76-61ffc4ba9370 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:46.810625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be30f78-6832-4c85-8d76-61ffc4ba9370 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:46.811956 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 614/1233] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:59:46.817066 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64010731-ba74-478b-953e-402b00e3f8b8 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:46.817465 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64010731-ba74-478b-953e-402b00e3f8b8 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:46.817617 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64010731-ba74-478b-953e-402b00e3f8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:46.837244 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-64010731-ba74-478b-953e-402b00e3f8b8 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:59:46.841695 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-64010731-ba74-478b-953e-402b00e3f8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:59:46.904712 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 620/1234] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:59:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:59:47.173650 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be30f78-6832-4c85-8d76-61ffc4ba9370 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:47.199168 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:47.271234 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be30f78-6832-4c85-8d76-61ffc4ba9370 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:47.304983 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbddae0-4345-4914-a0c3-fc49909287f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:47.305600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbddae0-4345-4914-a0c3-fc49909287f2 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:47.305876 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbddae0-4345-4914-a0c3-fc49909287f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:47.306144 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbddae0-4345-4914-a0c3-fc49909287f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:47.315797 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbddae0-4345-4914-a0c3-fc49909287f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:59:47.321433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-ebbddae0-4345-4914-a0c3-fc49909287f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:59:47.321433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:59:47.321433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:59:47.321433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:59:47.321433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:59:47.321433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:59:47.321433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:59:47.321433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:59:47.321433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:59:47.321433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:59:47.321433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:59:47.321433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:59:47.321433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:59:47.321433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:59:47.321433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:59:47.321433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:59:47.322606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:59:47.322606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:59:47.322606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:59:47.322606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:59:47.322606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:59:47.322606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:59:47.322606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:59:47.322606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:59:47.322606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:59:47.322606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:59:47.322606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:59:47.322606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:59:47.322606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:59:47.322606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:59:47.322606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:59:47.322606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:59:47.323797 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:59:47.323797 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:59:47.323797 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:59:47.323797 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:59:47.323797 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:59:47.323797 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:59:47.323797 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:59:47.323797 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:59:47.323797 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:59:47.323797 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:59:47.323797 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:59:47.323797 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:59:47.323797 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 615/1235] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 23 07:59:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:59:47.328933 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64010731-ba74-478b-953e-402b00e3f8b8 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:47.374224 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:47.424734 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64010731-ba74-478b-953e-402b00e3f8b8 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:47.458883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461e7c7-9837-4327-a3ab-02aec09de8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:47.459479 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461e7c7-9837-4327-a3ab-02aec09de8c4 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:47.459755 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461e7c7-9837-4327-a3ab-02aec09de8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:47.460023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461e7c7-9837-4327-a3ab-02aec09de8c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:47.460671 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461e7c7-9837-4327-a3ab-02aec09de8c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:47.460969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461e7c7-9837-4327-a3ab-02aec09de8c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:47.462345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461e7c7-9837-4327-a3ab-02aec09de8c4 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:47.470005 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 621/1236] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 23 07:59:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:47.476287 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbddae0-4345-4914-a0c3-fc49909287f2 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:47.559131 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:47.574499 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbddae0-4345-4914-a0c3-fc49909287f2 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:47.606598 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7800cd4-a6b5-4db3-b3d4-03bd1f7c2ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:47.607215 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7800cd4-a6b5-4db3-b3d4-03bd1f7c2ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:47.607495 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7800cd4-a6b5-4db3-b3d4-03bd1f7c2ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:47.607769 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7800cd4-a6b5-4db3-b3d4-03bd1f7c2ee7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:47.617935 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7800cd4-a6b5-4db3-b3d4-03bd1f7c2ee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:47.619415 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7800cd4-a6b5-4db3-b3d4-03bd1f7c2ee7 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:47.633314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-c7800cd4-a6b5-4db3-b3d4-03bd1f7c2ee7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:59:47.633314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:59:47.633314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:59:47.633314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:59:47.633314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:59:47.633314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:59:47.633314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:59:47.633314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:59:47.633314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:59:47.633314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:59:47.633314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:59:47.633314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:59:47.633314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:59:47.633314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:59:47.633314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:59:47.633314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:59:47.634483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:59:47.634483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:59:47.634483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:59:47.634483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:59:47.634483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:59:47.634483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:59:47.634483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:59:47.634483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:59:47.634483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:59:47.634483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:59:47.634483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:59:47.634483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:59:47.634483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:59:47.634483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:59:47.634483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:59:47.634483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:59:47.634483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:59:47.635590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:59:47.635590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:59:47.635590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:59:47.635590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 616/1237] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:59:47.640326 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461e7c7-9837-4327-a3ab-02aec09de8c4 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:47.739605 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461e7c7-9837-4327-a3ab-02aec09de8c4 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:47.748766 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:47.772792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc26d77-7c84-4161-94ae-2f56082c9da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:47.773393 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc26d77-7c84-4161-94ae-2f56082c9da6 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:47.773673 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc26d77-7c84-4161-94ae-2f56082c9da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:47.773944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc26d77-7c84-4161-94ae-2f56082c9da6 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:47.774600 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc26d77-7c84-4161-94ae-2f56082c9da6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:47.774906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc26d77-7c84-4161-94ae-2f56082c9da6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:47.776299 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc26d77-7c84-4161-94ae-2f56082c9da6 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:47.788072 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 622/1238] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:47.793753 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7800cd4-a6b5-4db3-b3d4-03bd1f7c2ee7 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:47.892267 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7800cd4-a6b5-4db3-b3d4-03bd1f7c2ee7 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:47.926882 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ff685-f761-4d7a-aea7-1faec028c0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:47.927733 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ff685-f761-4d7a-aea7-1faec028c0c7 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:47.928017 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ff685-f761-4d7a-aea7-1faec028c0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:47.928286 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ff685-f761-4d7a-aea7-1faec028c0c7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:47.930870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:47.935176 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ff685-f761-4d7a-aea7-1faec028c0c7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:47.936642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ff685-f761-4d7a-aea7-1faec028c0c7 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:47.948028 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-e15ff685-f761-4d7a-aea7-1faec028c0c7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 07:59:47.948028 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:59:47.948028 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:59:47.948028 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:59:47.948028 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:59:47.948028 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:59:47.948028 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:59:47.948028 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:59:47.948028 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:59:47.948028 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:59:47.948028 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:59:47.948028 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:59:47.948028 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:59:47.948028 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:59:47.948028 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:59:47.948028 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:59:47.949384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:59:47.949384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:59:47.949384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:59:47.949384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:59:47.949384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:59:47.949384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:59:47.949384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:59:47.949384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:59:47.949384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:59:47.949384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:59:47.949384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:59:47.949384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:59:47.949384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:59:47.949384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:59:47.949384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:59:47.949384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:59:47.949384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:59:47.949384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:59:47.950594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:59:47.950594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:59:47.950594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:59:47.950594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:59:47.950594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:59:47.950594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:59:47.950594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:59:47.950594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:59:47.950594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 07:59:47.950594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:59:47.950594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 617/1239] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:59:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:59:47.955319 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc26d77-7c84-4161-94ae-2f56082c9da6 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:48.054580 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc26d77-7c84-4161-94ae-2f56082c9da6 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:48.088238 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8831be8-2fd0-40e3-b8de-4989e6cfdf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:48.088830 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8831be8-2fd0-40e3-b8de-4989e6cfdf19 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:48.089115 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8831be8-2fd0-40e3-b8de-4989e6cfdf19 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:48.089384 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8831be8-2fd0-40e3-b8de-4989e6cfdf19 None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:48.090094 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8831be8-2fd0-40e3-b8de-4989e6cfdf19 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:48.090427 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8831be8-2fd0-40e3-b8de-4989e6cfdf19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:48.091874 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8831be8-2fd0-40e3-b8de-4989e6cfdf19 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:48.109043 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 623/1240] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Aug 23 07:59:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:48.114926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ff685-f761-4d7a-aea7-1faec028c0c7 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:48.212734 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ff685-f761-4d7a-aea7-1faec028c0c7 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:48.245479 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba969d0c-5e42-4805-bcda-44c9982b38a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:48.246077 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba969d0c-5e42-4805-bcda-44c9982b38a2 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:48.246385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba969d0c-5e42-4805-bcda-44c9982b38a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:48.246659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba969d0c-5e42-4805-bcda-44c9982b38a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:48.305743 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:48.311949 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba969d0c-5e42-4805-bcda-44c9982b38a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:48.313434 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba969d0c-5e42-4805-bcda-44c9982b38a2 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:48.407460 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 618/1241] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:59:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:59:48.413651 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8831be8-2fd0-40e3-b8de-4989e6cfdf19 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:48.440699 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:48.511959 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8831be8-2fd0-40e3-b8de-4989e6cfdf19 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:48.546011 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf233b2-09a6-4a34-83e6-2c13d6435a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:48.546662 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf233b2-09a6-4a34-83e6-2c13d6435a7c None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:48.546945 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf233b2-09a6-4a34-83e6-2c13d6435a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:48.547221 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf233b2-09a6-4a34-83e6-2c13d6435a7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:48.557006 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf233b2-09a6-4a34-83e6-2c13d6435a7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:48.558425 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf233b2-09a6-4a34-83e6-2c13d6435a7c None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:48.573404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-3bf233b2-09a6-4a34-83e6-2c13d6435a7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:59:48.573404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:59:48.573404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:59:48.573404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:59:48.573404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:59:48.573404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:59:48.573404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:59:48.573404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:59:48.573404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:59:48.573404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:59:48.573404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:59:48.573404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:59:48.573404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:59:48.573404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:59:48.573404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:59:48.573404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:59:48.574560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:59:48.574560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:59:48.574560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:59:48.574560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:59:48.574560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:59:48.574560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:59:48.574560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:59:48.574560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:59:48.574560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:59:48.574560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:59:48.574560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:59:48.574560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:59:48.574560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:59:48.574560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:59:48.574560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:59:48.574560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:59:48.574560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:59:48.575644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:59:48.575644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:59:48.575644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:59:48.575644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 624/1242] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:59:48.580232 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba969d0c-5e42-4805-bcda-44c9982b38a2 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:48.669368 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:48.677946 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba969d0c-5e42-4805-bcda-44c9982b38a2 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:48.710796 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d46799-cbea-4b1a-b48b-ecc8ac63dd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:48.711393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d46799-cbea-4b1a-b48b-ecc8ac63dd21 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:48.711670 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d46799-cbea-4b1a-b48b-ecc8ac63dd21 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:48.711940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d46799-cbea-4b1a-b48b-ecc8ac63dd21 None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:48.712560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d46799-cbea-4b1a-b48b-ecc8ac63dd21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:48.712858 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d46799-cbea-4b1a-b48b-ecc8ac63dd21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:48.714221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d46799-cbea-4b1a-b48b-ecc8ac63dd21 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:48.725077 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 619/1243] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:48.730945 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf233b2-09a6-4a34-83e6-2c13d6435a7c None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:48.810692 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:48.832584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf233b2-09a6-4a34-83e6-2c13d6435a7c None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:48.866734 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83330c94-a9cd-4f41-aaf5-4873b28e7883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:48.867361 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83330c94-a9cd-4f41-aaf5-4873b28e7883 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:48.867646 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83330c94-a9cd-4f41-aaf5-4873b28e7883 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:48.867927 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83330c94-a9cd-4f41-aaf5-4873b28e7883 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:48.874496 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83330c94-a9cd-4f41-aaf5-4873b28e7883 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:48.875932 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83330c94-a9cd-4f41-aaf5-4873b28e7883 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:48.888032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-83330c94-a9cd-4f41-aaf5-4873b28e7883 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:59:48.888032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:59:48.888032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:59:48.888032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:59:48.888032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:59:48.888032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:59:48.888032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:59:48.888032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:59:48.888032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:59:48.888032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:59:48.888032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:59:48.888032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:59:48.888032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:59:48.888032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:59:48.888032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:59:48.893471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:59:48.893471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:59:48.893471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:59:48.893471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:59:48.893471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:59:48.893471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:59:48.893471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:59:48.893471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:59:48.893471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:59:48.893471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:59:48.893471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:59:48.893471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:59:48.893471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:59:48.893471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:59:48.893471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:59:48.893471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:59:48.893471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:59:48.894662 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:59:48.894662 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:59:48.894662 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:59:48.894662 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:59:48.894662 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:59:48.894662 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:59:48.894662 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:59:48.894662 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:59:48.894662 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 625/1244] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:59:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:59:48.895262 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d46799-cbea-4b1a-b48b-ecc8ac63dd21 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:48.996249 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d46799-cbea-4b1a-b48b-ecc8ac63dd21 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:49.029047 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1307ba-0483-40f6-888a-4d2dd6d2360f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:49.029652 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1307ba-0483-40f6-888a-4d2dd6d2360f None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:49.029931 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1307ba-0483-40f6-888a-4d2dd6d2360f None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:49.030204 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1307ba-0483-40f6-888a-4d2dd6d2360f None admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:49.030913 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1307ba-0483-40f6-888a-4d2dd6d2360f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:49.031216 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1307ba-0483-40f6-888a-4d2dd6d2360f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:49.032654 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1307ba-0483-40f6-888a-4d2dd6d2360f None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:49.045042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 620/1245] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:59:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:49.051198 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83330c94-a9cd-4f41-aaf5-4873b28e7883 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:49.152338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83330c94-a9cd-4f41-aaf5-4873b28e7883 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:49.185596 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db17c96-f7aa-4fef-a03e-228d1d9e7c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:49.186187 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db17c96-f7aa-4fef-a03e-228d1d9e7c13 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:49.186496 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db17c96-f7aa-4fef-a03e-228d1d9e7c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:49.186808 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db17c96-f7aa-4fef-a03e-228d1d9e7c13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:49.187526 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db17c96-f7aa-4fef-a03e-228d1d9e7c13 None admin] RBAC: Adding query filter params (role.id=e005fb4b59104519a433fc31da70f47e, scope.project.id=a80ab70ab6b9415c98017d05512c33eb, user.id=8e92560dd9da4c7cbcac5a84bcaca483) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:49.187834 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db17c96-f7aa-4fef-a03e-228d1d9e7c13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:49.189259 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db17c96-f7aa-4fef-a03e-228d1d9e7c13 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:49.195161 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 626/1246] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:59:49 2022] GET /identity/v3/role_assignments?user.id=8e92560dd9da4c7cbcac5a84bcaca483&scope.project.id=a80ab70ab6b9415c98017d05512c33eb&role.id=e005fb4b59104519a433fc31da70f47e => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:51.164493 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258f97e-2063-4aad-a32e-05bc0d919527 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:51.165051 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258f97e-2063-4aad-a32e-05bc0d919527 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:51.165051 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258f97e-2063-4aad-a32e-05bc0d919527 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:51.166456 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 621/1247] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:59:51.171806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988ad95-e731-4dee-b6b0-d393309dc1fe None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:51.172215 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988ad95-e731-4dee-b6b0-d393309dc1fe None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:51.172363 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988ad95-e731-4dee-b6b0-d393309dc1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:51.179356 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:51.191143 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-2988ad95-e731-4dee-b6b0-d393309dc1fe None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:59:51.192339 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-2988ad95-e731-4dee-b6b0-d393309dc1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:59:51.265055 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 627/1248] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:59:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:59:51.536461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258f97e-2063-4aad-a32e-05bc0d919527 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:51.554417 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:51.636210 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258f97e-2063-4aad-a32e-05bc0d919527 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:51.669863 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78fca35-12f0-494c-92b2-89c5113d2a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:51.670521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fca35-12f0-494c-92b2-89c5113d2a9b None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:51.670801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fca35-12f0-494c-92b2-89c5113d2a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:51.677570 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fca35-12f0-494c-92b2-89c5113d2a9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:51.681559 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78fca35-12f0-494c-92b2-89c5113d2a9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:59:51.686300 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-d78fca35-12f0-494c-92b2-89c5113d2a9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:59:51.686300 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:59:51.686300 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:59:51.686300 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:59:51.686300 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:59:51.686300 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:59:51.686300 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:59:51.686300 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:59:51.686300 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:59:51.686300 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:59:51.686300 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:59:51.686300 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:59:51.686300 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:59:51.686300 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:59:51.686300 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:59:51.686300 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:59:51.687392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:59:51.687392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:59:51.687392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:59:51.687392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:59:51.687392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:59:51.687392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:59:51.687392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:59:51.687392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:59:51.687392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:59:51.687392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:59:51.687392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:59:51.687392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:59:51.687392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:59:51.687392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:59:51.687392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:59:51.687392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:59:51.688490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:59:51.688490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:59:51.688490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:59:51.688490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:59:51.688490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:59:51.688490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:59:51.688490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:59:51.688490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:59:51.688490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:59:51.688490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:59:51.688490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:59:51.688490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:59:51.688490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 622/1249] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:59:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:59:51.694157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988ad95-e731-4dee-b6b0-d393309dc1fe None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:51.791471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988ad95-e731-4dee-b6b0-d393309dc1fe None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:51.821147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:51.826232 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a4483-fa62-405b-8a21-7c4e721d9d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:51.826871 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a4483-fa62-405b-8a21-7c4e721d9d1d None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:51.827155 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a4483-fa62-405b-8a21-7c4e721d9d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:51.827428 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a4483-fa62-405b-8a21-7c4e721d9d1d None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:51.828084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a4483-fa62-405b-8a21-7c4e721d9d1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:51.828387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a4483-fa62-405b-8a21-7c4e721d9d1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:51.829753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a4483-fa62-405b-8a21-7c4e721d9d1d None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:51.837626 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 628/1250] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:59:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:51.843452 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78fca35-12f0-494c-92b2-89c5113d2a9b None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:51.917381 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:51.939532 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78fca35-12f0-494c-92b2-89c5113d2a9b None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:51.972357 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cdcd6-9db3-4921-a85e-8888a8b1cbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:51.972975 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cdcd6-9db3-4921-a85e-8888a8b1cbff None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:51.973254 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cdcd6-9db3-4921-a85e-8888a8b1cbff None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:51.973527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cdcd6-9db3-4921-a85e-8888a8b1cbff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:51.983790 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233cdcd6-9db3-4921-a85e-8888a8b1cbff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:51.985279 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233cdcd6-9db3-4921-a85e-8888a8b1cbff None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:51.999814 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-233cdcd6-9db3-4921-a85e-8888a8b1cbff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:59:51.999814 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:59:51.999814 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:59:51.999814 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:59:51.999814 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:59:51.999814 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:59:51.999814 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:59:51.999814 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:59:51.999814 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:59:51.999814 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:59:51.999814 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:59:51.999814 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:59:51.999814 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:59:51.999814 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:59:51.999814 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:59:51.999814 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:59:52.000940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:59:52.000940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:59:52.000940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:59:52.000940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:59:52.000940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:59:52.000940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:59:52.000940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:59:52.000940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:59:52.000940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:59:52.000940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:59:52.000940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:59:52.000940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:59:52.000940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:59:52.000940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:59:52.000940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:59:52.000940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:59:52.000940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:59:52.001861 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:59:52.001861 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:59:52.001861 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:59:52.001861 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 623/1251] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:59:52.006837 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a4483-fa62-405b-8a21-7c4e721d9d1d None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:52.107202 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a4483-fa62-405b-8a21-7c4e721d9d1d None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:52.140354 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75e8ab-fd41-4fce-bc94-11ba067579d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:52.140959 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75e8ab-fd41-4fce-bc94-11ba067579d4 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:52.141240 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75e8ab-fd41-4fce-bc94-11ba067579d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:52.141514 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75e8ab-fd41-4fce-bc94-11ba067579d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:52.142144 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75e8ab-fd41-4fce-bc94-11ba067579d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:52.142479 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75e8ab-fd41-4fce-bc94-11ba067579d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:52.143939 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75e8ab-fd41-4fce-bc94-11ba067579d4 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:52.155703 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 629/1252] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:52.162031 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cdcd6-9db3-4921-a85e-8888a8b1cbff None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:52.259480 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cdcd6-9db3-4921-a85e-8888a8b1cbff None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:52.284206 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:52.292259 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e2f5e-a49d-409c-9e4f-c61b5e6b1298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:52.292879 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e2f5e-a49d-409c-9e4f-c61b5e6b1298 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:52.293159 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e2f5e-a49d-409c-9e4f-c61b5e6b1298 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:52.293429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e2f5e-a49d-409c-9e4f-c61b5e6b1298 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:52.300787 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e2f5e-a49d-409c-9e4f-c61b5e6b1298 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:52.302952 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e2f5e-a49d-409c-9e4f-c61b5e6b1298 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:52.313852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-e51e2f5e-a49d-409c-9e4f-c61b5e6b1298 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 07:59:52.313852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:59:52.313852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:59:52.313852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:59:52.313852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:59:52.313852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:59:52.313852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:59:52.313852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:59:52.313852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:59:52.313852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:59:52.313852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:59:52.313852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:59:52.313852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:59:52.313852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:59:52.313852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:59:52.313852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:59:52.315014 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:59:52.315014 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:59:52.315014 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:59:52.315014 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:59:52.315014 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:59:52.315014 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:59:52.315014 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:59:52.315014 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:59:52.315014 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:59:52.315014 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:59:52.315014 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:59:52.315014 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:59:52.315014 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:59:52.315014 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:59:52.315014 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:59:52.315014 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:59:52.315014 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:59:52.315014 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:59:52.315964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:59:52.315964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:59:52.315964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:59:52.315964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:59:52.315964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:59:52.315964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:59:52.315964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:59:52.315964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:59:52.315964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 07:59:52.315964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:59:52.315964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 624/1253] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:59:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:59:52.321042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75e8ab-fd41-4fce-bc94-11ba067579d4 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:52.383641 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:52.426127 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75e8ab-fd41-4fce-bc94-11ba067579d4 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:52.458834 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964091bd-c4fb-46da-a128-e6fac4ac9f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:52.459518 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964091bd-c4fb-46da-a128-e6fac4ac9f84 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:52.459800 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964091bd-c4fb-46da-a128-e6fac4ac9f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:52.460075 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964091bd-c4fb-46da-a128-e6fac4ac9f84 None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:52.460791 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964091bd-c4fb-46da-a128-e6fac4ac9f84 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:52.461095 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964091bd-c4fb-46da-a128-e6fac4ac9f84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:52.462551 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964091bd-c4fb-46da-a128-e6fac4ac9f84 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:52.479351 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 630/1254] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Aug 23 07:59:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:52.487339 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e2f5e-a49d-409c-9e4f-c61b5e6b1298 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:52.582158 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e2f5e-a49d-409c-9e4f-c61b5e6b1298 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:52.616232 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9e5a8-4b1b-46d1-96ea-e70ee194873e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:52.616839 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9e5a8-4b1b-46d1-96ea-e70ee194873e None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:52.617117 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9e5a8-4b1b-46d1-96ea-e70ee194873e None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:52.617386 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9e5a8-4b1b-46d1-96ea-e70ee194873e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:52.671602 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:52.684521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9e5a8-4b1b-46d1-96ea-e70ee194873e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:52.685995 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9e5a8-4b1b-46d1-96ea-e70ee194873e None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:52.782673 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 625/1255] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 07:59:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:59:52.789650 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964091bd-c4fb-46da-a128-e6fac4ac9f84 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:52.887811 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964091bd-c4fb-46da-a128-e6fac4ac9f84 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:52.902036 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:52.921745 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7f878-c43a-4860-bd56-fe403fe4c264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:52.922493 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7f878-c43a-4860-bd56-fe403fe4c264 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:52.922827 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7f878-c43a-4860-bd56-fe403fe4c264 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:52.923105 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7f878-c43a-4860-bd56-fe403fe4c264 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:52.932706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7f878-c43a-4860-bd56-fe403fe4c264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:52.934163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7f878-c43a-4860-bd56-fe403fe4c264 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:52.949328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-10d7f878-c43a-4860-bd56-fe403fe4c264 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:59:52.949328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:59:52.949328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:59:52.949328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:59:52.949328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:59:52.949328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:59:52.949328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:59:52.949328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:59:52.949328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:59:52.949328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:59:52.949328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:59:52.949328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:59:52.949328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:59:52.949328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:59:52.949328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:59:52.949328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:59:52.950510 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:59:52.950510 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:59:52.950510 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:59:52.950510 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:59:52.950510 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:59:52.950510 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:59:52.950510 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:59:52.950510 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:59:52.950510 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:59:52.950510 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:59:52.950510 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:59:52.950510 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:59:52.950510 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:59:52.950510 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:59:52.950510 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:59:52.950510 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:59:52.950510 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:59:52.951625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:59:52.951625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:59:52.951625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:59:52.951625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 631/1256] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:59:52.956188 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9e5a8-4b1b-46d1-96ea-e70ee194873e None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:53.046448 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:53.058869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9e5a8-4b1b-46d1-96ea-e70ee194873e None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:53.094905 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72468adf-cd42-40a0-a7b2-50e0836a26a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:53.095494 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72468adf-cd42-40a0-a7b2-50e0836a26a0 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:53.095862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72468adf-cd42-40a0-a7b2-50e0836a26a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:53.096092 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72468adf-cd42-40a0-a7b2-50e0836a26a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:53.096724 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72468adf-cd42-40a0-a7b2-50e0836a26a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:53.097061 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72468adf-cd42-40a0-a7b2-50e0836a26a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:53.098458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72468adf-cd42-40a0-a7b2-50e0836a26a0 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:53.110396 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 626/1257] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:53.116229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7f878-c43a-4860-bd56-fe403fe4c264 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:53.214150 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7f878-c43a-4860-bd56-fe403fe4c264 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:53.247441 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3ec31-058e-4a73-9b39-b0264e766098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:53.248051 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3ec31-058e-4a73-9b39-b0264e766098 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:53.248329 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3ec31-058e-4a73-9b39-b0264e766098 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:53.248690 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3ec31-058e-4a73-9b39-b0264e766098 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:53.255942 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3ec31-058e-4a73-9b39-b0264e766098 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:53.257433 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3ec31-058e-4a73-9b39-b0264e766098 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:53.268290 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-cdc3ec31-058e-4a73-9b39-b0264e766098 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:59:53.268290 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:59:53.268290 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:59:53.268290 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:59:53.268290 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:59:53.268290 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:59:53.268290 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:59:53.268290 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:59:53.268290 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:59:53.268290 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:59:53.268290 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:59:53.268290 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:59:53.268290 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:59:53.268290 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:59:53.268290 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:59:53.269367 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:59:53.269367 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:59:53.269367 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:59:53.269367 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:59:53.269367 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:59:53.269367 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:59:53.269367 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:59:53.269367 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:59:53.269367 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 07:59:53.269367 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:59:53.269367 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:59:53.269367 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:59:53.269367 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:59:53.269367 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:59:53.269367 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:59:53.269367 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:59:53.269367 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:59:53.271207 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:59:53.271207 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:59:53.271207 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:59:53.271207 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:59:53.271207 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:59:53.271207 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:59:53.271207 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:59:53.271207 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 07:59:53.271207 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 632/1258] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:59:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:59:53.275946 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72468adf-cd42-40a0-a7b2-50e0836a26a0 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:53.374933 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72468adf-cd42-40a0-a7b2-50e0836a26a0 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:53.409299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404a78a-a35c-4663-ab00-fbd44b21b95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:53.409947 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404a78a-a35c-4663-ab00-fbd44b21b95e None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:53.410232 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404a78a-a35c-4663-ab00-fbd44b21b95e None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:53.410533 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404a78a-a35c-4663-ab00-fbd44b21b95e None admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:53.411273 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404a78a-a35c-4663-ab00-fbd44b21b95e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:53.412110 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404a78a-a35c-4663-ab00-fbd44b21b95e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:53.413535 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404a78a-a35c-4663-ab00-fbd44b21b95e None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:53.425049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 627/1259] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:59:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:53.431488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3ec31-058e-4a73-9b39-b0264e766098 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:53.457788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:53.529247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3ec31-058e-4a73-9b39-b0264e766098 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:53.561592 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863b7d0-c022-42d1-ac4b-65874aab8f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:53.562178 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863b7d0-c022-42d1-ac4b-65874aab8f40 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:53.562486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863b7d0-c022-42d1-ac4b-65874aab8f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:53.562758 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863b7d0-c022-42d1-ac4b-65874aab8f40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:53.563466 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863b7d0-c022-42d1-ac4b-65874aab8f40 None admin] RBAC: Adding query filter params (role.id=e905040849d04aadbb8da8b0d216c92c, scope.project.id=a80ab70ab6b9415c98017d05512c33eb, user.id=8e92560dd9da4c7cbcac5a84bcaca483) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:53.563807 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863b7d0-c022-42d1-ac4b-65874aab8f40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:53.565217 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863b7d0-c022-42d1-ac4b-65874aab8f40 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:53.570959 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 633/1260] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 07:59:53 2022] GET /identity/v3/role_assignments?user.id=8e92560dd9da4c7cbcac5a84bcaca483&scope.project.id=a80ab70ab6b9415c98017d05512c33eb&role.id=e905040849d04aadbb8da8b0d216c92c => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:55.464378 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c951a9-3f47-4d53-a72a-caf12f854a15 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:55.464906 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c951a9-3f47-4d53-a72a-caf12f854a15 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:55.464906 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c951a9-3f47-4d53-a72a-caf12f854a15 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:55.466336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 628/1261] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:59:55.471455 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39084ec-959d-4c8a-8e00-b803783b0791 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:55.471874 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39084ec-959d-4c8a-8e00-b803783b0791 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:55.472028 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39084ec-959d-4c8a-8e00-b803783b0791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:55.490509 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-b39084ec-959d-4c8a-8e00-b803783b0791 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:59:55.491686 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-b39084ec-959d-4c8a-8e00-b803783b0791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:59:55.556498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 634/1262] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:59:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:59:55.833152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c951a9-3f47-4d53-a72a-caf12f854a15 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:55.844046 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:55.932627 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c951a9-3f47-4d53-a72a-caf12f854a15 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:55.965803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00d219-e387-47cb-8818-541069fbfc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:55.966591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00d219-e387-47cb-8818-541069fbfc65 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:55.966926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00d219-e387-47cb-8818-541069fbfc65 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:55.967207 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00d219-e387-47cb-8818-541069fbfc65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:55.980898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00d219-e387-47cb-8818-541069fbfc65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:59:55.988075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-1a00d219-e387-47cb-8818-541069fbfc65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:59:55.988075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:59:55.988075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:59:55.988075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:59:55.988075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:59:55.988075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:59:55.988075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:59:55.988075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:59:55.988075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:59:55.988075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:59:55.988075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:59:55.988075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:59:55.988075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:59:55.988075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:59:55.988075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:59:55.988075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:59:55.998323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:59:55.998323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:59:55.998323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:59:55.998323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:59:55.998323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:59:55.998323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:59:55.998323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:59:55.998323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:59:55.998323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:59:55.998323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:59:55.998323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:59:55.998323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:59:55.998323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:59:55.998323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:59:55.998323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:59:55.998323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:59:55.999432 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:59:55.999432 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:59:55.999432 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:59:55.999432 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:59:55.999432 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:59:55.999432 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:59:55.999432 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:59:55.999432 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:59:55.999432 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:59:55.999432 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:59:55.999432 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:59:55.999432 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:59:55.999432 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 629/1263] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 07:59:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:59:56.000314 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39084ec-959d-4c8a-8e00-b803783b0791 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:56.014450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:56.091460 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39084ec-959d-4c8a-8e00-b803783b0791 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:56.126099 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d246bc4-5d51-4d78-9630-89c41bf3fd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:56.126731 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d246bc4-5d51-4d78-9630-89c41bf3fd02 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:56.127011 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d246bc4-5d51-4d78-9630-89c41bf3fd02 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:56.127283 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d246bc4-5d51-4d78-9630-89c41bf3fd02 None admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:56.127937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d246bc4-5d51-4d78-9630-89c41bf3fd02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:56.128237 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d246bc4-5d51-4d78-9630-89c41bf3fd02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:56.129609 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d246bc4-5d51-4d78-9630-89c41bf3fd02 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:56.137748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 635/1264] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 07:59:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:56.143505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00d219-e387-47cb-8818-541069fbfc65 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:56.210400 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:56.242257 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00d219-e387-47cb-8818-541069fbfc65 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:56.274606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355e12e-53c0-4ef8-ac27-3c609bd52ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:56.275227 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355e12e-53c0-4ef8-ac27-3c609bd52ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:56.275504 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355e12e-53c0-4ef8-ac27-3c609bd52ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:56.275773 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355e12e-53c0-4ef8-ac27-3c609bd52ed1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:56.287260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355e12e-53c0-4ef8-ac27-3c609bd52ed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:56.288707 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355e12e-53c0-4ef8-ac27-3c609bd52ed1 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:56.302170 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-e355e12e-53c0-4ef8-ac27-3c609bd52ed1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:59:56.302170 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:59:56.302170 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:59:56.302170 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:59:56.302170 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:59:56.302170 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:59:56.302170 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:59:56.302170 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:59:56.302170 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:59:56.302170 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:59:56.302170 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:59:56.302170 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:59:56.302170 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:59:56.302170 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:59:56.302170 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:59:56.302170 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:59:56.309869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:59:56.309869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:59:56.309869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:59:56.309869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:59:56.309869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:59:56.309869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:59:56.309869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:59:56.309869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:59:56.309869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:59:56.309869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:59:56.309869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:59:56.309869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:59:56.309869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:59:56.309869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:59:56.309869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:59:56.309869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:59:56.309869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:59:56.310890 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:59:56.310890 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:59:56.310890 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:59:56.310890 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 630/1265] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:59:56.311120 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d246bc4-5d51-4d78-9630-89c41bf3fd02 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:56.390313 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:56.409558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d246bc4-5d51-4d78-9630-89c41bf3fd02 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:56.442074 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08238d79-3733-4385-9a12-f1f99def8dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:56.443298 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08238d79-3733-4385-9a12-f1f99def8dbd None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:56.443575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08238d79-3733-4385-9a12-f1f99def8dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:56.443844 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08238d79-3733-4385-9a12-f1f99def8dbd None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:56.444475 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08238d79-3733-4385-9a12-f1f99def8dbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:56.444773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08238d79-3733-4385-9a12-f1f99def8dbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:56.446133 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08238d79-3733-4385-9a12-f1f99def8dbd None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:56.457489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 636/1266] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:56.464031 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355e12e-53c0-4ef8-ac27-3c609bd52ed1 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:56.559979 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355e12e-53c0-4ef8-ac27-3c609bd52ed1 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:56.579611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:56.593615 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf68e02-727a-4357-8785-2a448d249349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:56.594238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf68e02-727a-4357-8785-2a448d249349 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:56.594542 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf68e02-727a-4357-8785-2a448d249349 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:56.594811 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf68e02-727a-4357-8785-2a448d249349 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:56.602185 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf68e02-727a-4357-8785-2a448d249349 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:56.603647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf68e02-727a-4357-8785-2a448d249349 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:56.614272 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-ccf68e02-727a-4357-8785-2a448d249349 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 07:59:56.614272 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:59:56.614272 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:59:56.614272 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:59:56.614272 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:59:56.614272 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:59:56.614272 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:59:56.614272 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:59:56.614272 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:59:56.614272 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:59:56.614272 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:59:56.614272 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:59:56.614272 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:59:56.614272 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:59:56.614272 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:59:56.614272 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:59:56.615374 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:59:56.615374 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:59:56.615374 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:59:56.615374 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:59:56.615374 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:59:56.615374 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:59:56.615374 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:59:56.615374 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:59:56.615374 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:59:56.615374 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:59:56.615374 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:59:56.615374 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:59:56.615374 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:59:56.615374 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:59:56.615374 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:59:56.615374 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:59:56.615374 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:59:56.615374 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:59:56.616327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:59:56.616327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:59:56.616327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:59:56.616327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:59:56.616327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:59:56.616327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:59:56.616327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:59:56.616327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:59:56.616327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 07:59:56.616327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:59:56.616327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 631/1267] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:59:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:59:56.621397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08238d79-3733-4385-9a12-f1f99def8dbd None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:56.719243 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08238d79-3733-4385-9a12-f1f99def8dbd None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:56.752330 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1785f3-08c5-4ef3-8667-26b2f3b4828d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:56.752933 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1785f3-08c5-4ef3-8667-26b2f3b4828d None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:56.753208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1785f3-08c5-4ef3-8667-26b2f3b4828d None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:56.753473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1785f3-08c5-4ef3-8667-26b2f3b4828d None admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:56.754183 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1785f3-08c5-4ef3-8667-26b2f3b4828d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:56.754510 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1785f3-08c5-4ef3-8667-26b2f3b4828d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:56.756490 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1785f3-08c5-4ef3-8667-26b2f3b4828d None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:56.764787 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:56.773709 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 637/1268] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Aug 23 07:59:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:56.779406 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf68e02-727a-4357-8785-2a448d249349 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:56.875480 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf68e02-727a-4357-8785-2a448d249349 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:56.907249 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac2591-5e06-4119-b00b-dd2790de60c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:56.907856 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac2591-5e06-4119-b00b-dd2790de60c1 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:56.908138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac2591-5e06-4119-b00b-dd2790de60c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:56.908407 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac2591-5e06-4119-b00b-dd2790de60c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:56.918479 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac2591-5e06-4119-b00b-dd2790de60c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:56.919860 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac2591-5e06-4119-b00b-dd2790de60c1 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:56.933930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-76ac2591-5e06-4119-b00b-dd2790de60c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:59:56.933930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:59:56.933930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:59:56.933930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:59:56.933930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:59:56.933930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:59:56.933930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:59:56.933930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:59:56.933930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:59:56.933930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:59:56.933930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:59:56.933930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:59:56.933930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:59:56.933930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:59:56.933930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:59:56.933930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:59:56.939310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:59:56.939310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:59:56.939310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:59:56.939310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:59:56.939310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:59:56.939310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:59:56.939310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:59:56.939310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:59:56.939310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:59:56.939310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:59:56.939310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:59:56.939310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:59:56.939310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:59:56.939310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:59:56.939310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:59:56.939310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:59:56.939310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:59:56.940346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:59:56.940346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:59:56.940346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:59:56.940346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 632/1269] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 07:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:59:56.941046 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1785f3-08c5-4ef3-8667-26b2f3b4828d None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:57.041704 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1785f3-08c5-4ef3-8667-26b2f3b4828d None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:57.076390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2c51c-7261-4124-9139-79023e41e502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:57.076983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2c51c-7261-4124-9139-79023e41e502 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:57.077261 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2c51c-7261-4124-9139-79023e41e502 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:57.077531 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2c51c-7261-4124-9139-79023e41e502 None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:57.078156 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2c51c-7261-4124-9139-79023e41e502 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:57.078488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2c51c-7261-4124-9139-79023e41e502 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:57.079845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2c51c-7261-4124-9139-79023e41e502 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:57.091452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 638/1270] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 07:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:57.097224 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac2591-5e06-4119-b00b-dd2790de60c1 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:57.128688 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:57.195770 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac2591-5e06-4119-b00b-dd2790de60c1 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:57.229434 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3931f7-dcf7-46de-bea2-d13e18e619fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:57.230054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3931f7-dcf7-46de-bea2-d13e18e619fe None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:57.230365 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3931f7-dcf7-46de-bea2-d13e18e619fe None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:57.230642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3931f7-dcf7-46de-bea2-d13e18e619fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:57.237163 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3931f7-dcf7-46de-bea2-d13e18e619fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:57.238628 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3931f7-dcf7-46de-bea2-d13e18e619fe None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:57.250308 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-5b3931f7-dcf7-46de-bea2-d13e18e619fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:59:57.250308 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:59:57.250308 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:59:57.250308 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:59:57.250308 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:59:57.250308 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:59:57.250308 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:59:57.250308 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:59:57.250308 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:59:57.250308 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:59:57.250308 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:59:57.250308 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:59:57.250308 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:59:57.250308 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:59:57.250308 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:59:57.251366 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:59:57.251366 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:59:57.251366 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:59:57.251366 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:59:57.251366 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:59:57.251366 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:59:57.251366 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:59:57.251366 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:59:57.251366 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 07:59:57.251366 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:59:57.251366 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:59:57.251366 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:59:57.251366 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:59:57.251366 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:59:57.251366 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:59:57.251366 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:59:57.251366 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:59:57.252480 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:59:57.252480 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:59:57.252480 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:59:57.252480 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:59:57.252480 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:59:57.252480 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:59:57.252480 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:59:57.252480 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 07:59:57.252480 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 633/1271] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 07:59:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:59:57.257343 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2c51c-7261-4124-9139-79023e41e502 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:57.323826 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:57.365146 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2c51c-7261-4124-9139-79023e41e502 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:57.397980 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e8cdf-04d9-4fa4-8af8-f66938ff7a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:57.398604 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e8cdf-04d9-4fa4-8af8-f66938ff7a7d None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:57.398885 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e8cdf-04d9-4fa4-8af8-f66938ff7a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:57.399159 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e8cdf-04d9-4fa4-8af8-f66938ff7a7d None admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:57.399840 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e8cdf-04d9-4fa4-8af8-f66938ff7a7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:59:57.400144 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e8cdf-04d9-4fa4-8af8-f66938ff7a7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:57.401561 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e8cdf-04d9-4fa4-8af8-f66938ff7a7d None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:57.413735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 639/1272] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 07:59:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:59:57.419701 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3931f7-dcf7-46de-bea2-d13e18e619fe None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:59:57.509643 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:59:57.518022 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3931f7-dcf7-46de-bea2-d13e18e619fe None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:59:57.550769 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9362ce-481e-4702-a895-87859c4596ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:59:57.551412 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9362ce-481e-4702-a895-87859c4596ff None admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:57.552271 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9362ce-481e-4702-a895-87859c4596ff None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:57.552527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9362ce-481e-4702-a895-87859c4596ff None admin] PATH_INFO: `/v3/projects/a80ab70ab6b9415c98017d05512c33eb/users/8e92560dd9da4c7cbcac5a84bcaca483/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:57.554457 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9362ce-481e-4702-a895-87859c4596ff None admin] RBAC: Authorizing `identity:create_grant(project_id=a80ab70ab6b9415c98017d05512c33eb, user_id=8e92560dd9da4c7cbcac5a84bcaca483, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:59:57.555890 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9362ce-481e-4702-a895-87859c4596ff None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:59:57.725702 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 634/1273] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 23 07:59:57 2022] PUT /identity/v3/projects/a80ab70ab6b9415c98017d05512c33eb/users/8e92560dd9da4c7cbcac5a84bcaca483/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:59:59.641334 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31b562-7a5d-4965-bac9-c382b53ccce3 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:59.641874 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31b562-7a5d-4965-bac9-c382b53ccce3 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:59.641874 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31b562-7a5d-4965-bac9-c382b53ccce3 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:59.643438 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 640/1274] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 07:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:59:59.649221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f5f1f-8d22-4a7d-bd82-ee3309cf4e2c None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:59:59.649609 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f5f1f-8d22-4a7d-bd82-ee3309cf4e2c None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:59:59.649789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f5f1f-8d22-4a7d-bd82-ee3309cf4e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:59:59.667692 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-2e6f5f1f-8d22-4a7d-bd82-ee3309cf4e2c None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:59:59.669813 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-2e6f5f1f-8d22-4a7d-bd82-ee3309cf4e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:59:59.733612 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 635/1275] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 07:59:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 08:00:00.004722 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31b562-7a5d-4965-bac9-c382b53ccce3 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:00:00.104127 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31b562-7a5d-4965-bac9-c382b53ccce3 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:00:00.121770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:00:00.138698 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0d603-91a7-4aa7-a3a8-41f779d025c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:00:00.139319 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0d603-91a7-4aa7-a3a8-41f779d025c7 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:00.139605 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0d603-91a7-4aa7-a3a8-41f779d025c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:00.139879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0d603-91a7-4aa7-a3a8-41f779d025c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:00.150178 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0d603-91a7-4aa7-a3a8-41f779d025c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 08:00:00.155112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-c7a0d603-91a7-4aa7-a3a8-41f779d025c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 08:00:00.155112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 08:00:00.155112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 08:00:00.155112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 08:00:00.155112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 08:00:00.155112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 08:00:00.155112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 08:00:00.155112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 08:00:00.155112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 08:00:00.155112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 08:00:00.155112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 08:00:00.155112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 08:00:00.155112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 08:00:00.155112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 08:00:00.155112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 08:00:00.155112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 08:00:00.161304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 08:00:00.161304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 08:00:00.161304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 08:00:00.161304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 08:00:00.161304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 08:00:00.161304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 08:00:00.161304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 08:00:00.161304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 08:00:00.161304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 08:00:00.161304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 08:00:00.161304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 08:00:00.161304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 08:00:00.161304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 08:00:00.161304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 08:00:00.161304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 08:00:00.161304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 08:00:00.162218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 08:00:00.162218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 08:00:00.162218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 08:00:00.162218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 08:00:00.162218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 08:00:00.162218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 08:00:00.162218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 08:00:00.162218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 08:00:00.162218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 08:00:00.162218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 08:00:00.162218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 08:00:00.162218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 08:00:00.162218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 641/1276] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 23 08:00:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 08:00:00.162974 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f5f1f-8d22-4a7d-bd82-ee3309cf4e2c None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:00:00.247312 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:00:00.271005 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f5f1f-8d22-4a7d-bd82-ee3309cf4e2c None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:00:00.297427 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af3c4d-6e50-452e-94e5-496fecc073ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:00:00.298024 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af3c4d-6e50-452e-94e5-496fecc073ea None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:00.298321 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af3c4d-6e50-452e-94e5-496fecc073ea None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:00.305547 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af3c4d-6e50-452e-94e5-496fecc073ea None admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:00.305547 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af3c4d-6e50-452e-94e5-496fecc073ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:00:00.305547 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af3c4d-6e50-452e-94e5-496fecc073ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:00:00.305547 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af3c4d-6e50-452e-94e5-496fecc073ea None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:00:00.309202 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 636/1277] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 23 08:00:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:00:00.315205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0d603-91a7-4aa7-a3a8-41f779d025c7 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:00:00.416137 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0d603-91a7-4aa7-a3a8-41f779d025c7 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:00:00.449541 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e2b87-1916-45fd-a103-feb4940219fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:00:00.450160 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e2b87-1916-45fd-a103-feb4940219fe None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:00.450488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e2b87-1916-45fd-a103-feb4940219fe None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:00.450761 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e2b87-1916-45fd-a103-feb4940219fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:00.460468 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e2b87-1916-45fd-a103-feb4940219fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:00:00.461949 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e2b87-1916-45fd-a103-feb4940219fe None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:00:00.476383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-aa8e2b87-1916-45fd-a103-feb4940219fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 08:00:00.476383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 08:00:00.476383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 08:00:00.476383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 08:00:00.476383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 08:00:00.476383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 08:00:00.476383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 08:00:00.476383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 08:00:00.476383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 08:00:00.476383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 08:00:00.476383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 08:00:00.476383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 08:00:00.476383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 08:00:00.476383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 08:00:00.476383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 08:00:00.476383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 08:00:00.477575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 08:00:00.477575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 08:00:00.477575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 08:00:00.477575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 08:00:00.477575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 08:00:00.477575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 08:00:00.477575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 08:00:00.477575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 08:00:00.477575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 08:00:00.477575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 08:00:00.477575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 08:00:00.477575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 08:00:00.477575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 08:00:00.477575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 08:00:00.477575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 08:00:00.477575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 08:00:00.477575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 08:00:00.478752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 08:00:00.478752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 08:00:00.478752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 08:00:00.478752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 642/1278] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 08:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 08:00:00.483573 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af3c4d-6e50-452e-94e5-496fecc073ea None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:00:00.585730 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af3c4d-6e50-452e-94e5-496fecc073ea None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:00:00.618385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ed3dc-3589-4b0a-a978-6abfd07abc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:00:00.618971 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ed3dc-3589-4b0a-a978-6abfd07abc8a None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:00.619249 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ed3dc-3589-4b0a-a978-6abfd07abc8a None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:00.619521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ed3dc-3589-4b0a-a978-6abfd07abc8a None admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:00.620159 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ed3dc-3589-4b0a-a978-6abfd07abc8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:00:00.620459 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ed3dc-3589-4b0a-a978-6abfd07abc8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:00:00.621824 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ed3dc-3589-4b0a-a978-6abfd07abc8a None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:00:00.634014 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 637/1279] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 08:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:00:00.640024 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e2b87-1916-45fd-a103-feb4940219fe None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:00:00.671456 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:00:00.738821 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e2b87-1916-45fd-a103-feb4940219fe None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:00:00.771854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eccd85-0736-4410-bda4-e14c913a5d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:00:00.772549 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eccd85-0736-4410-bda4-e14c913a5d55 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:00.772835 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eccd85-0736-4410-bda4-e14c913a5d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:00.773112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eccd85-0736-4410-bda4-e14c913a5d55 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:00.780766 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eccd85-0736-4410-bda4-e14c913a5d55 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:00:00.782217 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eccd85-0736-4410-bda4-e14c913a5d55 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:00:00.793429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-c6eccd85-0736-4410-bda4-e14c913a5d55 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 08:00:00.793429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 08:00:00.793429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 08:00:00.793429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 08:00:00.793429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 08:00:00.793429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 08:00:00.793429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 08:00:00.793429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 08:00:00.793429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 08:00:00.793429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 08:00:00.793429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 08:00:00.793429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 08:00:00.793429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 08:00:00.793429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 08:00:00.793429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 08:00:00.793429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 08:00:00.794599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 08:00:00.794599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 08:00:00.794599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 08:00:00.794599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 08:00:00.794599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 08:00:00.794599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 08:00:00.794599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 08:00:00.794599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 08:00:00.794599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 08:00:00.794599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 08:00:00.794599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 08:00:00.794599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 08:00:00.794599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 08:00:00.794599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 08:00:00.794599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 08:00:00.794599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 08:00:00.794599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 08:00:00.794599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 08:00:00.795964 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 08:00:00.795964 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 08:00:00.795964 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 08:00:00.795964 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 08:00:00.795964 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 08:00:00.795964 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 08:00:00.795964 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 08:00:00.795964 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 08:00:00.795964 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 08:00:00.795964 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 08:00:00.795964 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 643/1280] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 08:00:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 08:00:00.800373 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ed3dc-3589-4b0a-a978-6abfd07abc8a None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:00:00.804691 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:00:00.897440 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ed3dc-3589-4b0a-a978-6abfd07abc8a None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:00:00.929396 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195954f-05e6-4f76-918b-e95493b7ab37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:00:00.929995 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195954f-05e6-4f76-918b-e95493b7ab37 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:00.930275 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195954f-05e6-4f76-918b-e95493b7ab37 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:00.930578 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195954f-05e6-4f76-918b-e95493b7ab37 None admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:00.931295 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195954f-05e6-4f76-918b-e95493b7ab37 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:00:00.931601 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195954f-05e6-4f76-918b-e95493b7ab37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:00:00.933030 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195954f-05e6-4f76-918b-e95493b7ab37 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:00:00.950215 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 638/1281] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Aug 23 08:00:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:00:00.956038 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eccd85-0736-4410-bda4-e14c913a5d55 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:00:01.045344 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:00:01.055084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eccd85-0736-4410-bda4-e14c913a5d55 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:00:01.087305 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb67d5f-a233-42e4-972f-d2bc2f286dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:00:01.087903 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb67d5f-a233-42e4-972f-d2bc2f286dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:01.088183 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb67d5f-a233-42e4-972f-d2bc2f286dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:01.088452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb67d5f-a233-42e4-972f-d2bc2f286dc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:01.154707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb67d5f-a233-42e4-972f-d2bc2f286dc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:00:01.156080 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb67d5f-a233-42e4-972f-d2bc2f286dc0 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:00:01.241496 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:00:01.251600 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 644/1282] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 23 08:00:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 08:00:01.257670 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195954f-05e6-4f76-918b-e95493b7ab37 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:00:01.339075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:00:01.376147 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195954f-05e6-4f76-918b-e95493b7ab37 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:00:01.408447 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469eee0-3b2c-49f0-9907-6ebfc8b4d748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:00:01.409029 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469eee0-3b2c-49f0-9907-6ebfc8b4d748 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:01.409309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469eee0-3b2c-49f0-9907-6ebfc8b4d748 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:01.409581 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469eee0-3b2c-49f0-9907-6ebfc8b4d748 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:01.419910 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469eee0-3b2c-49f0-9907-6ebfc8b4d748 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:00:01.421369 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469eee0-3b2c-49f0-9907-6ebfc8b4d748 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:00:01.435833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-b469eee0-3b2c-49f0-9907-6ebfc8b4d748 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 08:00:01.435833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 08:00:01.435833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 08:00:01.435833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 08:00:01.435833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 08:00:01.435833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 08:00:01.435833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 08:00:01.435833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 08:00:01.435833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 08:00:01.435833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 08:00:01.435833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 08:00:01.435833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 08:00:01.435833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 08:00:01.435833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 08:00:01.435833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 08:00:01.435833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 08:00:01.437012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 08:00:01.437012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 08:00:01.437012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 08:00:01.437012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 08:00:01.437012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 08:00:01.437012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 08:00:01.437012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 08:00:01.437012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 08:00:01.437012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 08:00:01.437012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 08:00:01.437012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 08:00:01.437012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 08:00:01.437012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 08:00:01.437012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 08:00:01.437012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 08:00:01.437012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 08:00:01.437012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 08:00:01.438120 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 08:00:01.438120 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 08:00:01.438120 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 08:00:01.438120 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 639/1283] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 08:00:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 08:00:01.442921 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb67d5f-a233-42e4-972f-d2bc2f286dc0 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:00:01.540990 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb67d5f-a233-42e4-972f-d2bc2f286dc0 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:00:01.574528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72e9c2-9e45-4de5-b4c1-a525693889df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:00:01.575118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72e9c2-9e45-4de5-b4c1-a525693889df None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:01.575395 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72e9c2-9e45-4de5-b4c1-a525693889df None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:01.575663 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72e9c2-9e45-4de5-b4c1-a525693889df None admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:01.576286 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72e9c2-9e45-4de5-b4c1-a525693889df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:00:01.576585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72e9c2-9e45-4de5-b4c1-a525693889df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:00:01.577937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72e9c2-9e45-4de5-b4c1-a525693889df None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:00:01.588735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 645/1284] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 23 08:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:00:01.594504 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469eee0-3b2c-49f0-9907-6ebfc8b4d748 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:00:01.695783 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469eee0-3b2c-49f0-9907-6ebfc8b4d748 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:00:01.709000 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:00:01.732724 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc129164-fa90-4a9b-9c4f-3a93c85a605b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:00:01.733388 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc129164-fa90-4a9b-9c4f-3a93c85a605b None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:01.733666 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc129164-fa90-4a9b-9c4f-3a93c85a605b None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:01.733938 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc129164-fa90-4a9b-9c4f-3a93c85a605b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:01.741065 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc129164-fa90-4a9b-9c4f-3a93c85a605b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:00:01.742575 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc129164-fa90-4a9b-9c4f-3a93c85a605b None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:00:01.753295 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application [None req-bc129164-fa90-4a9b-9c4f-3a93c85a605b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 08:00:01.753295 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 08:00:01.753295 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 08:00:01.753295 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 08:00:01.753295 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 08:00:01.753295 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 08:00:01.753295 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 08:00:01.753295 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 08:00:01.753295 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 08:00:01.753295 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 08:00:01.753295 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 08:00:01.753295 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 08:00:01.753295 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 08:00:01.753295 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 08:00:01.753295 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 08:00:01.754387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 08:00:01.754387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 08:00:01.754387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 08:00:01.754387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 08:00:01.754387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 08:00:01.754387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 08:00:01.754387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 08:00:01.754387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 08:00:01.754387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application with Lock( Aug 23 08:00:01.754387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 08:00:01.754387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._enter() Aug 23 08:00:01.754387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 08:00:01.754387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 08:00:01.754387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 08:00:01.754387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.creator() Aug 23 08:00:01.754387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 08:00:01.754387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application created_value = creator( Aug 23 08:00:01.755387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 08:00:01.755387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 08:00:01.755387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 08:00:01.755387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 08:00:01.755387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 08:00:01.755387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 08:00:01.755387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 08:00:01.755387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: ERROR keystone.server.flask.application Aug 23 08:00:01.755387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 640/1285] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 23 08:00:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 08:00:01.761778 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72e9c2-9e45-4de5-b4c1-a525693889df None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:00:01.811536 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:00:01.859460 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72e9c2-9e45-4de5-b4c1-a525693889df None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:00:01.893907 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0da9b-2c10-4e7c-9c66-e6c7a6aae135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:00:01.894539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0da9b-2c10-4e7c-9c66-e6c7a6aae135 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:01.894810 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0da9b-2c10-4e7c-9c66-e6c7a6aae135 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:01.895078 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0da9b-2c10-4e7c-9c66-e6c7a6aae135 None admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:01.895783 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0da9b-2c10-4e7c-9c66-e6c7a6aae135 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:00:01.896079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0da9b-2c10-4e7c-9c66-e6c7a6aae135 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:00:01.897488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0da9b-2c10-4e7c-9c66-e6c7a6aae135 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:00:01.908842 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 646/1286] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 23 08:00:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:00:01.915847 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc129164-fa90-4a9b-9c4f-3a93c85a605b None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:00:02.015888 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc129164-fa90-4a9b-9c4f-3a93c85a605b None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:00:02.049638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11035c1-66c8-4280-a36f-9866f2f71c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:00:02.050238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11035c1-66c8-4280-a36f-9866f2f71c02 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:02.050547 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11035c1-66c8-4280-a36f-9866f2f71c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:02.050825 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11035c1-66c8-4280-a36f-9866f2f71c02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:02.052229 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11035c1-66c8-4280-a36f-9866f2f71c02 None admin] RBAC: Adding query filter params (role.id=e905040849d04aadbb8da8b0d216c92c, scope.project.id=a80ab70ab6b9415c98017d05512c33eb, user.id=8e92560dd9da4c7cbcac5a84bcaca483) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:00:02.052546 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11035c1-66c8-4280-a36f-9866f2f71c02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:00:02.053977 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11035c1-66c8-4280-a36f-9866f2f71c02 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:00:02.059663 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 641/1287] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 23 08:00:01 2022] GET /identity/v3/role_assignments?user.id=8e92560dd9da4c7cbcac5a84bcaca483&scope.project.id=a80ab70ab6b9415c98017d05512c33eb&role.id=e905040849d04aadbb8da8b0d216c92c => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:00:04.000996 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea8942-571b-4731-a7f2-2ff03f60b9c9 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:04.001618 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea8942-571b-4731-a7f2-2ff03f60b9c9 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:04.001618 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea8942-571b-4731-a7f2-2ff03f60b9c9 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:04.003026 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 647/1288] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:00:04.008775 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fda7f-4979-4cff-adac-b7033e09b3fa None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:04.009236 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fda7f-4979-4cff-adac-b7033e09b3fa None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:04.009340 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fda7f-4979-4cff-adac-b7033e09b3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:04.027394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-e22fda7f-4979-4cff-adac-b7033e09b3fa None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:00:04.028579 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-e22fda7f-4979-4cff-adac-b7033e09b3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:00:04.056271 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:00:04.094147 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 642/1289] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:00:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 08:00:04.356906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea8942-571b-4731-a7f2-2ff03f60b9c9 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:00:04.457295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea8942-571b-4731-a7f2-2ff03f60b9c9 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:00:04.468659 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:00:04.492111 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cad09-056f-4b5f-85d3-d7050435e1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:00:04.492720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cad09-056f-4b5f-85d3-d7050435e1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:04.492997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cad09-056f-4b5f-85d3-d7050435e1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:04.494546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cad09-056f-4b5f-85d3-d7050435e1d8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:04.494546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584cad09-056f-4b5f-85d3-d7050435e1d8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:00:04.495231 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584cad09-056f-4b5f-85d3-d7050435e1d8 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:00:04.503750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-584cad09-056f-4b5f-85d3-d7050435e1d8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 08:00:04.503750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 08:00:04.503750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 08:00:04.503750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 08:00:04.503750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 08:00:04.503750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 08:00:04.503750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 08:00:04.503750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 08:00:04.503750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 08:00:04.503750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 08:00:04.503750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 08:00:04.503750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 08:00:04.503750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 08:00:04.503750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 08:00:04.503750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 08:00:04.503750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 08:00:04.503750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 08:00:04.505139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 08:00:04.505139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 08:00:04.505139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 08:00:04.505139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 08:00:04.505139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 08:00:04.505139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 08:00:04.505139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 08:00:04.505139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 08:00:04.505139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 08:00:04.505139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 08:00:04.505139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 08:00:04.505139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 08:00:04.505139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 08:00:04.505139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 08:00:04.505139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 08:00:04.505139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 08:00:04.506145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 08:00:04.506145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 08:00:04.506145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 08:00:04.506145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 08:00:04.506145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 08:00:04.506145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 08:00:04.506145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 08:00:04.506145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 08:00:04.506145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 08:00:04.506145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 08:00:04.506145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 08:00:04.506145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 08:00:04.506145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 08:00:04.506145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 08:00:04.506145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 648/1290] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 23 08:00:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 08:00:04.511078 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fda7f-4979-4cff-adac-b7033e09b3fa None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:00:04.606425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fda7f-4979-4cff-adac-b7033e09b3fa None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:00:04.640479 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd7750-b708-4414-8ceb-fa1fce205294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:00:04.640479 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd7750-b708-4414-8ceb-fa1fce205294 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:04.640479 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd7750-b708-4414-8ceb-fa1fce205294 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:04.640812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd7750-b708-4414-8ceb-fa1fce205294 None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:04.641208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd7750-b708-4414-8ceb-fa1fce205294 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:00:04.641513 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd7750-b708-4414-8ceb-fa1fce205294 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:00:04.642925 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd7750-b708-4414-8ceb-fa1fce205294 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:00:04.652987 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 643/1291] 10.222.0.57 () {56 vars in 1116 bytes} [Tue Aug 23 08:00:04 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:00:04.654094 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cad09-056f-4b5f-85d3-d7050435e1d8 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:00:04.753215 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cad09-056f-4b5f-85d3-d7050435e1d8 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:00:04.786608 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2c2ca-f426-4e58-b15e-5a9e403df025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:00:04.787205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2c2ca-f426-4e58-b15e-5a9e403df025 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:04.787486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2c2ca-f426-4e58-b15e-5a9e403df025 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:04.787759 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2c2ca-f426-4e58-b15e-5a9e403df025 None admin] PATH_INFO: `/v3/services` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:04.795289 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2c2ca-f426-4e58-b15e-5a9e403df025 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:00:04.795289 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2c2ca-f426-4e58-b15e-5a9e403df025 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:00:04.795289 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2c2ca-f426-4e58-b15e-5a9e403df025 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:00:04.795289 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 649/1292] 10.222.0.57 () {56 vars in 1116 bytes} [Tue Aug 23 08:00:04 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 08:00:06.673717 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f745e-4582-4235-a50d-14052dcdbd9a None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:06.674202 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f745e-4582-4235-a50d-14052dcdbd9a None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:06.674323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f745e-4582-4235-a50d-14052dcdbd9a None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:06.675634 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 644/1293] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:00:06.681697 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17617ee3-6b55-4f65-b6d7-4bf46da7f6ec None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:06.682165 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17617ee3-6b55-4f65-b6d7-4bf46da7f6ec None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:06.682262 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17617ee3-6b55-4f65-b6d7-4bf46da7f6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:06.700829 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-17617ee3-6b55-4f65-b6d7-4bf46da7f6ec None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:00:06.702022 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-17617ee3-6b55-4f65-b6d7-4bf46da7f6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:00:06.730966 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:00:06.768196 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 650/1294] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:00:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 08:00:07.036064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f745e-4582-4235-a50d-14052dcdbd9a None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:00:07.066148 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:00:07.145735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f745e-4582-4235-a50d-14052dcdbd9a None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:00:07.179479 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22153bdc-f283-4f49-8d08-3e6d41168e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:00:07.180077 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22153bdc-f283-4f49-8d08-3e6d41168e89 None admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:07.180365 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22153bdc-f283-4f49-8d08-3e6d41168e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:07.180637 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22153bdc-f283-4f49-8d08-3e6d41168e89 None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:07.181309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22153bdc-f283-4f49-8d08-3e6d41168e89 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:00:07.182707 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22153bdc-f283-4f49-8d08-3e6d41168e89 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:00:07.284916 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 645/1295] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 23 08:00:07 2022] POST /identity/v3/services => generated 246 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:00:09.205353 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce67e1b-ed3e-4f2a-9ad2-19e3e39042e2 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:09.205914 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce67e1b-ed3e-4f2a-9ad2-19e3e39042e2 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:09.206010 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce67e1b-ed3e-4f2a-9ad2-19e3e39042e2 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:09.208337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 651/1296] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:00:09.213236 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c72d0-49eb-456f-8dd7-9778158646eb None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:09.213651 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c72d0-49eb-456f-8dd7-9778158646eb None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:09.213794 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c72d0-49eb-456f-8dd7-9778158646eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:09.231655 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-a62c72d0-49eb-456f-8dd7-9778158646eb None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:00:09.232844 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a62c72d0-49eb-456f-8dd7-9778158646eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:00:09.311330 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 646/1297] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:00:09 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 08:00:09.614485 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce67e1b-ed3e-4f2a-9ad2-19e3e39042e2 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:00:09.744928 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce67e1b-ed3e-4f2a-9ad2-19e3e39042e2 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:00:09.784253 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16eb59-3eb1-45c5-b008-41d7ff33efd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:00:09.784884 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16eb59-3eb1-45c5-b008-41d7ff33efd0 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:09.785163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16eb59-3eb1-45c5-b008-41d7ff33efd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:09.785511 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16eb59-3eb1-45c5-b008-41d7ff33efd0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:09.786098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16eb59-3eb1-45c5-b008-41d7ff33efd0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:00:09.787507 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16eb59-3eb1-45c5-b008-41d7ff33efd0 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:00:09.796498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-7c16eb59-3eb1-45c5-b008-41d7ff33efd0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 08:00:09.796498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 08:00:09.796498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 08:00:09.796498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 08:00:09.796498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 08:00:09.796498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 08:00:09.796498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 08:00:09.796498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 08:00:09.796498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 08:00:09.796498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 08:00:09.796498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 08:00:09.796498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 08:00:09.796498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 08:00:09.796498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 08:00:09.796498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 08:00:09.796498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 08:00:09.796498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 08:00:09.797788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 08:00:09.797788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 08:00:09.797788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 08:00:09.797788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 08:00:09.797788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 08:00:09.797788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 08:00:09.797788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 08:00:09.797788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 08:00:09.797788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 08:00:09.797788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 08:00:09.797788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 08:00:09.797788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 08:00:09.797788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 08:00:09.797788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 08:00:09.797788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 08:00:09.797788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 08:00:09.798947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 08:00:09.798947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 08:00:09.798947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 08:00:09.798947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 08:00:09.798947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 08:00:09.798947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 08:00:09.798947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 08:00:09.798947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 08:00:09.798947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 08:00:09.798947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 08:00:09.798947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 08:00:09.798947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 08:00:09.798947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 08:00:09.798947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 08:00:09.798947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 652/1298] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 23 08:00:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 08:00:09.805027 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c72d0-49eb-456f-8dd7-9778158646eb None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:00:09.825109 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:00:09.916534 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c72d0-49eb-456f-8dd7-9778158646eb None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:00:09.950166 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f052c-f14d-4085-956d-e061002dc161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:00:09.950797 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f052c-f14d-4085-956d-e061002dc161 None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:09.951076 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f052c-f14d-4085-956d-e061002dc161 None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:09.951345 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f052c-f14d-4085-956d-e061002dc161 None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:09.952000 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f052c-f14d-4085-956d-e061002dc161 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:00:09.952299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f052c-f14d-4085-956d-e061002dc161 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:00:09.953683 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f052c-f14d-4085-956d-e061002dc161 None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:00:09.958705 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 647/1299] 10.222.0.57 () {56 vars in 1116 bytes} [Tue Aug 23 08:00:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:00:09.964912 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16eb59-3eb1-45c5-b008-41d7ff33efd0 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:00:09.996791 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:00:10.062650 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16eb59-3eb1-45c5-b008-41d7ff33efd0 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:00:10.096528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1fe93c-fa2e-4e6a-8045-40e54e1bc4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:00:10.097125 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fe93c-fa2e-4e6a-8045-40e54e1bc4b1 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:10.097406 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fe93c-fa2e-4e6a-8045-40e54e1bc4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:10.097680 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fe93c-fa2e-4e6a-8045-40e54e1bc4b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:10.098954 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1fe93c-fa2e-4e6a-8045-40e54e1bc4b1 None admin] RBAC: Adding query filter params (interface=public, service_id=06f216fe303a41b296cffdd21b037e05, region_id=RegionOne) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:00:10.099216 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1fe93c-fa2e-4e6a-8045-40e54e1bc4b1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:00:10.100576 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1fe93c-fa2e-4e6a-8045-40e54e1bc4b1 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:00:10.105431 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 653/1300] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Aug 23 08:00:09 2022] GET /identity/v3/endpoints?service_id=06f216fe303a41b296cffdd21b037e05&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:00:10.111192 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f052c-f14d-4085-956d-e061002dc161 None admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:00:10.190876 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:00:10.208387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f052c-f14d-4085-956d-e061002dc161 None admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:00:10.241951 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c6f31-802c-40c6-b389-dc2958943b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:00:10.242583 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c6f31-802c-40c6-b389-dc2958943b2a None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:10.242849 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c6f31-802c-40c6-b389-dc2958943b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:10.243126 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c6f31-802c-40c6-b389-dc2958943b2a None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:10.243779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c6f31-802c-40c6-b389-dc2958943b2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:00:10.245628 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c6f31-802c-40c6-b389-dc2958943b2a None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:00:10.252767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 648/1301] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Aug 23 08:00:10 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:00:12.166831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7ec5f-1f45-42c5-bb08-47370a0ca83c None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:12.167402 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7ec5f-1f45-42c5-bb08-47370a0ca83c None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:12.167402 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7ec5f-1f45-42c5-bb08-47370a0ca83c None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:12.168706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 654/1302] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:00:12.174085 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cb664-778d-42b7-9648-e740497294ba None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:12.174522 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cb664-778d-42b7-9648-e740497294ba None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:12.174738 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cb664-778d-42b7-9648-e740497294ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:12.193695 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-8b8cb664-778d-42b7-9648-e740497294ba None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:00:12.197444 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-8b8cb664-778d-42b7-9648-e740497294ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:00:12.259678 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 649/1303] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:00:12 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 08:00:12.534302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7ec5f-1f45-42c5-bb08-47370a0ca83c None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:00:12.630329 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:00:12.637120 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7ec5f-1f45-42c5-bb08-47370a0ca83c None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:00:12.669901 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86bc72-e2de-4db3-b654-aa5dfe563903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:00:12.670554 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86bc72-e2de-4db3-b654-aa5dfe563903 None admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:12.670833 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86bc72-e2de-4db3-b654-aa5dfe563903 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:12.671103 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86bc72-e2de-4db3-b654-aa5dfe563903 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:12.671668 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86bc72-e2de-4db3-b654-aa5dfe563903 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:00:12.673022 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86bc72-e2de-4db3-b654-aa5dfe563903 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:00:12.681913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application [None req-2c86bc72-e2de-4db3-b654-aa5dfe563903 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 08:00:12.681913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 08:00:12.681913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 08:00:12.681913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 08:00:12.681913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 08:00:12.681913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 08:00:12.681913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 08:00:12.681913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 08:00:12.681913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 08:00:12.681913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 08:00:12.681913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 08:00:12.681913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 08:00:12.681913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 08:00:12.681913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 08:00:12.681913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 08:00:12.681913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 08:00:12.681913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 08:00:12.683179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 08:00:12.683179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 08:00:12.683179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 08:00:12.683179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 08:00:12.683179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 08:00:12.683179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 08:00:12.683179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 08:00:12.683179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 08:00:12.683179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 08:00:12.683179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 08:00:12.683179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 08:00:12.683179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 08:00:12.683179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 08:00:12.683179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 08:00:12.683179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 08:00:12.683179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 08:00:12.684278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 08:00:12.684278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application with Lock( Aug 23 08:00:12.684278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 08:00:12.684278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self._enter() Aug 23 08:00:12.684278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 08:00:12.684278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 08:00:12.684278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 08:00:12.684278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application return self.creator() Aug 23 08:00:12.684278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 08:00:12.684278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application created_value = creator( Aug 23 08:00:12.684278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 08:00:12.684278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 08:00:12.684278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 08:00:12.684278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: ERROR keystone.server.flask.application Aug 23 08:00:12.684278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 655/1304] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 23 08:00:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 08:00:12.689147 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cb664-778d-42b7-9648-e740497294ba None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:00:12.764160 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:00:12.785307 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cb664-778d-42b7-9648-e740497294ba None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:00:12.817605 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d16f2-2435-4ce3-875f-131bd3b67e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:00:12.818169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d16f2-2435-4ce3-875f-131bd3b67e2d None admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:12.818488 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d16f2-2435-4ce3-875f-131bd3b67e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:12.818768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d16f2-2435-4ce3-875f-131bd3b67e2d None admin] PATH_INFO: `/v3/services` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:12.819392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d16f2-2435-4ce3-875f-131bd3b67e2d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:00:12.819695 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d16f2-2435-4ce3-875f-131bd3b67e2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:00:12.821079 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d16f2-2435-4ce3-875f-131bd3b67e2d None admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:00:12.827486 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 650/1305] 10.222.0.57 () {56 vars in 1116 bytes} [Tue Aug 23 08:00:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:00:12.832496 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86bc72-e2de-4db3-b654-aa5dfe563903 None admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:00:12.930010 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86bc72-e2de-4db3-b654-aa5dfe563903 None admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:00:12.962936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e5f7a-567f-4ecb-ac29-9cc5987d4cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:00:12.964152 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e5f7a-567f-4ecb-ac29-9cc5987d4cd3 None admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:00:12.964152 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e5f7a-567f-4ecb-ac29-9cc5987d4cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:00:12.964152 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e5f7a-567f-4ecb-ac29-9cc5987d4cd3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:00:12.964716 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e5f7a-567f-4ecb-ac29-9cc5987d4cd3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:00:12.966074 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e5f7a-567f-4ecb-ac29-9cc5987d4cd3 None admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:00:13.062806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 656/1306] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:00:12 2022] POST /identity/v3/endpoints => generated 331 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:00:22.850510 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=30 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:00:23.057879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:07:50.996009 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491e490-ec49-4866-9fc5-4cb288dd203d None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:07:50.996841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491e490-ec49-4866-9fc5-4cb288dd203d None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:07:50.997275 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491e490-ec49-4866-9fc5-4cb288dd203d None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:07:50.998813 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 651/1307] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:07:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:07:51.004982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222763de-b7b5-4bd9-bb2a-65560e099588 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:07:51.012517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222763de-b7b5-4bd9-bb2a-65560e099588 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:07:51.012517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222763de-b7b5-4bd9-bb2a-65560e099588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:07:51.083683 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-222763de-b7b5-4bd9-bb2a-65560e099588 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:07:51.085181 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-222763de-b7b5-4bd9-bb2a-65560e099588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:07:51.210808 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 657/1308] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:07:51.500702 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01132ea3-33b1-45c8-9e7f-666cffdae654 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:07:51.500904 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01132ea3-33b1-45c8-9e7f-666cffdae654 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:07:51.501150 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01132ea3-33b1-45c8-9e7f-666cffdae654 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:07:51.503058 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 652/1309] 10.222.0.57 () {54 vars in 965 bytes} [Tue Aug 23 08:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:07:51.509182 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132361a-3835-494c-913c-c09166c253ec None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:07:51.509696 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132361a-3835-494c-913c-c09166c253ec None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:07:51.510212 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132361a-3835-494c-913c-c09166c253ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:07:51.590463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-b132361a-3835-494c-913c-c09166c253ec None None] MFA Rules not processed for user `4239cee14f954e95b4a6b0af2e8799b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:07:51.591976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-b132361a-3835-494c-913c-c09166c253ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:07:51.613601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:07:51.671964 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 658/1310] 10.222.0.57 () {58 vars in 1062 bytes} [Tue Aug 23 08:07:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:07:51.682227 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01132ea3-33b1-45c8-9e7f-666cffdae654 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:07:51.684162 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-01132ea3-33b1-45c8-9e7f-666cffdae654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:07:51.803819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01132ea3-33b1-45c8-9e7f-666cffdae654 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:07:51.878644 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56a53d-7465-4eea-950a-bccdf00fa507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:07:51.879255 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56a53d-7465-4eea-950a-bccdf00fa507 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:07:51.879535 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56a53d-7465-4eea-950a-bccdf00fa507 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:07:51.879807 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56a53d-7465-4eea-950a-bccdf00fa507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:07:51.881389 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-7d56a53d-7465-4eea-950a-bccdf00fa507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:07:51.939521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:07:52.002383 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56a53d-7465-4eea-950a-bccdf00fa507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:07:52.003860 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56a53d-7465-4eea-950a-bccdf00fa507 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:07:52.024901 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 653/1311] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:07:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:07:54.289015 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0029f4-cda7-4c28-b094-b32313fc6be2 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:07:54.289574 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0029f4-cda7-4c28-b094-b32313fc6be2 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:07:54.289574 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0029f4-cda7-4c28-b094-b32313fc6be2 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:07:54.290983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 659/1312] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:07:54.296992 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e072e6e-a41d-4d2e-9dd4-af81e229b9c9 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:07:54.297518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e072e6e-a41d-4d2e-9dd4-af81e229b9c9 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:07:54.297607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e072e6e-a41d-4d2e-9dd4-af81e229b9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:07:54.385653 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-7e072e6e-a41d-4d2e-9dd4-af81e229b9c9 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:07:54.386977 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-7e072e6e-a41d-4d2e-9dd4-af81e229b9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:07:54.501133 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 654/1313] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:07:54.790776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0029f4-cda7-4c28-b094-b32313fc6be2 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:07:54.792346 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-ab0029f4-cda7-4c28-b094-b32313fc6be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:07:54.899523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0029f4-cda7-4c28-b094-b32313fc6be2 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:07:54.970793 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:07:54.973775 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ef4d7-64d5-4405-9ece-c40c205a30da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:07:54.974420 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ef4d7-64d5-4405-9ece-c40c205a30da service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:07:54.974706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ef4d7-64d5-4405-9ece-c40c205a30da service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:07:54.975009 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ef4d7-64d5-4405-9ece-c40c205a30da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:07:54.976609 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-ae8ef4d7-64d5-4405-9ece-c40c205a30da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:07:55.085925 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ef4d7-64d5-4405-9ece-c40c205a30da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:07:55.087428 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ef4d7-64d5-4405-9ece-c40c205a30da service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:07:55.105711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 660/1314] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:07:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:07:57.526488 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46b29a-4d44-4927-9e93-584776f5f9a5 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:07:57.527027 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46b29a-4d44-4927-9e93-584776f5f9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:07:57.527027 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46b29a-4d44-4927-9e93-584776f5f9a5 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:07:57.528371 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 655/1315] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:07:57.533733 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a6a60-03c2-406c-839c-93fc27737110 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:07:57.534142 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a6a60-03c2-406c-839c-93fc27737110 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:07:57.534276 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a6a60-03c2-406c-839c-93fc27737110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:07:57.599156 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-b93a6a60-03c2-406c-839c-93fc27737110 None None] MFA Rules not processed for user `f209424acda544bf9bd23d4759bc040d`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:07:57.600348 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-b93a6a60-03c2-406c-839c-93fc27737110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:07:57.650563 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:07:57.698888 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 661/1316] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:07:57 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:07:57.984822 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46b29a-4d44-4927-9e93-584776f5f9a5 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:07:57.986429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-7d46b29a-4d44-4927-9e93-584776f5f9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:07:57.996135 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:07:58.089564 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46b29a-4d44-4927-9e93-584776f5f9a5 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:07:58.162450 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaae98e-18c6-4b51-9aa5-5011e5f96cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:07:58.163059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaae98e-18c6-4b51-9aa5-5011e5f96cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:07:58.163341 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaae98e-18c6-4b51-9aa5-5011e5f96cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:07:58.163612 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaae98e-18c6-4b51-9aa5-5011e5f96cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:07:58.165204 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-bbaae98e-18c6-4b51-9aa5-5011e5f96cd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:07:58.235081 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:07:58.283063 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaae98e-18c6-4b51-9aa5-5011e5f96cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:07:58.284518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaae98e-18c6-4b51-9aa5-5011e5f96cd9 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:07:58.303374 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 656/1317] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:07:57 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:08:01.054111 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0558d86-cde2-4036-8dc9-b62ed72fe684 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:01.054684 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0558d86-cde2-4036-8dc9-b62ed72fe684 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:01.054684 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0558d86-cde2-4036-8dc9-b62ed72fe684 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:01.056035 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 662/1318] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:08:01.061363 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de6c58-17d6-472b-ae69-4369af933c0a None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:01.062512 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de6c58-17d6-472b-ae69-4369af933c0a None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:01.062512 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de6c58-17d6-472b-ae69-4369af933c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:01.127211 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-45de6c58-17d6-472b-ae69-4369af933c0a None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:08:01.128522 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-45de6c58-17d6-472b-ae69-4369af933c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:01.221420 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 657/1319] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:08:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:08:01.504751 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0558d86-cde2-4036-8dc9-b62ed72fe684 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:08:01.506349 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-f0558d86-cde2-4036-8dc9-b62ed72fe684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:01.607224 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0558d86-cde2-4036-8dc9-b62ed72fe684 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:08:01.678917 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d72dea-a321-40b4-839d-912e1ca621cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:08:01.679521 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d72dea-a321-40b4-839d-912e1ca621cf service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:01.679801 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d72dea-a321-40b4-839d-912e1ca621cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:01.680073 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d72dea-a321-40b4-839d-912e1ca621cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:01.681645 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-31d72dea-a321-40b4-839d-912e1ca621cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:01.689785 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:01.788369 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d72dea-a321-40b4-839d-912e1ca621cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:08:01.789742 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d72dea-a321-40b4-839d-912e1ca621cf service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:08:01.807983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 663/1320] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:08:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:08:04.614821 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b715d-b1e8-44e4-b191-89db7612e159 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:04.615396 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b715d-b1e8-44e4-b191-89db7612e159 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:04.615490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b715d-b1e8-44e4-b191-89db7612e159 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:04.616804 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 658/1321] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:08:04.622130 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f24e60-bd85-421e-8fe8-5519f368cd75 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:04.622562 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f24e60-bd85-421e-8fe8-5519f368cd75 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:04.622858 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f24e60-bd85-421e-8fe8-5519f368cd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:04.694042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-16f24e60-bd85-421e-8fe8-5519f368cd75 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:08:04.695303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-16f24e60-bd85-421e-8fe8-5519f368cd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:04.753918 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:04.793035 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 664/1322] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:08:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:08:05.078344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b715d-b1e8-44e4-b191-89db7612e159 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:08:05.079961 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-462b715d-b1e8-44e4-b191-89db7612e159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:05.216548 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:05.303143 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b715d-b1e8-44e4-b191-89db7612e159 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:08:05.377327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70df93-f974-4168-b285-0af3dbae8321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:08:05.377937 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70df93-f974-4168-b285-0af3dbae8321 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:05.378216 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70df93-f974-4168-b285-0af3dbae8321 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:05.378517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70df93-f974-4168-b285-0af3dbae8321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:05.380102 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-fa70df93-f974-4168-b285-0af3dbae8321 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:05.450368 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:05.490126 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70df93-f974-4168-b285-0af3dbae8321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:08:05.491589 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70df93-f974-4168-b285-0af3dbae8321 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:08:05.509555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 659/1323] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:08:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:08:07.475897 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533dbe6-68a7-4035-ade0-7d25a49fac9f None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:07.476474 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533dbe6-68a7-4035-ade0-7d25a49fac9f None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:07.476474 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533dbe6-68a7-4035-ade0-7d25a49fac9f None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:07.477778 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 665/1324] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:08:07.483294 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e7124-3107-43ff-a7ea-6bc1db5c47e5 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:07.483730 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e7124-3107-43ff-a7ea-6bc1db5c47e5 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:07.484113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e7124-3107-43ff-a7ea-6bc1db5c47e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:07.549211 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-0f8e7124-3107-43ff-a7ea-6bc1db5c47e5 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:08:07.550458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-0f8e7124-3107-43ff-a7ea-6bc1db5c47e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:07.646521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 660/1325] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:08:07.956660 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe15fd-26c6-421f-961f-4209d71aa785 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:07.956957 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe15fd-26c6-421f-961f-4209d71aa785 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:07.957292 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe15fd-26c6-421f-961f-4209d71aa785 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:07.958685 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 666/1326] 10.222.0.57 () {54 vars in 965 bytes} [Tue Aug 23 08:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:08:07.965015 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4683f6-0d3d-4cd7-9d0a-00a64d1090eb None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:07.965384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4683f6-0d3d-4cd7-9d0a-00a64d1090eb None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:07.965735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4683f6-0d3d-4cd7-9d0a-00a64d1090eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:07.997024 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:08.040765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-1a4683f6-0d3d-4cd7-9d0a-00a64d1090eb None None] MFA Rules not processed for user `4239cee14f954e95b4a6b0af2e8799b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:08:08.041948 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-1a4683f6-0d3d-4cd7-9d0a-00a64d1090eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:08.116583 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 661/1327] 10.222.0.57 () {58 vars in 1062 bytes} [Tue Aug 23 08:08:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:08:08.126452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe15fd-26c6-421f-961f-4209d71aa785 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:08:08.127968 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-12fe15fd-26c6-421f-961f-4209d71aa785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:08.236391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe15fd-26c6-421f-961f-4209d71aa785 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:08:08.318110 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c2ba6-1b43-4172-a0fe-63689df0bcbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:08:08.318659 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c2ba6-1b43-4172-a0fe-63689df0bcbc service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:08.318993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c2ba6-1b43-4172-a0fe-63689df0bcbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:08.319264 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c2ba6-1b43-4172-a0fe-63689df0bcbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:08.323977 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-e20c2ba6-1b43-4172-a0fe-63689df0bcbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:08.338449 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:08.431328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c2ba6-1b43-4172-a0fe-63689df0bcbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:08:08.432788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c2ba6-1b43-4172-a0fe-63689df0bcbc service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:08:08.451499 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 667/1328] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:08:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:08:10.646788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e6295-bf68-4b36-bdef-fdbdc06be1d0 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:10.647304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e6295-bf68-4b36-bdef-fdbdc06be1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:10.647489 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e6295-bf68-4b36-bdef-fdbdc06be1d0 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:10.648671 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 662/1329] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:08:10.654094 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c8443-4d71-4673-977c-ebbebc221386 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:10.654584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c8443-4d71-4673-977c-ebbebc221386 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:10.655302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c8443-4d71-4673-977c-ebbebc221386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:10.733771 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-427c8443-4d71-4673-977c-ebbebc221386 None None] MFA Rules not processed for user `f209424acda544bf9bd23d4759bc040d`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:08:10.735110 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-427c8443-4d71-4673-977c-ebbebc221386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:10.808203 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:10.841222 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 668/1330] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:08:10 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:08:11.125423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e6295-bf68-4b36-bdef-fdbdc06be1d0 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:08:11.127385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-ee4e6295-bf68-4b36-bdef-fdbdc06be1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:11.240554 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e6295-bf68-4b36-bdef-fdbdc06be1d0 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:08:11.262173 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:11.324461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f0987-e8eb-46d4-9e22-7a770673b440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:08:11.325079 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f0987-e8eb-46d4-9e22-7a770673b440 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:11.325360 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f0987-e8eb-46d4-9e22-7a770673b440 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:11.325633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f0987-e8eb-46d4-9e22-7a770673b440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:11.327888 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-284f0987-e8eb-46d4-9e22-7a770673b440 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:11.438135 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f0987-e8eb-46d4-9e22-7a770673b440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:08:11.439627 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f0987-e8eb-46d4-9e22-7a770673b440 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:08:11.458971 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 663/1331] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:08:11 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:08:13.939541 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848a89e-b408-40f5-8066-c1fe6c4e1fc6 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:13.940047 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848a89e-b408-40f5-8066-c1fe6c4e1fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:13.940047 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848a89e-b408-40f5-8066-c1fe6c4e1fc6 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:13.941336 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 669/1332] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:08:13.946941 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb630dc3-8700-4fb4-8b64-a49ed05fbb5f None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:13.947325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb630dc3-8700-4fb4-8b64-a49ed05fbb5f None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:13.947486 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb630dc3-8700-4fb4-8b64-a49ed05fbb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:14.008778 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:14.011523 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-cb630dc3-8700-4fb4-8b64-a49ed05fbb5f None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:08:14.012717 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-cb630dc3-8700-4fb4-8b64-a49ed05fbb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:14.104762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 664/1333] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:08:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:08:14.387890 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848a89e-b408-40f5-8066-c1fe6c4e1fc6 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:08:14.390038 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-d848a89e-b408-40f5-8066-c1fe6c4e1fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:14.494503 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848a89e-b408-40f5-8066-c1fe6c4e1fc6 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:08:14.565260 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd977e-d56f-47e7-a540-128909b23114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:08:14.565882 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd977e-d56f-47e7-a540-128909b23114 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:14.566158 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd977e-d56f-47e7-a540-128909b23114 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:14.566456 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd977e-d56f-47e7-a540-128909b23114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:14.568035 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-76bd977e-d56f-47e7-a540-128909b23114 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:14.594516 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:14.675650 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd977e-d56f-47e7-a540-128909b23114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:08:14.677100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd977e-d56f-47e7-a540-128909b23114 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:08:14.695817 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 670/1334] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:08:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:08:16.659048 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f2bb4-63a1-4272-ab2b-b49acaa8863f None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:16.659537 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f2bb4-63a1-4272-ab2b-b49acaa8863f None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:16.659633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f2bb4-63a1-4272-ab2b-b49acaa8863f None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:16.660942 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 665/1335] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:08:16.666266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494cc16-fd35-464e-8b4d-2567543644cf None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:16.666719 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494cc16-fd35-464e-8b4d-2567543644cf None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:16.666855 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494cc16-fd35-464e-8b4d-2567543644cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:16.734678 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-4494cc16-fd35-464e-8b4d-2567543644cf None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:08:16.735947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-4494cc16-fd35-464e-8b4d-2567543644cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:16.808901 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:16.831458 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 671/1336] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:08:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:08:17.118307 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f2bb4-63a1-4272-ab2b-b49acaa8863f None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:08:17.119843 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-3c7f2bb4-63a1-4272-ab2b-b49acaa8863f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:17.221665 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f2bb4-63a1-4272-ab2b-b49acaa8863f None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:08:17.249612 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:17.295038 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdd0db-3c43-4681-968f-bc59364a97a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:08:17.295821 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdd0db-3c43-4681-968f-bc59364a97a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:17.296108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdd0db-3c43-4681-968f-bc59364a97a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:17.296381 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdd0db-3c43-4681-968f-bc59364a97a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:17.297973 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-dacdd0db-3c43-4681-968f-bc59364a97a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:17.405830 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacdd0db-3c43-4681-968f-bc59364a97a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:08:17.407237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacdd0db-3c43-4681-968f-bc59364a97a2 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:08:17.426883 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 666/1337] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:08:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:08:19.943311 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf99e76-97a2-4bec-9963-595c8b0e8671 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:19.943841 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf99e76-97a2-4bec-9963-595c8b0e8671 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:19.943841 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf99e76-97a2-4bec-9963-595c8b0e8671 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:19.945108 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 672/1338] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:08:19.950648 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbe44f-5dd1-4813-a970-0fabc64cd147 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:19.951698 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbe44f-5dd1-4813-a970-0fabc64cd147 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:19.951698 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbe44f-5dd1-4813-a970-0fabc64cd147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:20.015904 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-e3fbe44f-5dd1-4813-a970-0fabc64cd147 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:08:20.017097 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-e3fbe44f-5dd1-4813-a970-0fabc64cd147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:20.025073 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:20.110137 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 667/1339] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:08:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:08:20.392046 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf99e76-97a2-4bec-9963-595c8b0e8671 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:08:20.393626 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-cbf99e76-97a2-4bec-9963-595c8b0e8671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:20.498277 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf99e76-97a2-4bec-9963-595c8b0e8671 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:08:20.572487 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23abad-96c3-4763-bbea-c5caae25ff8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:08:20.573081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23abad-96c3-4763-bbea-c5caae25ff8c service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:20.573356 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23abad-96c3-4763-bbea-c5caae25ff8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:20.573625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23abad-96c3-4763-bbea-c5caae25ff8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:20.575235 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-de23abad-96c3-4763-bbea-c5caae25ff8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:20.609939 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:20.682142 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23abad-96c3-4763-bbea-c5caae25ff8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:08:20.683611 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23abad-96c3-4763-bbea-c5caae25ff8c service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:08:20.703244 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 673/1340] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:08:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:08:24.892453 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554564e7-78df-4644-a530-ab0b5672b3b6 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:24.893063 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554564e7-78df-4644-a530-ab0b5672b3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:24.893063 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554564e7-78df-4644-a530-ab0b5672b3b6 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:24.894369 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 668/1341] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:08:24.899591 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe8738-bc0d-42ad-86c6-c3d3a0d371ea None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:24.900033 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe8738-bc0d-42ad-86c6-c3d3a0d371ea None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:24.900130 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe8738-bc0d-42ad-86c6-c3d3a0d371ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:24.966795 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-a2fe8738-bc0d-42ad-86c6-c3d3a0d371ea None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:08:24.968012 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-a2fe8738-bc0d-42ad-86c6-c3d3a0d371ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:25.054456 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:25.066018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 674/1342] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:08:25.350610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554564e7-78df-4644-a530-ab0b5672b3b6 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:08:25.352175 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-554564e7-78df-4644-a530-ab0b5672b3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:25.456225 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554564e7-78df-4644-a530-ab0b5672b3b6 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:08:25.493355 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:25.530473 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f2113-c27b-4e00-8bd7-213944f76c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:08:25.531086 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f2113-c27b-4e00-8bd7-213944f76c12 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:25.531367 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f2113-c27b-4e00-8bd7-213944f76c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:25.531639 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f2113-c27b-4e00-8bd7-213944f76c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:25.533221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-c74f2113-c27b-4e00-8bd7-213944f76c12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:25.642497 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f2113-c27b-4e00-8bd7-213944f76c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:08:25.643932 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f2113-c27b-4e00-8bd7-213944f76c12 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:08:25.664678 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 669/1343] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:08:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:08:28.608314 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072f3b1-686e-4625-85fb-a81254a01020 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:28.608885 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072f3b1-686e-4625-85fb-a81254a01020 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:28.608885 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072f3b1-686e-4625-85fb-a81254a01020 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:28.610213 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 675/1344] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:08:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:08:28.615450 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa8440-037c-462f-8976-b0c29a4ac39f None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:28.615861 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa8440-037c-462f-8976-b0c29a4ac39f None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:28.616010 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa8440-037c-462f-8976-b0c29a4ac39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:28.683384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-38aa8440-037c-462f-8976-b0c29a4ac39f None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:08:28.684510 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-38aa8440-037c-462f-8976-b0c29a4ac39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:28.704408 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:28.789802 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 670/1345] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:08:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:08:29.072856 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072f3b1-686e-4625-85fb-a81254a01020 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:08:29.074523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-1072f3b1-686e-4625-85fb-a81254a01020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:29.188692 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072f3b1-686e-4625-85fb-a81254a01020 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:08:29.263841 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59daf5-a4ec-4186-88b4-1e23a0b2c248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:08:29.264449 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59daf5-a4ec-4186-88b4-1e23a0b2c248 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:29.264728 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59daf5-a4ec-4186-88b4-1e23a0b2c248 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:29.264998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59daf5-a4ec-4186-88b4-1e23a0b2c248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:29.266622 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-ed59daf5-a4ec-4186-88b4-1e23a0b2c248 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:29.313064 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:29.383160 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59daf5-a4ec-4186-88b4-1e23a0b2c248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:08:29.384642 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59daf5-a4ec-4186-88b4-1e23a0b2c248 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:08:29.405093 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 676/1346] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:08:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:08:33.618317 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ede5cf-a77b-4b9f-8ab7-e273757ded24 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:33.618844 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ede5cf-a77b-4b9f-8ab7-e273757ded24 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:33.618964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ede5cf-a77b-4b9f-8ab7-e273757ded24 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:33.620285 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 671/1347] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:08:33.626096 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305425ab-7244-4a6c-89d3-9c2a4b240b22 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:33.626617 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305425ab-7244-4a6c-89d3-9c2a4b240b22 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:33.626856 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305425ab-7244-4a6c-89d3-9c2a4b240b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:33.699912 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-305425ab-7244-4a6c-89d3-9c2a4b240b22 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:08:33.701881 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-305425ab-7244-4a6c-89d3-9c2a4b240b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:33.803415 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:33.806098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 677/1348] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:08:34.229851 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ede5cf-a77b-4b9f-8ab7-e273757ded24 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:08:34.231971 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-95ede5cf-a77b-4b9f-8ab7-e273757ded24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:34.334878 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ede5cf-a77b-4b9f-8ab7-e273757ded24 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:08:34.383667 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:34.410627 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86955b5-2125-49f5-ab25-766f8056a88f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:08:34.411378 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86955b5-2125-49f5-ab25-766f8056a88f service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:34.411952 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86955b5-2125-49f5-ab25-766f8056a88f service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:34.412224 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86955b5-2125-49f5-ab25-766f8056a88f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:34.413817 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-f86955b5-2125-49f5-ab25-766f8056a88f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:34.524411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86955b5-2125-49f5-ab25-766f8056a88f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:08:34.525860 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86955b5-2125-49f5-ab25-766f8056a88f service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:08:34.545424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 672/1349] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:08:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:08:39.493485 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a309771-f57e-4880-bd7f-ede2e7dee225 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:39.493485 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a309771-f57e-4880-bd7f-ede2e7dee225 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:39.493485 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a309771-f57e-4880-bd7f-ede2e7dee225 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:39.496216 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 678/1350] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 23 08:08:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:08:39.505672 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de6a96-143a-422d-89c9-5535a97d5d98 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:39.505672 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de6a96-143a-422d-89c9-5535a97d5d98 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:39.505672 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de6a96-143a-422d-89c9-5535a97d5d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:39.634309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-c0de6a96-143a-422d-89c9-5535a97d5d98 None None] MFA Rules not processed for user `8e92560dd9da4c7cbcac5a84bcaca483`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:08:39.642319 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-c0de6a96-143a-422d-89c9-5535a97d5d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:39.665315 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:39.764626 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 673/1351] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 23 08:08:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:08:43.974252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd3b91-9a35-4f30-92d7-ca68389e9418 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:43.974829 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd3b91-9a35-4f30-92d7-ca68389e9418 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:43.975134 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd3b91-9a35-4f30-92d7-ca68389e9418 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:43.976613 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 679/1352] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 23 08:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:08:43.982801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafacb54-9acb-4aff-958d-2675f3964aa8 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:43.983225 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafacb54-9acb-4aff-958d-2675f3964aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:43.983356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafacb54-9acb-4aff-958d-2675f3964aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:44.065021 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-bafacb54-9acb-4aff-958d-2675f3964aa8 None None] MFA Rules not processed for user `8e92560dd9da4c7cbcac5a84bcaca483`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:08:44.066237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-bafacb54-9acb-4aff-958d-2675f3964aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:44.142125 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:44.179299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 674/1353] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 23 08:08:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:08:45.579540 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a711c-c469-4cc5-9ac8-77983944fbd3 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:45.580258 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a711c-c469-4cc5-9ac8-77983944fbd3 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:45.580258 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a711c-c469-4cc5-9ac8-77983944fbd3 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:45.581571 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 680/1354] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 23 08:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:08:45.586724 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb28dc8-a91d-4176-ab9f-21b20202f4ae None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:45.587177 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb28dc8-a91d-4176-ab9f-21b20202f4ae None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:45.587288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb28dc8-a91d-4176-ab9f-21b20202f4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:45.669851 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-beb28dc8-a91d-4176-ab9f-21b20202f4ae None None] MFA Rules not processed for user `8e92560dd9da4c7cbcac5a84bcaca483`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:08:45.671102 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-beb28dc8-a91d-4176-ab9f-21b20202f4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:45.776587 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 675/1355] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 23 08:08:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:08:49.180469 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3a592-9a00-410e-9a31-062cfc4d9c81 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:49.187653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3a592-9a00-410e-9a31-062cfc4d9c81 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:49.187653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3a592-9a00-410e-9a31-062cfc4d9c81 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:49.187653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 681/1356] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:08:49.188343 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803b2bb-1fe3-4669-b4f3-87f28e20b3f3 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:49.188779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803b2bb-1fe3-4669-b4f3-87f28e20b3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:49.188907 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803b2bb-1fe3-4669-b4f3-87f28e20b3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:49.237066 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:49.276089 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-7803b2bb-1fe3-4669-b4f3-87f28e20b3f3 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:08:49.277290 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-7803b2bb-1fe3-4669-b4f3-87f28e20b3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:49.409355 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 676/1357] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:08:49.738888 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a408b00-c4fd-4aa3-aeda-790e9432a371 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:49.739465 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a408b00-c4fd-4aa3-aeda-790e9432a371 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:49.739955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a408b00-c4fd-4aa3-aeda-790e9432a371 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:49.741914 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 682/1358] 10.222.0.57 () {54 vars in 962 bytes} [Tue Aug 23 08:08:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:08:49.750553 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d843a0-e949-4674-bebe-7227c232b218 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:49.750885 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d843a0-e949-4674-bebe-7227c232b218 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:49.751220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d843a0-e949-4674-bebe-7227c232b218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:49.843617 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-82d843a0-e949-4674-bebe-7227c232b218 None None] MFA Rules not processed for user `b5c55e5c1cea47f29d378ea457384a31`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:08:49.845043 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-82d843a0-e949-4674-bebe-7227c232b218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:49.900699 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:49.973940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 677/1359] 10.222.0.57 () {58 vars in 1059 bytes} [Tue Aug 23 08:08:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:08:49.981606 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a408b00-c4fd-4aa3-aeda-790e9432a371 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:08:49.983289 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-7a408b00-c4fd-4aa3-aeda-790e9432a371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:50.139956 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a408b00-c4fd-4aa3-aeda-790e9432a371 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:08:50.217218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:50.259088 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d1783-6cf0-4c41-a4d5-a513162e1872 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:08:50.259743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d1783-6cf0-4c41-a4d5-a513162e1872 service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:50.260021 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d1783-6cf0-4c41-a4d5-a513162e1872 service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:50.260286 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d1783-6cf0-4c41-a4d5-a513162e1872 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:50.262526 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-825d1783-6cf0-4c41-a4d5-a513162e1872 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:50.355043 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d1783-6cf0-4c41-a4d5-a513162e1872 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:08:50.356673 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d1783-6cf0-4c41-a4d5-a513162e1872 service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:08:50.375227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 683/1360] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:08:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:08:52.539568 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854eff3b-cff1-423b-a665-130a43cba0e7 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:52.540174 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854eff3b-cff1-423b-a665-130a43cba0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:52.540174 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854eff3b-cff1-423b-a665-130a43cba0e7 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:52.541539 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 678/1361] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:08:52.548179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b67221-6bb7-41c5-8103-41cdb73247d7 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:52.549536 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b67221-6bb7-41c5-8103-41cdb73247d7 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:52.550225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b67221-6bb7-41c5-8103-41cdb73247d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:52.620514 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-69b67221-6bb7-41c5-8103-41cdb73247d7 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:08:52.622864 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-69b67221-6bb7-41c5-8103-41cdb73247d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:52.665229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:52.750460 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 684/1362] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:08:53.045551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854eff3b-cff1-423b-a665-130a43cba0e7 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:08:53.045551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-854eff3b-cff1-423b-a665-130a43cba0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:53.231047 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854eff3b-cff1-423b-a665-130a43cba0e7 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:08:53.242033 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:53.352246 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7317d4-5337-4044-a70a-c4765d2b4afd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:08:53.352763 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7317d4-5337-4044-a70a-c4765d2b4afd service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:53.353039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7317d4-5337-4044-a70a-c4765d2b4afd service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:53.353439 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7317d4-5337-4044-a70a-c4765d2b4afd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:53.355042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-7e7317d4-5337-4044-a70a-c4765d2b4afd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:53.463612 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7317d4-5337-4044-a70a-c4765d2b4afd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:08:53.465776 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7317d4-5337-4044-a70a-c4765d2b4afd service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:08:53.485399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 679/1363] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:08:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:08:55.885104 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9fff4-80af-41e8-bd35-7c010b1e1082 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:55.885666 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9fff4-80af-41e8-bd35-7c010b1e1082 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:55.885666 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9fff4-80af-41e8-bd35-7c010b1e1082 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:55.887829 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 685/1364] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:08:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:08:55.893432 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fcd10-fadc-49b5-a7ad-660964f02eb0 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:55.893885 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fcd10-fadc-49b5-a7ad-660964f02eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:55.894057 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fcd10-fadc-49b5-a7ad-660964f02eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:55.911083 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:55.964177 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-304fcd10-fadc-49b5-a7ad-660964f02eb0 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:08:55.966043 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-304fcd10-fadc-49b5-a7ad-660964f02eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:56.073049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 680/1365] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:08:56.373152 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56403b9-9c2b-4eb1-97f4-086dcc98c387 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:56.373476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56403b9-9c2b-4eb1-97f4-086dcc98c387 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:56.373778 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56403b9-9c2b-4eb1-97f4-086dcc98c387 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:56.375317 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 686/1366] 10.222.0.57 () {54 vars in 962 bytes} [Tue Aug 23 08:08:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:08:56.381160 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dfaa1-75df-4b07-8ae2-a7955013ddf0 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:56.381590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dfaa1-75df-4b07-8ae2-a7955013ddf0 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:56.381923 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dfaa1-75df-4b07-8ae2-a7955013ddf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:56.464394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-4a0dfaa1-75df-4b07-8ae2-a7955013ddf0 None None] MFA Rules not processed for user `b5c55e5c1cea47f29d378ea457384a31`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:08:56.465800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-4a0dfaa1-75df-4b07-8ae2-a7955013ddf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:56.500903 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:56.587527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 681/1367] 10.222.0.57 () {58 vars in 1059 bytes} [Tue Aug 23 08:08:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:08:56.596231 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56403b9-9c2b-4eb1-97f4-086dcc98c387 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:08:56.597869 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-f56403b9-9c2b-4eb1-97f4-086dcc98c387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:56.762619 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56403b9-9c2b-4eb1-97f4-086dcc98c387 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:08:56.784400 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:56.883381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d6c91-c279-4140-8520-cbfde21fcd0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:08:56.884140 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d6c91-c279-4140-8520-cbfde21fcd0c service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:56.884516 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d6c91-c279-4140-8520-cbfde21fcd0c service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:56.884885 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d6c91-c279-4140-8520-cbfde21fcd0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:56.886690 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-5a8d6c91-c279-4140-8520-cbfde21fcd0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:56.987391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d6c91-c279-4140-8520-cbfde21fcd0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:08:56.989000 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d6c91-c279-4140-8520-cbfde21fcd0c service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:08:57.010544 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 687/1368] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:08:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:08:57.509542 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e50c71-7ed5-4e23-a3c6-747291d95fd2 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:57.510067 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e50c71-7ed5-4e23-a3c6-747291d95fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:57.510067 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e50c71-7ed5-4e23-a3c6-747291d95fd2 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:57.511754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 682/1369] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:08:57.517181 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933354ad-5868-4990-b654-4dbaae8f0bb8 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:57.517474 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933354ad-5868-4990-b654-4dbaae8f0bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:57.517754 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933354ad-5868-4990-b654-4dbaae8f0bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:57.550734 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:57.587978 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-933354ad-5868-4990-b654-4dbaae8f0bb8 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:08:57.589671 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-933354ad-5868-4990-b654-4dbaae8f0bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:57.706851 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 688/1370] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:08:58.284109 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1add2fa-169c-4dfd-9def-b6ff31a091a3 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:58.284109 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1add2fa-169c-4dfd-9def-b6ff31a091a3 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:58.284109 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1add2fa-169c-4dfd-9def-b6ff31a091a3 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:58.287001 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 683/1371] 10.222.0.57 () {54 vars in 964 bytes} [Tue Aug 23 08:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:08:58.290532 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcce5d5-39c5-435c-a6c6-89ef2a5744da None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:58.291065 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcce5d5-39c5-435c-a6c6-89ef2a5744da None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:58.291065 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcce5d5-39c5-435c-a6c6-89ef2a5744da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:58.371753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-2dcce5d5-39c5-435c-a6c6-89ef2a5744da None None] MFA Rules not processed for user `8c3e2f6c4d8f4798a5fa271bb0b0154b`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:08:58.372964 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-2dcce5d5-39c5-435c-a6c6-89ef2a5744da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:58.422034 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:58.457285 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 689/1372] 10.222.0.57 () {58 vars in 1061 bytes} [Tue Aug 23 08:08:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:08:58.464841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1add2fa-169c-4dfd-9def-b6ff31a091a3 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:08:58.466409 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a1add2fa-169c-4dfd-9def-b6ff31a091a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:58.578232 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1add2fa-169c-4dfd-9def-b6ff31a091a3 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:08:58.621851 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:58.658172 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277aebd2-47b2-464b-bbcb-0fc6ba02a080 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:08:58.659094 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277aebd2-47b2-464b-bbcb-0fc6ba02a080 service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:58.659604 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277aebd2-47b2-464b-bbcb-0fc6ba02a080 service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:58.660134 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277aebd2-47b2-464b-bbcb-0fc6ba02a080 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:58.662367 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-277aebd2-47b2-464b-bbcb-0fc6ba02a080 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:58.779791 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277aebd2-47b2-464b-bbcb-0fc6ba02a080 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:08:58.781148 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277aebd2-47b2-464b-bbcb-0fc6ba02a080 service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:08:58.804288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 684/1373] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:08:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:08:59.155843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc1889-b968-447a-9037-42e9ad658c9c None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:59.156128 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc1889-b968-447a-9037-42e9ad658c9c None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:59.156428 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc1889-b968-447a-9037-42e9ad658c9c None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:59.157791 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 690/1374] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:08:59.163081 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee53fe-988e-46f7-a422-ac64b5d18dbb None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:59.163371 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee53fe-988e-46f7-a422-ac64b5d18dbb None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:59.163649 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee53fe-988e-46f7-a422-ac64b5d18dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:59.233479 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-1dee53fe-988e-46f7-a422-ac64b5d18dbb None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:08:59.234766 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-1dee53fe-988e-46f7-a422-ac64b5d18dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:59.255533 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:59.332903 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 685/1375] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:08:59.620064 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc1889-b968-447a-9037-42e9ad658c9c None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:08:59.621917 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-36bc1889-b968-447a-9037-42e9ad658c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:59.772744 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc1889-b968-447a-9037-42e9ad658c9c None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:08:59.822974 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:59.889129 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3912b0-d8af-48c1-8621-280b6a78f76c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:08:59.889678 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3912b0-d8af-48c1-8621-280b6a78f76c service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:08:59.889961 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3912b0-d8af-48c1-8621-280b6a78f76c service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:08:59.890232 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3912b0-d8af-48c1-8621-280b6a78f76c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:08:59.891867 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-ca3912b0-d8af-48c1-8621-280b6a78f76c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:08:59.980082 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3912b0-d8af-48c1-8621-280b6a78f76c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:08:59.982113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3912b0-d8af-48c1-8621-280b6a78f76c service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:09:00.000083 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 691/1376] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:08:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:09:02.054920 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf3f0a-5a7c-4209-b78f-722712e39cac None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:02.055454 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf3f0a-5a7c-4209-b78f-722712e39cac None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:02.055454 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf3f0a-5a7c-4209-b78f-722712e39cac None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:02.057072 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 686/1377] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:09:02.062758 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38e693-afa1-4a34-abe3-be8b908ee785 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:02.063215 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38e693-afa1-4a34-abe3-be8b908ee785 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:02.063334 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38e693-afa1-4a34-abe3-be8b908ee785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:02.130441 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-fb38e693-afa1-4a34-abe3-be8b908ee785 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:09:02.131564 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-fb38e693-afa1-4a34-abe3-be8b908ee785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:02.138389 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:02.234071 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 692/1378] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:09:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:09:02.545370 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf3f0a-5a7c-4209-b78f-722712e39cac None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:09:02.547893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-48cf3f0a-5a7c-4209-b78f-722712e39cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:02.713685 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf3f0a-5a7c-4209-b78f-722712e39cac None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:09:02.722314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:02.834343 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423ad39-1e3f-4668-b07c-45596224e705 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:09:02.834950 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423ad39-1e3f-4668-b07c-45596224e705 service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:02.835227 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423ad39-1e3f-4668-b07c-45596224e705 service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:02.835499 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423ad39-1e3f-4668-b07c-45596224e705 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:02.837063 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-0423ad39-1e3f-4668-b07c-45596224e705 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:02.930079 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423ad39-1e3f-4668-b07c-45596224e705 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:09:02.931731 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423ad39-1e3f-4668-b07c-45596224e705 service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:09:02.951460 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 687/1379] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:09:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:09:05.010041 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6a715-e4a4-4320-82b8-20d92f441372 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:05.010600 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6a715-e4a4-4320-82b8-20d92f441372 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:05.010600 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6a715-e4a4-4320-82b8-20d92f441372 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:05.012211 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 693/1380] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:09:05.017450 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f04edc-20c5-4010-882a-e10cd9e1c81f None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:05.017865 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f04edc-20c5-4010-882a-e10cd9e1c81f None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:05.018011 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f04edc-20c5-4010-882a-e10cd9e1c81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:05.030214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:05.087177 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-c7f04edc-20c5-4010-882a-e10cd9e1c81f None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:09:05.088507 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-c7f04edc-20c5-4010-882a-e10cd9e1c81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:05.199864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 688/1381] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:09:05.505731 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6a715-e4a4-4320-82b8-20d92f441372 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:09:05.507674 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-12c6a715-e4a4-4320-82b8-20d92f441372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:05.670017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:05.680528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6a715-e4a4-4320-82b8-20d92f441372 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:09:05.799298 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423d94a-10dd-44ee-b0cd-c8c361d6bbe8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:09:05.800014 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423d94a-10dd-44ee-b0cd-c8c361d6bbe8 service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:05.800366 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423d94a-10dd-44ee-b0cd-c8c361d6bbe8 service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:05.800710 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423d94a-10dd-44ee-b0cd-c8c361d6bbe8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:05.802420 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-6423d94a-10dd-44ee-b0cd-c8c361d6bbe8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:05.900240 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423d94a-10dd-44ee-b0cd-c8c361d6bbe8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:09:05.901942 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423d94a-10dd-44ee-b0cd-c8c361d6bbe8 service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:09:05.912778 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:05.921196 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 694/1382] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:09:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:09:08.398824 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42470e-a28c-4bc8-9477-7c99ff93e482 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:08.399371 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42470e-a28c-4bc8-9477-7c99ff93e482 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:08.399641 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42470e-a28c-4bc8-9477-7c99ff93e482 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:08.401463 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 689/1383] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:09:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:09:08.407164 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e4cae-6294-4c2e-839e-d4e53274bd08 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:08.407613 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e4cae-6294-4c2e-839e-d4e53274bd08 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:08.407708 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e4cae-6294-4c2e-839e-d4e53274bd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:08.485115 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-708e4cae-6294-4c2e-839e-d4e53274bd08 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:09:08.486831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-708e4cae-6294-4c2e-839e-d4e53274bd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:08.594314 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 695/1384] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:09:08.889361 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42470e-a28c-4bc8-9477-7c99ff93e482 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:09:08.890988 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-7d42470e-a28c-4bc8-9477-7c99ff93e482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:08.981035 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:09.059602 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42470e-a28c-4bc8-9477-7c99ff93e482 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:09:09.189913 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88b9fd-2949-43fe-ab8c-4294ae3a0a8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:09:09.190567 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88b9fd-2949-43fe-ab8c-4294ae3a0a8f service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:09.190851 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88b9fd-2949-43fe-ab8c-4294ae3a0a8f service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:09.191126 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88b9fd-2949-43fe-ab8c-4294ae3a0a8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:09.192908 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-7b88b9fd-2949-43fe-ab8c-4294ae3a0a8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:09.245017 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:09.287610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88b9fd-2949-43fe-ab8c-4294ae3a0a8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:09:09.289225 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88b9fd-2949-43fe-ab8c-4294ae3a0a8f service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:09:09.307672 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 690/1385] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:09:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:09:12.550025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac96ca-f519-4b91-b3ed-80dba2aca84a None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:12.550619 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac96ca-f519-4b91-b3ed-80dba2aca84a None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:12.550619 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac96ca-f519-4b91-b3ed-80dba2aca84a None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:12.551980 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 696/1386] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:09:12.557986 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e8e67-3846-4b28-8964-290e9c9f1286 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:12.558505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e8e67-3846-4b28-8964-290e9c9f1286 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:12.558710 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e8e67-3846-4b28-8964-290e9c9f1286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:12.623837 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-a08e8e67-3846-4b28-8964-290e9c9f1286 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:09:12.625041 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a08e8e67-3846-4b28-8964-290e9c9f1286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:12.733829 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 691/1387] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:09:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:09:13.032399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac96ca-f519-4b91-b3ed-80dba2aca84a None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:09:13.033935 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-69ac96ca-f519-4b91-b3ed-80dba2aca84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:13.111144 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:13.181526 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac96ca-f519-4b91-b3ed-80dba2aca84a None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:09:13.301978 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e99552-9255-4235-9572-8b41e53a78b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:09:13.302513 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e99552-9255-4235-9572-8b41e53a78b6 service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:13.302794 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e99552-9255-4235-9572-8b41e53a78b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:13.303061 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e99552-9255-4235-9572-8b41e53a78b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:13.304632 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-e2e99552-9255-4235-9572-8b41e53a78b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:13.345120 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:13.395713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e99552-9255-4235-9572-8b41e53a78b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:09:13.397308 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e99552-9255-4235-9572-8b41e53a78b6 service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:09:13.415755 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 697/1388] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:09:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:09:14.180171 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a13e1-eb28-41e2-8f9f-19cf5b964f3f None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:14.180800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a13e1-eb28-41e2-8f9f-19cf5b964f3f None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:14.180906 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a13e1-eb28-41e2-8f9f-19cf5b964f3f None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:14.182259 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 692/1389] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:09:14.188294 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ca327-55f1-4bdd-9516-042a9e3d638e None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:14.188748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ca327-55f1-4bdd-9516-042a9e3d638e None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:14.188852 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ca327-55f1-4bdd-9516-042a9e3d638e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:14.257911 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-742ca327-55f1-4bdd-9516-042a9e3d638e None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:09:14.259140 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-742ca327-55f1-4bdd-9516-042a9e3d638e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:14.355556 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 698/1390] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:09:14.656941 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4007b14-4094-4946-b8ba-aa86940c455f None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:14.657232 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4007b14-4094-4946-b8ba-aa86940c455f None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:14.657514 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4007b14-4094-4946-b8ba-aa86940c455f None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:14.661893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 693/1391] 10.222.0.57 () {54 vars in 967 bytes} [Tue Aug 23 08:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:09:14.664109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad44aea-f027-43db-89ab-480d17eec409 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:14.664464 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad44aea-f027-43db-89ab-480d17eec409 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:14.664747 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad44aea-f027-43db-89ab-480d17eec409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:14.680746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:14.749890 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-3ad44aea-f027-43db-89ab-480d17eec409 None None] MFA Rules not processed for user `2f4ee9c3c5be48699a24dfce9b30bda6`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:09:14.752069 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-3ad44aea-f027-43db-89ab-480d17eec409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:14.831202 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 699/1392] 10.222.0.57 () {58 vars in 1064 bytes} [Tue Aug 23 08:09:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:09:14.839549 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4007b14-4094-4946-b8ba-aa86940c455f None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:09:14.840908 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a4007b14-4094-4946-b8ba-aa86940c455f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:14.872980 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:14.944163 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4007b14-4094-4946-b8ba-aa86940c455f None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:09:15.018597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4367a-e916-4a83-877b-003b02a3ebf5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f4ee9c3c5be48699a24dfce9b30bda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:09:15.019211 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4367a-e916-4a83-877b-003b02a3ebf5 service glance] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:15.019499 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4367a-e916-4a83-877b-003b02a3ebf5 service glance] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:15.019770 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4367a-e916-4a83-877b-003b02a3ebf5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:15.021357 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-d9c4367a-e916-4a83-877b-003b02a3ebf5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:15.099549 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:15.133090 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4367a-e916-4a83-877b-003b02a3ebf5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:09:15.134579 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4367a-e916-4a83-877b-003b02a3ebf5 service glance] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:09:15.155366 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 694/1393] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:09:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:09:15.571441 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfc33d-9d08-44ff-b2ac-9a684c00e67a None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:15.571966 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfc33d-9d08-44ff-b2ac-9a684c00e67a None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:15.572184 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfc33d-9d08-44ff-b2ac-9a684c00e67a None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:15.579794 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 700/1394] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:09:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:09:15.581980 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34516d1c-f8c1-4cd9-9358-bebaedfde258 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:15.582475 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34516d1c-f8c1-4cd9-9358-bebaedfde258 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:15.582586 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34516d1c-f8c1-4cd9-9358-bebaedfde258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:15.656068 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-34516d1c-f8c1-4cd9-9358-bebaedfde258 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:09:15.657285 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-34516d1c-f8c1-4cd9-9358-bebaedfde258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:15.755226 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 695/1395] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:09:16.056593 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfc33d-9d08-44ff-b2ac-9a684c00e67a None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:09:16.058735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-4cdfc33d-9d08-44ff-b2ac-9a684c00e67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:16.058877 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e53498-067b-4c30-af3c-d1be28b977c5 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:16.059089 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e53498-067b-4c30-af3c-d1be28b977c5 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:16.059371 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e53498-067b-4c30-af3c-d1be28b977c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:16.107056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:16.130986 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-58e53498-067b-4c30-af3c-d1be28b977c5 None None] MFA Rules not processed for user `970300b51d504a2bbc48158855f02f34`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:09:16.132217 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-58e53498-067b-4c30-af3c-d1be28b977c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:16.164997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:16.212702 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfc33d-9d08-44ff-b2ac-9a684c00e67a None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:09:16.222210 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 696/1396] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 23 08:09:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:09:16.267318 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b91213-15a1-49b0-b345-1cd8633009b0 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:16.267610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b91213-15a1-49b0-b345-1cd8633009b0 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:16.267888 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b91213-15a1-49b0-b345-1cd8633009b0 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:16.269267 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 697/1397] 10.222.0.57 () {54 vars in 943 bytes} [Tue Aug 23 08:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 08:09:16.275401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02019e3-8843-43e5-8ca3-9a6ce8a528db None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:16.275691 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02019e3-8843-43e5-8ca3-9a6ce8a528db None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:16.275969 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02019e3-8843-43e5-8ca3-9a6ce8a528db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:16.340231 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec29bd6-e2d4-468e-b58a-2b3f96d8d478 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:09:16.340845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec29bd6-e2d4-468e-b58a-2b3f96d8d478 service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:16.341125 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec29bd6-e2d4-468e-b58a-2b3f96d8d478 service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:16.341396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec29bd6-e2d4-468e-b58a-2b3f96d8d478 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:16.343040 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-0ec29bd6-e2d4-468e-b58a-2b3f96d8d478 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:16.352951 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-f02019e3-8843-43e5-8ca3-9a6ce8a528db None None] MFA Rules not processed for user `4718cad0c0b9461d9c4152d7ea4b385d`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:09:16.354131 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-f02019e3-8843-43e5-8ca3-9a6ce8a528db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:16.412606 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:16.416127 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:16.432725 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec29bd6-e2d4-468e-b58a-2b3f96d8d478 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:09:16.434367 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec29bd6-e2d4-468e-b58a-2b3f96d8d478 service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:09:16.453018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 701/1398] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:09:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:09:16.461735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 698/1399] 10.222.0.57 () {58 vars in 1040 bytes} [Tue Aug 23 08:09:16 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:09:16.471960 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec29bd6-e2d4-468e-b58a-2b3f96d8d478 service nova] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:09:16.473153 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-0ec29bd6-e2d4-468e-b58a-2b3f96d8d478 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:16.560118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec29bd6-e2d4-468e-b58a-2b3f96d8d478 service nova] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:09:16.667989 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:16.669790 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5422d-0fcd-4875-89c2-7fbd64b0baa4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4718cad0c0b9461d9c4152d7ea4b385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:09:16.670504 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5422d-0fcd-4875-89c2-7fbd64b0baa4 service swift] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:16.670785 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5422d-0fcd-4875-89c2-7fbd64b0baa4 service swift] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:16.671056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5422d-0fcd-4875-89c2-7fbd64b0baa4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:16.672807 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-17b5422d-0fcd-4875-89c2-7fbd64b0baa4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:16.770571 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5422d-0fcd-4875-89c2-7fbd64b0baa4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:09:16.772223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5422d-0fcd-4875-89c2-7fbd64b0baa4 service swift] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:09:16.781961 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 702/1400] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 23 08:09:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 08:09:18.584074 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb72670-9464-46b0-b3bf-efa01f89384c None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:18.584637 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb72670-9464-46b0-b3bf-efa01f89384c None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:18.584637 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb72670-9464-46b0-b3bf-efa01f89384c None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:18.590668 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 699/1401] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:09:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:09:18.594322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df714a-79f5-4ebb-a331-a2b2ab3218a7 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:18.594322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df714a-79f5-4ebb-a331-a2b2ab3218a7 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:18.594322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df714a-79f5-4ebb-a331-a2b2ab3218a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:18.683631 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-b7df714a-79f5-4ebb-a331-a2b2ab3218a7 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:09:18.684899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-b7df714a-79f5-4ebb-a331-a2b2ab3218a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:18.818302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:18.827665 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 703/1402] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:09:19.157569 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb72670-9464-46b0-b3bf-efa01f89384c None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:09:19.159511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-7bb72670-9464-46b0-b3bf-efa01f89384c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:19.326101 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb72670-9464-46b0-b3bf-efa01f89384c None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:09:19.374408 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:19.455832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3566087-8257-4edb-b6b4-0da08dd1ec34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:09:19.456476 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3566087-8257-4edb-b6b4-0da08dd1ec34 service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:19.456769 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3566087-8257-4edb-b6b4-0da08dd1ec34 service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:19.457037 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3566087-8257-4edb-b6b4-0da08dd1ec34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:19.458643 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-c3566087-8257-4edb-b6b4-0da08dd1ec34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:19.561188 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3566087-8257-4edb-b6b4-0da08dd1ec34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:09:19.562954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3566087-8257-4edb-b6b4-0da08dd1ec34 service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:09:19.583869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 700/1403] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:09:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:09:21.656428 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dec63-1c75-4d35-9c55-0092306cbad3 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:21.656938 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dec63-1c75-4d35-9c55-0092306cbad3 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:21.657024 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dec63-1c75-4d35-9c55-0092306cbad3 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:21.658542 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 704/1404] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:09:21.663749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5728ba-c11d-456e-9d04-72e49e5188c2 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:21.664204 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5728ba-c11d-456e-9d04-72e49e5188c2 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:21.664321 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5728ba-c11d-456e-9d04-72e49e5188c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:21.727224 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:21.735883 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-4d5728ba-c11d-456e-9d04-72e49e5188c2 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:09:21.737109 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-4d5728ba-c11d-456e-9d04-72e49e5188c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:21.854355 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 701/1405] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:09:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:09:22.134042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9dec63-1c75-4d35-9c55-0092306cbad3 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:09:22.136186 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-4c9dec63-1c75-4d35-9c55-0092306cbad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:22.307571 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9dec63-1c75-4d35-9c55-0092306cbad3 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:09:22.384438 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:22.436359 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4dc8e-c9b6-4f71-b658-86a73f1f8f2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:09:22.437005 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4dc8e-c9b6-4f71-b658-86a73f1f8f2b service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:22.437288 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4dc8e-c9b6-4f71-b658-86a73f1f8f2b service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:22.437566 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4dc8e-c9b6-4f71-b658-86a73f1f8f2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:22.439211 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-f9a4dc8e-c9b6-4f71-b658-86a73f1f8f2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:22.542557 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4dc8e-c9b6-4f71-b658-86a73f1f8f2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:09:22.544207 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4dc8e-c9b6-4f71-b658-86a73f1f8f2b service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:09:22.564028 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 705/1406] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:09:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:09:24.607331 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16170e4d-1906-4f27-a12b-befb12602fa7 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:24.607872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16170e4d-1906-4f27-a12b-befb12602fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:24.607872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16170e4d-1906-4f27-a12b-befb12602fa7 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:24.613176 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 702/1407] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:09:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:09:24.614738 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f7774-29a9-4078-bd13-a9fdd42e783a None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:24.615465 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f7774-29a9-4078-bd13-a9fdd42e783a None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:24.615745 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f7774-29a9-4078-bd13-a9fdd42e783a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:24.692602 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-196f7774-29a9-4078-bd13-a9fdd42e783a None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:09:24.693830 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-196f7774-29a9-4078-bd13-a9fdd42e783a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:24.727052 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:24.803216 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 706/1408] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:09:25.097060 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16170e4d-1906-4f27-a12b-befb12602fa7 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:09:25.098606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-16170e4d-1906-4f27-a12b-befb12602fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:25.238078 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:25.270780 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16170e4d-1906-4f27-a12b-befb12602fa7 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:09:25.407690 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7984ea3-96dd-4df3-a2e5-38f343759cb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:09:25.408350 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7984ea3-96dd-4df3-a2e5-38f343759cb1 service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:25.408707 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7984ea3-96dd-4df3-a2e5-38f343759cb1 service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:25.408982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7984ea3-96dd-4df3-a2e5-38f343759cb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:25.411713 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-b7984ea3-96dd-4df3-a2e5-38f343759cb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:25.506746 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:25.510663 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7984ea3-96dd-4df3-a2e5-38f343759cb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:09:25.512324 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7984ea3-96dd-4df3-a2e5-38f343759cb1 service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:09:25.533699 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 703/1409] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:09:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:09:34.799966 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=30 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:35.552072 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=7 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:39.980676 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de06c77-4bd5-4d22-ad5d-fcbed8944296 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:39.981238 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de06c77-4bd5-4d22-ad5d-fcbed8944296 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:39.981238 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de06c77-4bd5-4d22-ad5d-fcbed8944296 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:39.982663 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 707/1410] 10.222.0.57 () {54 vars in 918 bytes} [Tue Aug 23 08:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:09:39.987801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629e107-588d-47f8-9d75-f07b972f534a None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:39.988252 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629e107-588d-47f8-9d75-f07b972f534a None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:39.988358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629e107-588d-47f8-9d75-f07b972f534a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:40.061411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-0629e107-588d-47f8-9d75-f07b972f534a None None] MFA Rules not processed for user `8e92560dd9da4c7cbcac5a84bcaca483`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:09:40.062653 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-0629e107-588d-47f8-9d75-f07b972f534a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:40.166944 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 704/1411] 10.222.0.57 () {58 vars in 1015 bytes} [Tue Aug 23 08:09:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:09:40.181058 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004c069-ef5e-493b-931d-3c49abd27c93 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:40.181340 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004c069-ef5e-493b-931d-3c49abd27c93 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:40.181615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004c069-ef5e-493b-931d-3c49abd27c93 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:40.190400 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 708/1412] 10.222.0.57 () {54 vars in 918 bytes} [Tue Aug 23 08:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:09:40.190524 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73263958-5744-4d4a-a0c3-0f3c0935cc4d None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:40.190524 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73263958-5744-4d4a-a0c3-0f3c0935cc4d None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:40.190524 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73263958-5744-4d4a-a0c3-0f3c0935cc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:40.262621 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:40.265007 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-73263958-5744-4d4a-a0c3-0f3c0935cc4d None None] MFA Rules not processed for user `b5c55e5c1cea47f29d378ea457384a31`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:09:40.266201 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-73263958-5744-4d4a-a0c3-0f3c0935cc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:40.381641 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 705/1413] 10.222.0.57 () {58 vars in 1015 bytes} [Tue Aug 23 08:09:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:09:42.849234 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6204ac5-c680-4dad-aaa6-549c9ca066cd None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:42.849776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6204ac5-c680-4dad-aaa6-549c9ca066cd None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:42.849776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6204ac5-c680-4dad-aaa6-549c9ca066cd None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:42.851146 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 08:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:09:42.857922 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ffcc5-2d99-47c0-97cb-564af792c207 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:42.858446 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ffcc5-2d99-47c0-97cb-564af792c207 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:42.858553 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ffcc5-2d99-47c0-97cb-564af792c207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:42.932176 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-aa1ffcc5-2d99-47c0-97cb-564af792c207 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:09:42.933303 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-aa1ffcc5-2d99-47c0-97cb-564af792c207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:43.012636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:43.066941 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 08:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:09:43.361902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6204ac5-c680-4dad-aaa6-549c9ca066cd None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:09:43.363437 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c6204ac5-c680-4dad-aaa6-549c9ca066cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:43.506441 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6204ac5-c680-4dad-aaa6-549c9ca066cd None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:09:43.578939 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:43.619490 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e179b-53a6-4643-acb2-f662ff1be1c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:09:43.620024 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e179b-53a6-4643-acb2-f662ff1be1c3 service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:43.620303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e179b-53a6-4643-acb2-f662ff1be1c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:43.620579 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e179b-53a6-4643-acb2-f662ff1be1c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:43.622164 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-376e179b-53a6-4643-acb2-f662ff1be1c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:43.710599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e179b-53a6-4643-acb2-f662ff1be1c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:09:43.712736 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e179b-53a6-4643-acb2-f662ff1be1c3 service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:09:43.730410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 710/1416] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:09:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:09:44.619472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae83a70-f51f-448c-9ede-b67f394c74f9 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:44.620046 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae83a70-f51f-448c-9ede-b67f394c74f9 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:44.620046 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae83a70-f51f-448c-9ede-b67f394c74f9 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:44.621350 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 08:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:09:44.626172 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91818ae8-1db0-457f-8fd0-686824682e0b None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:44.626633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91818ae8-1db0-457f-8fd0-686824682e0b None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:44.626829 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91818ae8-1db0-457f-8fd0-686824682e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:44.704194 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-91818ae8-1db0-457f-8fd0-686824682e0b None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:09:44.705403 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-91818ae8-1db0-457f-8fd0-686824682e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:44.733012 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:44.802117 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 08:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:09:44.954436 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae83a70-f51f-448c-9ede-b67f394c74f9 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:09:44.955948 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-fae83a70-f51f-448c-9ede-b67f394c74f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:45.102818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae83a70-f51f-448c-9ede-b67f394c74f9 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:09:45.142505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:45.216160 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447fcd02-e367-4142-80bf-3f2cc499c5ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:09:45.216689 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fcd02-e367-4142-80bf-3f2cc499c5ed service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:45.216969 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fcd02-e367-4142-80bf-3f2cc499c5ed service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:45.217242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fcd02-e367-4142-80bf-3f2cc499c5ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:45.218869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-447fcd02-e367-4142-80bf-3f2cc499c5ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:45.308363 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447fcd02-e367-4142-80bf-3f2cc499c5ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:09:45.309970 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447fcd02-e367-4142-80bf-3f2cc499c5ed service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:09:45.336585 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 708/1419] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:09:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:09:46.226373 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99ea5b-d60d-4e02-86db-354763d934bc None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:46.226935 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99ea5b-d60d-4e02-86db-354763d934bc None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:46.226935 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99ea5b-d60d-4e02-86db-354763d934bc None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:46.228343 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 08:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:09:46.233309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7250d-cb09-477b-8414-c306166c9424 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:46.233713 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7250d-cb09-477b-8414-c306166c9424 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:46.233862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7250d-cb09-477b-8414-c306166c9424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:46.288743 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:46.310783 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-4aa7250d-cb09-477b-8414-c306166c9424 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:09:46.312019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-4aa7250d-cb09-477b-8414-c306166c9424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:46.415979 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 08:09:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:09:46.573553 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99ea5b-d60d-4e02-86db-354763d934bc None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:09:46.575018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-9d99ea5b-d60d-4e02-86db-354763d934bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:46.730100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99ea5b-d60d-4e02-86db-354763d934bc None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:09:46.741961 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:46.841880 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e401f96-23c5-49d2-9f4d-9834fda2d983 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:09:46.842441 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e401f96-23c5-49d2-9f4d-9834fda2d983 service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:46.842747 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e401f96-23c5-49d2-9f4d-9834fda2d983 service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:46.843008 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e401f96-23c5-49d2-9f4d-9834fda2d983 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:46.844650 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-0e401f96-23c5-49d2-9f4d-9834fda2d983 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:46.934277 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e401f96-23c5-49d2-9f4d-9834fda2d983 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:09:46.935933 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e401f96-23c5-49d2-9f4d-9834fda2d983 service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:09:46.954755 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 713/1422] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:09:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:09:47.812828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7b304-66d0-4a6e-9c02-386a33200387 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:47.813399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7b304-66d0-4a6e-9c02-386a33200387 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:47.813399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7b304-66d0-4a6e-9c02-386a33200387 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:47.814764 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 08:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:09:47.819661 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2b80b-3a36-455f-8ae3-0114447adfe9 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:47.820353 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2b80b-3a36-455f-8ae3-0114447adfe9 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:47.820476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2b80b-3a36-455f-8ae3-0114447adfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:47.840503 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:47.896514 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-44d2b80b-3a36-455f-8ae3-0114447adfe9 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:09:47.897718 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-44d2b80b-3a36-455f-8ae3-0114447adfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:47.996447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 08:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:09:48.146931 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7b304-66d0-4a6e-9c02-386a33200387 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:09:48.148451 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-88d7b304-66d0-4a6e-9c02-386a33200387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:48.258476 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:48.296234 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7b304-66d0-4a6e-9c02-386a33200387 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:09:48.407221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9913c2c-c39f-41b9-98d8-0edd5d8839d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:09:48.407822 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9913c2c-c39f-41b9-98d8-0edd5d8839d0 service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:48.408097 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9913c2c-c39f-41b9-98d8-0edd5d8839d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:48.408364 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9913c2c-c39f-41b9-98d8-0edd5d8839d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:48.409991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-b9913c2c-c39f-41b9-98d8-0edd5d8839d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:48.484805 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:48.498515 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9913c2c-c39f-41b9-98d8-0edd5d8839d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:09:48.500118 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9913c2c-c39f-41b9-98d8-0edd5d8839d0 service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:09:48.518468 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 711/1425] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:09:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:09:49.387396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cf176-c8f2-4a7a-8d7d-9d3a06b1f5e4 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:49.387982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cf176-c8f2-4a7a-8d7d-9d3a06b1f5e4 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:49.387982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cf176-c8f2-4a7a-8d7d-9d3a06b1f5e4 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:49.389309 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 08:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:09:49.394391 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03283ff9-f31b-4137-ba80-83fcca61fbe7 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:49.394870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03283ff9-f31b-4137-ba80-83fcca61fbe7 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:49.394983 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03283ff9-f31b-4137-ba80-83fcca61fbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:49.472669 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-03283ff9-f31b-4137-ba80-83fcca61fbe7 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:09:49.473927 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-03283ff9-f31b-4137-ba80-83fcca61fbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:49.569157 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 08:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:09:49.722264 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cf176-c8f2-4a7a-8d7d-9d3a06b1f5e4 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:09:49.723808 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-196cf176-c8f2-4a7a-8d7d-9d3a06b1f5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:49.811437 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:49.875764 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cf176-c8f2-4a7a-8d7d-9d3a06b1f5e4 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:09:49.986990 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958f855-7d9b-4cb6-8da1-e54d6cde40bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:09:49.987595 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958f855-7d9b-4cb6-8da1-e54d6cde40bc service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:49.987877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958f855-7d9b-4cb6-8da1-e54d6cde40bc service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:49.988151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958f855-7d9b-4cb6-8da1-e54d6cde40bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:49.989743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-1958f855-7d9b-4cb6-8da1-e54d6cde40bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:50.037325 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:50.078134 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958f855-7d9b-4cb6-8da1-e54d6cde40bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:09:50.079762 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958f855-7d9b-4cb6-8da1-e54d6cde40bc service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:09:50.098001 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 716/1428] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:09:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:09:50.961378 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bd691-cec6-4f5e-b24a-dce27b0852b9 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:50.962529 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bd691-cec6-4f5e-b24a-dce27b0852b9 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:50.962529 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bd691-cec6-4f5e-b24a-dce27b0852b9 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:50.964007 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 08:09:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:09:50.969674 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f6c6c-2a68-44f4-b044-95e937bb8e40 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:50.970140 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f6c6c-2a68-44f4-b044-95e937bb8e40 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:50.970238 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f6c6c-2a68-44f4-b044-95e937bb8e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:51.049416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-bd7f6c6c-2a68-44f4-b044-95e937bb8e40 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:09:51.050548 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-bd7f6c6c-2a68-44f4-b044-95e937bb8e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:51.144552 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 08:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:09:51.295558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0bd691-cec6-4f5e-b24a-dce27b0852b9 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:09:51.297084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-cd0bd691-cec6-4f5e-b24a-dce27b0852b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:51.346398 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:51.440758 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0bd691-cec6-4f5e-b24a-dce27b0852b9 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:09:51.554483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e15753-877c-4142-a78c-365751ae6720 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:09:51.555100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e15753-877c-4142-a78c-365751ae6720 service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:51.555375 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e15753-877c-4142-a78c-365751ae6720 service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:51.556268 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e15753-877c-4142-a78c-365751ae6720 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:51.557872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-b6e15753-877c-4142-a78c-365751ae6720 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:51.564908 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:51.654140 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e15753-877c-4142-a78c-365751ae6720 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:09:51.655823 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e15753-877c-4142-a78c-365751ae6720 service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:09:51.673927 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 714/1431] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:09:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:09:52.525202 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcffa0-adf2-4e03-8c84-516a0766113a None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:52.525768 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcffa0-adf2-4e03-8c84-516a0766113a None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:52.525768 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcffa0-adf2-4e03-8c84-516a0766113a None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:52.527112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 08:09:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:09:52.532008 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b5712-ac59-4652-8d37-2cf0a8588307 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:52.532453 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b5712-ac59-4652-8d37-2cf0a8588307 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:52.532554 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b5712-ac59-4652-8d37-2cf0a8588307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:52.607059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-d76b5712-ac59-4652-8d37-2cf0a8588307 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:09:52.608197 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-d76b5712-ac59-4652-8d37-2cf0a8588307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:52.674967 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:52.704780 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 08:09:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:09:52.856349 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcffa0-adf2-4e03-8c84-516a0766113a None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:09:52.857942 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-4edcffa0-adf2-4e03-8c84-516a0766113a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:52.875747 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:53.011679 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcffa0-adf2-4e03-8c84-516a0766113a None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:09:53.099487 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:53.125648 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bffb1c-605b-43e4-8227-d54a47762065 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:09:53.126190 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bffb1c-605b-43e4-8227-d54a47762065 service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:53.126502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bffb1c-605b-43e4-8227-d54a47762065 service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:53.126780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bffb1c-605b-43e4-8227-d54a47762065 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:53.128377 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-32bffb1c-605b-43e4-8227-d54a47762065 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:53.217737 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bffb1c-605b-43e4-8227-d54a47762065 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:09:53.219376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bffb1c-605b-43e4-8227-d54a47762065 service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:09:53.237198 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 719/1434] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:09:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:09:54.158705 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25837afd-bd56-4c4f-9d8b-ff6fd50cbebc None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:54.159273 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25837afd-bd56-4c4f-9d8b-ff6fd50cbebc None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:54.159273 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25837afd-bd56-4c4f-9d8b-ff6fd50cbebc None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:54.160603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 08:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:09:54.166736 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e29e2-ca9d-43e4-922f-79cd37942da1 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:54.167145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e29e2-ca9d-43e4-922f-79cd37942da1 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:54.167290 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e29e2-ca9d-43e4-922f-79cd37942da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:54.242451 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-439e29e2-ca9d-43e4-922f-79cd37942da1 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:09:54.244371 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-439e29e2-ca9d-43e4-922f-79cd37942da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:54.284678 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:54.339605 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 08:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:09:54.488959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25837afd-bd56-4c4f-9d8b-ff6fd50cbebc None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:09:54.490503 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-25837afd-bd56-4c4f-9d8b-ff6fd50cbebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:54.633039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25837afd-bd56-4c4f-9d8b-ff6fd50cbebc None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:09:54.688157 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:54.748016 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b5d37-0c39-45af-a4c6-dffe1e71b552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:09:54.748168 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b5d37-0c39-45af-a4c6-dffe1e71b552 service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:54.748350 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b5d37-0c39-45af-a4c6-dffe1e71b552 service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:54.748623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b5d37-0c39-45af-a4c6-dffe1e71b552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:54.750205 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-0b6b5d37-0c39-45af-a4c6-dffe1e71b552 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:54.837993 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b5d37-0c39-45af-a4c6-dffe1e71b552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:09:54.839636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b5d37-0c39-45af-a4c6-dffe1e71b552 service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:09:54.857901 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 717/1437] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:09:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:09:55.744875 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67ed74-c006-40a0-968b-179a1923c92b None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:55.745447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67ed74-c006-40a0-968b-179a1923c92b None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:55.745447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67ed74-c006-40a0-968b-179a1923c92b None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:55.746894 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 08:09:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:09:55.751890 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e288b-9cd8-421a-8a85-3f53961b2d70 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:55.752285 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e288b-9cd8-421a-8a85-3f53961b2d70 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:55.752445 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e288b-9cd8-421a-8a85-3f53961b2d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:55.828357 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-1a6e288b-9cd8-421a-8a85-3f53961b2d70 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:09:55.829573 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-1a6e288b-9cd8-421a-8a85-3f53961b2d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:55.831614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:55.924378 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 08:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:09:56.081669 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67ed74-c006-40a0-968b-179a1923c92b None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:09:56.083255 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-3b67ed74-c006-40a0-968b-179a1923c92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:56.227761 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67ed74-c006-40a0-968b-179a1923c92b None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:09:56.253584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:56.340728 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fe944-50fb-4325-9c5d-51c080d6a107 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:09:56.341337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fe944-50fb-4325-9c5d-51c080d6a107 service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:56.341620 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fe944-50fb-4325-9c5d-51c080d6a107 service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:56.341894 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fe944-50fb-4325-9c5d-51c080d6a107 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:56.343527 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-8d4fe944-50fb-4325-9c5d-51c080d6a107 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:56.440597 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4fe944-50fb-4325-9c5d-51c080d6a107 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:09:56.442207 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4fe944-50fb-4325-9c5d-51c080d6a107 service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:09:56.460799 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 722/1440] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:09:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:09:58.277666 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bce57-4e9d-49c4-89d9-78dbc0efd1fe None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:58.278234 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bce57-4e9d-49c4-89d9-78dbc0efd1fe None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:58.278234 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bce57-4e9d-49c4-89d9-78dbc0efd1fe None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:58.279600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 08:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:09:58.284959 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe3339-3edf-4d6d-89c1-481d7f5c2192 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:58.285366 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe3339-3edf-4d6d-89c1-481d7f5c2192 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:58.285504 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe3339-3edf-4d6d-89c1-481d7f5c2192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:58.327742 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:58.355037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-cafe3339-3edf-4d6d-89c1-481d7f5c2192 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:09:58.356254 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-cafe3339-3edf-4d6d-89c1-481d7f5c2192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:58.451002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 08:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:09:58.734335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bce57-4e9d-49c4-89d9-78dbc0efd1fe None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:09:58.735927 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-8e4bce57-4e9d-49c4-89d9-78dbc0efd1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:58.837761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bce57-4e9d-49c4-89d9-78dbc0efd1fe None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:09:58.870048 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:58.909880 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a27d69-1630-4963-a965-ca1251196797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:09:58.910519 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a27d69-1630-4963-a965-ca1251196797 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:09:58.911005 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a27d69-1630-4963-a965-ca1251196797 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:09:58.911493 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a27d69-1630-4963-a965-ca1251196797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:09:58.913539 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-d6a27d69-1630-4963-a965-ca1251196797 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:09:59.021590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a27d69-1630-4963-a965-ca1251196797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:09:59.023067 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a27d69-1630-4963-a965-ca1251196797 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:09:59.047057 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 720/1443] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:09:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:10:01.132305 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77e66a-2b0a-4e41-9046-cc7eba50d6e1 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:01.132913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77e66a-2b0a-4e41-9046-cc7eba50d6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:01.132913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77e66a-2b0a-4e41-9046-cc7eba50d6e1 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:01.134788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 08:10:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:10:01.139940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90933b5d-471d-4770-a538-5e32ded1ad61 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:01.140398 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90933b5d-471d-4770-a538-5e32ded1ad61 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:01.140505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90933b5d-471d-4770-a538-5e32ded1ad61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:01.205574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-90933b5d-471d-4770-a538-5e32ded1ad61 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:10:01.206868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-90933b5d-471d-4770-a538-5e32ded1ad61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:01.220916 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:01.303246 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 08:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:10:01.602369 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77e66a-2b0a-4e41-9046-cc7eba50d6e1 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:10:01.603973 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-ab77e66a-2b0a-4e41-9046-cc7eba50d6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:01.717071 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77e66a-2b0a-4e41-9046-cc7eba50d6e1 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:10:01.730882 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:01.792700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a8c47-b79d-4f87-8538-1d492e987b06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:10:01.793299 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a8c47-b79d-4f87-8538-1d492e987b06 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:01.793580 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a8c47-b79d-4f87-8538-1d492e987b06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:01.793853 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a8c47-b79d-4f87-8538-1d492e987b06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:01.795481 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-4d7a8c47-b79d-4f87-8538-1d492e987b06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:01.903489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a8c47-b79d-4f87-8538-1d492e987b06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:10:01.904845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a8c47-b79d-4f87-8538-1d492e987b06 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:10:01.923047 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 725/1446] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:10:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:10:04.234008 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9b725-d406-4382-ba9e-9ea89aa77d16 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:04.234603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9b725-d406-4382-ba9e-9ea89aa77d16 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:04.234603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9b725-d406-4382-ba9e-9ea89aa77d16 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:04.235962 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 08:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:10:04.241475 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86bfc6-7990-45cc-809b-b974ad3b9ee1 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:04.241904 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86bfc6-7990-45cc-809b-b974ad3b9ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:04.242013 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86bfc6-7990-45cc-809b-b974ad3b9ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:04.290970 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:04.308663 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-3e86bfc6-7990-45cc-809b-b974ad3b9ee1 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:10:04.309968 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-3e86bfc6-7990-45cc-809b-b974ad3b9ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:04.405788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 08:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:10:04.693144 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9b725-d406-4382-ba9e-9ea89aa77d16 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:10:04.694722 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-0af9b725-d406-4382-ba9e-9ea89aa77d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:04.797633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9b725-d406-4382-ba9e-9ea89aa77d16 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:10:04.836945 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:04.870090 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcd42a-dde6-4082-8aaa-3331a8a96b02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:10:04.870731 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcd42a-dde6-4082-8aaa-3331a8a96b02 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:04.871208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcd42a-dde6-4082-8aaa-3331a8a96b02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:04.871657 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcd42a-dde6-4082-8aaa-3331a8a96b02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:04.873532 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-5afcd42a-dde6-4082-8aaa-3331a8a96b02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:04.980581 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcd42a-dde6-4082-8aaa-3331a8a96b02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:10:04.982042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcd42a-dde6-4082-8aaa-3331a8a96b02 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:10:05.000572 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 723/1449] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:10:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:10:07.034406 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddaa31-aee1-4999-b584-f61f466fbbaf None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:07.034978 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddaa31-aee1-4999-b584-f61f466fbbaf None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:07.034978 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddaa31-aee1-4999-b584-f61f466fbbaf None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:07.036301 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 08:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:10:07.041698 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bb0f6-7d39-4a9f-b497-4ddaef28a425 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:07.042132 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bb0f6-7d39-4a9f-b497-4ddaef28a425 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:07.042280 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bb0f6-7d39-4a9f-b497-4ddaef28a425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:07.108289 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-dc5bb0f6-7d39-4a9f-b497-4ddaef28a425 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:10:07.109496 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-dc5bb0f6-7d39-4a9f-b497-4ddaef28a425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:07.129883 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:07.205100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 08:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:10:07.494461 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddaa31-aee1-4999-b584-f61f466fbbaf None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:10:07.496025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-78ddaa31-aee1-4999-b584-f61f466fbbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:07.598531 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddaa31-aee1-4999-b584-f61f466fbbaf None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:10:07.618876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:07.674425 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23be39-ba53-4b02-b87f-dc8e12f1563d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:10:07.675029 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23be39-ba53-4b02-b87f-dc8e12f1563d service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:07.675305 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23be39-ba53-4b02-b87f-dc8e12f1563d service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:07.675572 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23be39-ba53-4b02-b87f-dc8e12f1563d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:07.677142 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-6c23be39-ba53-4b02-b87f-dc8e12f1563d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:07.784473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23be39-ba53-4b02-b87f-dc8e12f1563d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:10:07.785838 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23be39-ba53-4b02-b87f-dc8e12f1563d service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:10:07.803816 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 728/1452] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:10:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:10:09.768426 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88c5bb-78ef-4178-a5bc-c43769e25b0a None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:09.768992 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88c5bb-78ef-4178-a5bc-c43769e25b0a None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:09.768992 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88c5bb-78ef-4178-a5bc-c43769e25b0a None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:09.770365 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 08:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:10:09.776327 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3af08-4aef-48ca-9c67-610af30c3f78 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:09.776745 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3af08-4aef-48ca-9c67-610af30c3f78 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:09.776856 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3af08-4aef-48ca-9c67-610af30c3f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:09.839905 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:09.842906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-e0d3af08-4aef-48ca-9c67-610af30c3f78 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:10:09.844140 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-e0d3af08-4aef-48ca-9c67-610af30c3f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:09.941270 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 08:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:10:10.228167 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88c5bb-78ef-4178-a5bc-c43769e25b0a None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:10:10.229822 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-ed88c5bb-78ef-4178-a5bc-c43769e25b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:10.334619 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88c5bb-78ef-4178-a5bc-c43769e25b0a None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:10:10.384400 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:10.409161 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5225a9-6200-4202-8d4c-294ab8d3a1ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:10:10.409765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5225a9-6200-4202-8d4c-294ab8d3a1ac service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:10.410045 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5225a9-6200-4202-8d4c-294ab8d3a1ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:10.410350 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5225a9-6200-4202-8d4c-294ab8d3a1ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:10.411939 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-bf5225a9-6200-4202-8d4c-294ab8d3a1ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:10.518098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5225a9-6200-4202-8d4c-294ab8d3a1ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:10:10.519513 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5225a9-6200-4202-8d4c-294ab8d3a1ac service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:10:10.539523 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 726/1455] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:10:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:10:12.510488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c35df9-bae1-4aa0-ba9a-6e8ff3dc8d85 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:12.511052 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c35df9-bae1-4aa0-ba9a-6e8ff3dc8d85 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:12.511052 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c35df9-bae1-4aa0-ba9a-6e8ff3dc8d85 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:12.512379 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 08:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:10:12.517764 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98601387-02bc-41f0-ae40-6bcb33a73084 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:12.518171 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98601387-02bc-41f0-ae40-6bcb33a73084 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:12.518324 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98601387-02bc-41f0-ae40-6bcb33a73084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:12.582787 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-98601387-02bc-41f0-ae40-6bcb33a73084 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:10:12.583995 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-98601387-02bc-41f0-ae40-6bcb33a73084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:12.612001 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:12.679057 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 08:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:10:12.971230 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c35df9-bae1-4aa0-ba9a-6e8ff3dc8d85 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:10:12.972772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-d4c35df9-bae1-4aa0-ba9a-6e8ff3dc8d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:13.075509 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c35df9-bae1-4aa0-ba9a-6e8ff3dc8d85 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:10:13.103276 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:13.152809 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcb375-e691-4e79-8fcc-daa7493d1934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:10:13.153421 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcb375-e691-4e79-8fcc-daa7493d1934 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:13.153699 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcb375-e691-4e79-8fcc-daa7493d1934 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:13.153968 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcb375-e691-4e79-8fcc-daa7493d1934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:13.155604 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-a3bcb375-e691-4e79-8fcc-daa7493d1934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:13.263076 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bcb375-e691-4e79-8fcc-daa7493d1934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:10:13.264502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bcb375-e691-4e79-8fcc-daa7493d1934 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:10:13.284103 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 731/1458] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:10:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:10:15.263751 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91761111-0201-4b8f-baa4-aee0733d6cc2 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:15.264290 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91761111-0201-4b8f-baa4-aee0733d6cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:15.264290 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91761111-0201-4b8f-baa4-aee0733d6cc2 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:15.265659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 08:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:10:15.270923 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110858d-0da5-4b2d-9aa4-fac6bc57911e None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:15.271335 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110858d-0da5-4b2d-9aa4-fac6bc57911e None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:15.271508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110858d-0da5-4b2d-9aa4-fac6bc57911e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:15.337003 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-6110858d-0da5-4b2d-9aa4-fac6bc57911e None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:10:15.338208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-6110858d-0da5-4b2d-9aa4-fac6bc57911e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:15.346593 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:15.435369 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 08:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:10:15.716103 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91761111-0201-4b8f-baa4-aee0733d6cc2 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:10:15.717627 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-91761111-0201-4b8f-baa4-aee0733d6cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:15.820631 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91761111-0201-4b8f-baa4-aee0733d6cc2 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:10:15.874011 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:15.892549 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a81cf-b94c-4c1a-add9-4b286ab96749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:10:15.907138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a81cf-b94c-4c1a-add9-4b286ab96749 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:15.907138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a81cf-b94c-4c1a-add9-4b286ab96749 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:15.907138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a81cf-b94c-4c1a-add9-4b286ab96749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:15.907138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-4d0a81cf-b94c-4c1a-add9-4b286ab96749 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:16.001164 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a81cf-b94c-4c1a-add9-4b286ab96749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:10:16.002625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a81cf-b94c-4c1a-add9-4b286ab96749 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:10:16.020356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 729/1461] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:10:18.035666 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c79fc-5678-46eb-9624-c7c8de8d8cd8 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:18.036191 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c79fc-5678-46eb-9624-c7c8de8d8cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:18.036191 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c79fc-5678-46eb-9624-c7c8de8d8cd8 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:18.037553 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 08:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:10:18.043787 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b25f6-f390-441a-9990-a8fe23b8dde2 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:18.044201 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b25f6-f390-441a-9990-a8fe23b8dde2 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:18.044351 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b25f6-f390-441a-9990-a8fe23b8dde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:18.110402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-3e8b25f6-f390-441a-9990-a8fe23b8dde2 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:10:18.111724 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-3e8b25f6-f390-441a-9990-a8fe23b8dde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:18.151071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:18.208613 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 08:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:10:18.490621 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c79fc-5678-46eb-9624-c7c8de8d8cd8 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:10:18.492732 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-747c79fc-5678-46eb-9624-c7c8de8d8cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:18.593379 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c79fc-5678-46eb-9624-c7c8de8d8cd8 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:10:18.631006 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:18.666555 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97719c26-5f88-4efd-9fbc-10fb8bf240bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:10:18.667158 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97719c26-5f88-4efd-9fbc-10fb8bf240bf service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:18.667433 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97719c26-5f88-4efd-9fbc-10fb8bf240bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:18.667703 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97719c26-5f88-4efd-9fbc-10fb8bf240bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:18.669282 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-97719c26-5f88-4efd-9fbc-10fb8bf240bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:18.780041 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97719c26-5f88-4efd-9fbc-10fb8bf240bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:10:18.781485 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97719c26-5f88-4efd-9fbc-10fb8bf240bf service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:10:18.798917 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 734/1464] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:10:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:10:20.832793 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee8b80-920d-4668-932d-71997060f966 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:20.833328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee8b80-920d-4668-932d-71997060f966 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:20.833328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee8b80-920d-4668-932d-71997060f966 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:20.834695 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 08:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:10:20.840264 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056eba4a-6d07-47f7-9669-6b2918751fea None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:20.840697 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056eba4a-6d07-47f7-9669-6b2918751fea None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:20.840846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056eba4a-6d07-47f7-9669-6b2918751fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:20.905960 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-056eba4a-6d07-47f7-9669-6b2918751fea None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:10:20.907176 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-056eba4a-6d07-47f7-9669-6b2918751fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:20.924679 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:21.002056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 08:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:10:21.289855 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee8b80-920d-4668-932d-71997060f966 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:10:21.291417 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-b4ee8b80-920d-4668-932d-71997060f966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:21.398084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee8b80-920d-4668-932d-71997060f966 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:10:21.463434 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:21.469995 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b70c4-5d4d-4920-8163-801275b69716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:10:21.470640 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b70c4-5d4d-4920-8163-801275b69716 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:21.473852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b70c4-5d4d-4920-8163-801275b69716 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:21.473852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b70c4-5d4d-4920-8163-801275b69716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:21.473852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-ac6b70c4-5d4d-4920-8163-801275b69716 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:21.583168 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b70c4-5d4d-4920-8163-801275b69716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:10:21.586543 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b70c4-5d4d-4920-8163-801275b69716 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:10:21.603338 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 732/1467] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:10:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:10:23.510834 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2903044-0252-4251-bcb0-865dc49ab117 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:23.511390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2903044-0252-4251-bcb0-865dc49ab117 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:23.511390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2903044-0252-4251-bcb0-865dc49ab117 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:23.512733 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 08:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:10:23.518027 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01618d23-eb88-42cf-bc5e-7ba129ee9dda None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:23.518492 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01618d23-eb88-42cf-bc5e-7ba129ee9dda None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:23.518603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01618d23-eb88-42cf-bc5e-7ba129ee9dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:23.583689 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-01618d23-eb88-42cf-bc5e-7ba129ee9dda None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:10:23.584893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-01618d23-eb88-42cf-bc5e-7ba129ee9dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:23.634405 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:23.682598 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 08:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:10:23.964883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2903044-0252-4251-bcb0-865dc49ab117 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:10:23.966460 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-b2903044-0252-4251-bcb0-865dc49ab117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:24.067989 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2903044-0252-4251-bcb0-865dc49ab117 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:10:24.115167 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:24.141120 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3a2be-8d3d-4048-8d80-761da202b8ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:10:24.141720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3a2be-8d3d-4048-8d80-761da202b8ba service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:24.141999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3a2be-8d3d-4048-8d80-761da202b8ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:24.142271 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3a2be-8d3d-4048-8d80-761da202b8ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:24.143881 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-20b3a2be-8d3d-4048-8d80-761da202b8ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:24.253388 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3a2be-8d3d-4048-8d80-761da202b8ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:10:24.254818 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3a2be-8d3d-4048-8d80-761da202b8ba service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:10:24.273579 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 737/1470] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:10:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:10:33.680792 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=22 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:34.270792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=66 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:43.888339 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c6fd1-6340-4fa0-8512-91fe15809d91 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:43.889162 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c6fd1-6340-4fa0-8512-91fe15809d91 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:43.889162 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c6fd1-6340-4fa0-8512-91fe15809d91 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:43.890329 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 734/1471] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:10:43.897710 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5f46d-2c46-41e3-875b-475b135dcd3c None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:43.898199 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5f46d-2c46-41e3-875b-475b135dcd3c None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:43.898334 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5f46d-2c46-41e3-875b-475b135dcd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:43.975718 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-bde5f46d-2c46-41e3-875b-475b135dcd3c None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:10:43.977033 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-bde5f46d-2c46-41e3-875b-475b135dcd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:44.104005 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 738/1472] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:10:44.416123 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b093d-4485-46f0-8f95-970aae100a73 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:44.416411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b093d-4485-46f0-8f95-970aae100a73 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:44.416684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b093d-4485-46f0-8f95-970aae100a73 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:44.418060 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 735/1473] 10.222.0.57 () {54 vars in 967 bytes} [Tue Aug 23 08:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:10:44.423069 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2fae2-580d-4e83-8883-c188d34769a6 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:44.423356 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2fae2-580d-4e83-8883-c188d34769a6 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:44.423633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2fae2-580d-4e83-8883-c188d34769a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:44.502466 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-c0e2fae2-580d-4e83-8883-c188d34769a6 None None] MFA Rules not processed for user `2f4ee9c3c5be48699a24dfce9b30bda6`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:10:44.503687 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c0e2fae2-580d-4e83-8883-c188d34769a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:44.525129 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:44.581079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 739/1474] 10.222.0.57 () {58 vars in 1064 bytes} [Tue Aug 23 08:10:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:10:44.588600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b093d-4485-46f0-8f95-970aae100a73 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:10:44.590101 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-134b093d-4485-46f0-8f95-970aae100a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:44.694648 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b093d-4485-46f0-8f95-970aae100a73 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:10:44.766636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa4311-a37a-4919-99b9-f54c761d5e9d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f4ee9c3c5be48699a24dfce9b30bda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:10:44.767241 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa4311-a37a-4919-99b9-f54c761d5e9d service glance] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:44.767532 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa4311-a37a-4919-99b9-f54c761d5e9d service glance] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:44.767805 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa4311-a37a-4919-99b9-f54c761d5e9d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:44.769392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-49aa4311-a37a-4919-99b9-f54c761d5e9d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:44.822973 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:44.877138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa4311-a37a-4919-99b9-f54c761d5e9d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:10:44.878614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa4311-a37a-4919-99b9-f54c761d5e9d service glance] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:10:44.897046 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 736/1475] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:10:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:10:46.896507 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b21f2b-a068-4651-b824-36b6314f15d1 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:46.897071 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b21f2b-a068-4651-b824-36b6314f15d1 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:46.897071 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b21f2b-a068-4651-b824-36b6314f15d1 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:46.898448 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 740/1476] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:10:46.903868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594ce8e-d103-4f91-8510-51379b595285 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:46.904275 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594ce8e-d103-4f91-8510-51379b595285 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:46.904395 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594ce8e-d103-4f91-8510-51379b595285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:46.970226 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-5594ce8e-d103-4f91-8510-51379b595285 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:10:46.972116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-5594ce8e-d103-4f91-8510-51379b595285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:47.067781 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 737/1477] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:10:47.344568 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b21f2b-a068-4651-b824-36b6314f15d1 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:10:47.346106 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-d4b21f2b-a068-4651-b824-36b6314f15d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:47.477324 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b21f2b-a068-4651-b824-36b6314f15d1 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:10:47.525376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:47.571825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539636e-f3fc-40bc-8ddf-3fc1c349cc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:10:47.572222 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539636e-f3fc-40bc-8ddf-3fc1c349cc3e admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:47.572502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539636e-f3fc-40bc-8ddf-3fc1c349cc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:47.572772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539636e-f3fc-40bc-8ddf-3fc1c349cc3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:47.573411 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539636e-f3fc-40bc-8ddf-3fc1c349cc3e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:10:47.575670 dv-cinder-854070-4-smb devstack@keystone.service[81771]: WARNING py.warnings [None req-d539636e-f3fc-40bc-8ddf-3fc1c349cc3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 08:10:47.575670 dv-cinder-854070-4-smb devstack@keystone.service[81771]: warnings.warn(msg) Aug 23 08:10:47.575670 dv-cinder-854070-4-smb devstack@keystone.service[81771]: Aug 23 08:10:47.576509 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539636e-f3fc-40bc-8ddf-3fc1c349cc3e admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:10:47.596317 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 741/1478] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 23 08:10:47 2022] GET /identity/v3/projects => generated 2553 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:10:49.565277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c86ca-e431-4c33-b826-89a63053d8ea None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:49.565848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c86ca-e431-4c33-b826-89a63053d8ea None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:49.565848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c86ca-e431-4c33-b826-89a63053d8ea None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:49.567221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 738/1479] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:10:49.572733 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5711e8-2e73-48dc-8bc9-56c7c2b9ff7b None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:49.573177 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5711e8-2e73-48dc-8bc9-56c7c2b9ff7b None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:49.573338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5711e8-2e73-48dc-8bc9-56c7c2b9ff7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:49.640251 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-4e5711e8-2e73-48dc-8bc9-56c7c2b9ff7b None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:10:49.641472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-4e5711e8-2e73-48dc-8bc9-56c7c2b9ff7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:49.741439 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 742/1480] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:10:50.032783 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c86ca-e431-4c33-b826-89a63053d8ea None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:10:50.034433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-2f2c86ca-e431-4c33-b826-89a63053d8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:50.044663 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:50.179975 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c86ca-e431-4c33-b826-89a63053d8ea None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:10:50.261261 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:50.293599 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f10cf-bd8e-48ad-b17f-856248104cee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:10:50.294206 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f10cf-bd8e-48ad-b17f-856248104cee service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:50.294520 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f10cf-bd8e-48ad-b17f-856248104cee service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:50.294794 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f10cf-bd8e-48ad-b17f-856248104cee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:50.296385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-489f10cf-bd8e-48ad-b17f-856248104cee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:50.384559 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f10cf-bd8e-48ad-b17f-856248104cee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:10:50.386180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f10cf-bd8e-48ad-b17f-856248104cee service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:10:50.404238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 739/1481] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:10:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:10:52.509848 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad6054-6ec4-454f-b0ba-93d3baaff7cc None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:52.510473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad6054-6ec4-454f-b0ba-93d3baaff7cc None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:52.510589 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad6054-6ec4-454f-b0ba-93d3baaff7cc None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:52.512535 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 743/1482] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:10:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:10:52.517822 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd9c56-ac1b-447e-9ff4-3d4e4cc3d2ed None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:52.518242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd9c56-ac1b-447e-9ff4-3d4e4cc3d2ed None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:52.518430 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd9c56-ac1b-447e-9ff4-3d4e4cc3d2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:52.582923 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-a4cd9c56-ac1b-447e-9ff4-3d4e4cc3d2ed None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:10:52.584130 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a4cd9c56-ac1b-447e-9ff4-3d4e4cc3d2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:52.629218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:52.681649 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 740/1483] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:10:52.967101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad6054-6ec4-454f-b0ba-93d3baaff7cc None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:10:52.968654 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-e2ad6054-6ec4-454f-b0ba-93d3baaff7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:52.992675 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:53.073107 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad6054-6ec4-454f-b0ba-93d3baaff7cc None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:10:53.147670 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7448808c-b54b-4d5f-851b-a82bea129e2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:10:53.148310 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448808c-b54b-4d5f-851b-a82bea129e2c service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:53.148589 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448808c-b54b-4d5f-851b-a82bea129e2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:53.148885 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448808c-b54b-4d5f-851b-a82bea129e2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:53.150532 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-7448808c-b54b-4d5f-851b-a82bea129e2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:53.226017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:53.262170 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448808c-b54b-4d5f-851b-a82bea129e2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:10:53.263645 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7448808c-b54b-4d5f-851b-a82bea129e2c service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:10:53.281398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 744/1484] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:10:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:10:55.242754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429edeff-4910-4618-87d7-213bbbd06d4a None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:55.243311 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429edeff-4910-4618-87d7-213bbbd06d4a None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:55.243311 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429edeff-4910-4618-87d7-213bbbd06d4a None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:55.244649 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 741/1485] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:10:55.250698 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd138e-5e48-4461-836f-b5c43295902d None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:55.251133 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd138e-5e48-4461-836f-b5c43295902d None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:55.251268 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd138e-5e48-4461-836f-b5c43295902d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:55.316592 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-85cd138e-5e48-4461-836f-b5c43295902d None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:10:55.317809 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-85cd138e-5e48-4461-836f-b5c43295902d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:55.414751 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 745/1486] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:10:55.711305 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429edeff-4910-4618-87d7-213bbbd06d4a None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:10:55.712841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-429edeff-4910-4618-87d7-213bbbd06d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:55.815521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429edeff-4910-4618-87d7-213bbbd06d4a None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:10:55.885405 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:55.887204 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65ec25-8bb4-4a19-b2bd-6755c7043292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:10:55.887803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65ec25-8bb4-4a19-b2bd-6755c7043292 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:55.888081 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65ec25-8bb4-4a19-b2bd-6755c7043292 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:55.888352 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65ec25-8bb4-4a19-b2bd-6755c7043292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:55.890465 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-0a65ec25-8bb4-4a19-b2bd-6755c7043292 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:55.997127 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65ec25-8bb4-4a19-b2bd-6755c7043292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:10:55.998686 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65ec25-8bb4-4a19-b2bd-6755c7043292 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:10:56.017070 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 742/1487] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:10:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:10:58.025715 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4271ea-82c2-4d42-80d8-a6b944f0f34a None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:58.026260 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4271ea-82c2-4d42-80d8-a6b944f0f34a None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:58.026260 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4271ea-82c2-4d42-80d8-a6b944f0f34a None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:58.027623 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 746/1488] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:10:58.033392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5298a-96a4-4e70-a416-61afc60d6490 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:58.033807 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5298a-96a4-4e70-a416-61afc60d6490 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:58.033941 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5298a-96a4-4e70-a416-61afc60d6490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:58.098779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-8ef5298a-96a4-4e70-a416-61afc60d6490 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:10:58.099994 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-8ef5298a-96a4-4e70-a416-61afc60d6490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:58.152637 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:58.197057 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 743/1489] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:10:58.497951 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4271ea-82c2-4d42-80d8-a6b944f0f34a None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:10:58.499518 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-7e4271ea-82c2-4d42-80d8-a6b944f0f34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:58.535671 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:58.601957 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4271ea-82c2-4d42-80d8-a6b944f0f34a None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:10:58.676449 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2c11e-1898-48b8-8bdd-3fc7d2aed365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:10:58.677057 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2c11e-1898-48b8-8bdd-3fc7d2aed365 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:10:58.677333 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2c11e-1898-48b8-8bdd-3fc7d2aed365 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:10:58.677602 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2c11e-1898-48b8-8bdd-3fc7d2aed365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:10:58.679263 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-3cb2c11e-1898-48b8-8bdd-3fc7d2aed365 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:10:58.758352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:58.786726 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2c11e-1898-48b8-8bdd-3fc7d2aed365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:10:58.788112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2c11e-1898-48b8-8bdd-3fc7d2aed365 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:10:58.808582 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 747/1490] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:10:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:11:01.033449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e6bfe-53af-4a75-9723-8354d9e98132 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:11:01.034856 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e6bfe-53af-4a75-9723-8354d9e98132 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:11:01.034856 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e6bfe-53af-4a75-9723-8354d9e98132 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:11:01.036136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 744/1491] 10.222.0.57 () {54 vars in 927 bytes} [Tue Aug 23 08:11:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:11:01.041382 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb85c4c-4efd-4583-b73e-451e789e4618 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:11:01.041824 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb85c4c-4efd-4583-b73e-451e789e4618 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:11:01.041938 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb85c4c-4efd-4583-b73e-451e789e4618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:11:01.224771 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-3eb85c4c-4efd-4583-b73e-451e789e4618 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:11:01.225991 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-3eb85c4c-4efd-4583-b73e-451e789e4618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:11:01.324171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 748/1492] 10.222.0.57 () {58 vars in 1024 bytes} [Tue Aug 23 08:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:11:01.625516 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e6bfe-53af-4a75-9723-8354d9e98132 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:11:01.627084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-bf1e6bfe-53af-4a75-9723-8354d9e98132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:11:01.738345 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e6bfe-53af-4a75-9723-8354d9e98132 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:11:01.811848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17e5ce-e09e-4edc-a91d-0039adcc4163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:11:01.812448 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17e5ce-e09e-4edc-a91d-0039adcc4163 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:11:01.812725 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17e5ce-e09e-4edc-a91d-0039adcc4163 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:11:01.812992 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17e5ce-e09e-4edc-a91d-0039adcc4163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:11:01.814611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-de17e5ce-e09e-4edc-a91d-0039adcc4163 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:11:01.824242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:11:01.920853 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17e5ce-e09e-4edc-a91d-0039adcc4163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:11:01.922230 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17e5ce-e09e-4edc-a91d-0039adcc4163 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:11:01.940396 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 745/1493] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:11:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:11:11.322019 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=82 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:11:11.938223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=50 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:13:28.689799 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dc815-87b9-4e4b-bbfd-9ee9ce53bc30 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:13:28.690333 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dc815-87b9-4e4b-bbfd-9ee9ce53bc30 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:13:28.690443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dc815-87b9-4e4b-bbfd-9ee9ce53bc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:13:28.769488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-393dc815-87b9-4e4b-bbfd-9ee9ce53bc30 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:13:28.770706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-393dc815-87b9-4e4b-bbfd-9ee9ce53bc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:13:28.871006 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 749/1494] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:13:28.878952 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f8749-ba17-430b-96b9-2539258f54f3 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:13:28.879435 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f8749-ba17-430b-96b9-2539258f54f3 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:13:28.879541 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f8749-ba17-430b-96b9-2539258f54f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:13:28.899706 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-027f8749-ba17-430b-96b9-2539258f54f3 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:13:28.900848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-027f8749-ba17-430b-96b9-2539258f54f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:13:28.909240 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 746/1495] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:13:28.913791 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dc815-87b9-4e4b-bbfd-9ee9ce53bc30 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:13:28.923196 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dc815-87b9-4e4b-bbfd-9ee9ce53bc30 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:13:28.927677 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58cf223-8f50-423b-a91c-8b0571e5b8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:13:28.928797 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58cf223-8f50-423b-a91c-8b0571e5b8ca admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:13:28.929069 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58cf223-8f50-423b-a91c-8b0571e5b8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:13:28.929334 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58cf223-8f50-423b-a91c-8b0571e5b8ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:13:28.929960 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58cf223-8f50-423b-a91c-8b0571e5b8ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:13:28.930256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58cf223-8f50-423b-a91c-8b0571e5b8ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:13:28.931543 dv-cinder-854070-4-smb devstack@keystone.service[81771]: WARNING py.warnings [None req-f58cf223-8f50-423b-a91c-8b0571e5b8ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 08:13:28.931543 dv-cinder-854070-4-smb devstack@keystone.service[81771]: warnings.warn(msg) Aug 23 08:13:28.931543 dv-cinder-854070-4-smb devstack@keystone.service[81771]: Aug 23 08:13:28.932413 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58cf223-8f50-423b-a91c-8b0571e5b8ca admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:13:28.944673 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 750/1496] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:13:28.952756 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f8749-ba17-430b-96b9-2539258f54f3 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:13:28.961705 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f8749-ba17-430b-96b9-2539258f54f3 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:13:28.966270 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d1184-6e0e-4ade-a930-5d0e0ebcd46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:13:28.966880 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d1184-6e0e-4ade-a930-5d0e0ebcd46f admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:13:28.967158 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d1184-6e0e-4ade-a930-5d0e0ebcd46f admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:13:28.967427 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d1184-6e0e-4ade-a930-5d0e0ebcd46f admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:13:28.968044 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d1184-6e0e-4ade-a930-5d0e0ebcd46f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:13:28.969767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: WARNING py.warnings [None req-205d1184-6e0e-4ade-a930-5d0e0ebcd46f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 08:13:28.969767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: warnings.warn(msg) Aug 23 08:13:28.969767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: Aug 23 08:13:28.970987 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d1184-6e0e-4ade-a930-5d0e0ebcd46f admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:13:29.150157 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 747/1497] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:13:28 2022] POST /identity/v3/projects => generated 379 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:13:29.154166 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58cf223-8f50-423b-a91c-8b0571e5b8ca admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:13:29.164719 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58cf223-8f50-423b-a91c-8b0571e5b8ca admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:13:29.214400 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:13:29.220870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac0bb7-7868-4542-86f6-ec69da947498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:13:29.221474 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac0bb7-7868-4542-86f6-ec69da947498 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:13:29.221760 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac0bb7-7868-4542-86f6-ec69da947498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:13:29.222035 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac0bb7-7868-4542-86f6-ec69da947498 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:13:29.222706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac0bb7-7868-4542-86f6-ec69da947498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:13:29.223734 dv-cinder-854070-4-smb devstack@keystone.service[81771]: WARNING py.warnings [None req-3fac0bb7-7868-4542-86f6-ec69da947498 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 08:13:29.223734 dv-cinder-854070-4-smb devstack@keystone.service[81771]: warnings.warn(msg) Aug 23 08:13:29.223734 dv-cinder-854070-4-smb devstack@keystone.service[81771]: Aug 23 08:13:29.225471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac0bb7-7868-4542-86f6-ec69da947498 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:13:29.355594 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 751/1498] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:13:29 2022] POST /identity/v3/users => generated 290 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:13:29.359712 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d1184-6e0e-4ade-a930-5d0e0ebcd46f admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:13:29.369911 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d1184-6e0e-4ade-a930-5d0e0ebcd46f admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:13:29.374531 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7980dd-ebec-4212-9b48-ca20318a9d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:13:29.375925 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7980dd-ebec-4212-9b48-ca20318a9d9e admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:13:29.375925 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7980dd-ebec-4212-9b48-ca20318a9d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:13:29.375925 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7980dd-ebec-4212-9b48-ca20318a9d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:13:29.376303 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7980dd-ebec-4212-9b48-ca20318a9d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:13:29.377384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: WARNING py.warnings [None req-8f7980dd-ebec-4212-9b48-ca20318a9d9e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 08:13:29.377384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: warnings.warn(msg) Aug 23 08:13:29.377384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: Aug 23 08:13:29.378273 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7980dd-ebec-4212-9b48-ca20318a9d9e admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:13:29.391065 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 748/1499] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:13:29.395087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac0bb7-7868-4542-86f6-ec69da947498 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:13:29.405840 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac0bb7-7868-4542-86f6-ec69da947498 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:13:29.410386 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f19f87-c432-4383-b1a7-7f5683c461fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:13:29.411020 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f19f87-c432-4383-b1a7-7f5683c461fb admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:13:29.411302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f19f87-c432-4383-b1a7-7f5683c461fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:13:29.411576 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f19f87-c432-4383-b1a7-7f5683c461fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:13:29.412211 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f19f87-c432-4383-b1a7-7f5683c461fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:13:29.413935 dv-cinder-854070-4-smb devstack@keystone.service[81771]: WARNING py.warnings [None req-06f19f87-c432-4383-b1a7-7f5683c461fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 08:13:29.413935 dv-cinder-854070-4-smb devstack@keystone.service[81771]: warnings.warn(msg) Aug 23 08:13:29.413935 dv-cinder-854070-4-smb devstack@keystone.service[81771]: Aug 23 08:13:29.414850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f19f87-c432-4383-b1a7-7f5683c461fb admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:13:29.429292 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 752/1500] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:13:29.433744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7980dd-ebec-4212-9b48-ca20318a9d9e admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:13:29.443803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7980dd-ebec-4212-9b48-ca20318a9d9e admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:13:29.448177 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006bea2-5e05-427b-87fa-9a16e5726573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:13:29.448815 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006bea2-5e05-427b-87fa-9a16e5726573 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:13:29.449092 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006bea2-5e05-427b-87fa-9a16e5726573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:13:29.449363 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006bea2-5e05-427b-87fa-9a16e5726573 admin admin] PATH_INFO: `/v3/projects/51ff38162037469a98b9ec9d28622c48/users/0180710f05b04badac88a482b682c1d4/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:13:29.464151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006bea2-5e05-427b-87fa-9a16e5726573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51ff38162037469a98b9ec9d28622c48, user_id=0180710f05b04badac88a482b682c1d4, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:13:29.465172 dv-cinder-854070-4-smb devstack@keystone.service[81770]: WARNING py.warnings [None req-6006bea2-5e05-427b-87fa-9a16e5726573 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 08:13:29.465172 dv-cinder-854070-4-smb devstack@keystone.service[81770]: warnings.warn(msg) Aug 23 08:13:29.465172 dv-cinder-854070-4-smb devstack@keystone.service[81770]: Aug 23 08:13:29.467147 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006bea2-5e05-427b-87fa-9a16e5726573 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:13:29.543292 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 749/1501] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:13:29 2022] PUT /identity/v3/projects/51ff38162037469a98b9ec9d28622c48/users/0180710f05b04badac88a482b682c1d4/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:13:29.555551 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efaa0f6-c729-430d-b1cb-2ffb8e509a53 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:13:29.556101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efaa0f6-c729-430d-b1cb-2ffb8e509a53 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:13:29.556371 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efaa0f6-c729-430d-b1cb-2ffb8e509a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:13:29.583196 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-6efaa0f6-c729-430d-b1cb-2ffb8e509a53 None None] MFA Rules not processed for user `0180710f05b04badac88a482b682c1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:13:29.584917 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-6efaa0f6-c729-430d-b1cb-2ffb8e509a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:13:29.645856 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 753/1502] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:13:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:13:29.659740 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d9737-3999-46fb-9c77-a05ebd5245a2 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:13:29.659965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d9737-3999-46fb-9c77-a05ebd5245a2 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:13:29.660236 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d9737-3999-46fb-9c77-a05ebd5245a2 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:13:29.661572 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 750/1503] 10.222.0.57 () {54 vars in 964 bytes} [Tue Aug 23 08:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:13:29.667081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb8eac-2780-4a2d-8686-0a4651587124 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:13:29.667367 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb8eac-2780-4a2d-8686-0a4651587124 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:13:29.667670 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb8eac-2780-4a2d-8686-0a4651587124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:13:29.726088 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-5acb8eac-2780-4a2d-8686-0a4651587124 None None] MFA Rules not processed for user `8c3e2f6c4d8f4798a5fa271bb0b0154b`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:13:29.727310 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-5acb8eac-2780-4a2d-8686-0a4651587124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:13:29.800394 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 754/1504] 10.222.0.57 () {58 vars in 1061 bytes} [Tue Aug 23 08:13:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:13:29.808362 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d9737-3999-46fb-9c77-a05ebd5245a2 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:13:29.819701 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d9737-3999-46fb-9c77-a05ebd5245a2 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:13:29.823301 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a75d14-b6e0-4ec8-a717-e478356b4e43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:13:29.823895 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a75d14-b6e0-4ec8-a717-e478356b4e43 service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:13:29.824172 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a75d14-b6e0-4ec8-a717-e478356b4e43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:13:29.824444 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a75d14-b6e0-4ec8-a717-e478356b4e43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:13:29.832612 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a75d14-b6e0-4ec8-a717-e478356b4e43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:13:29.836365 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a75d14-b6e0-4ec8-a717-e478356b4e43 service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:13:29.843783 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 751/1505] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:13:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:13:29.897877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ed86e-fd6f-43b4-9ad9-e936d3ef7548 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:13:29.898158 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ed86e-fd6f-43b4-9ad9-e936d3ef7548 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:13:29.898467 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ed86e-fd6f-43b4-9ad9-e936d3ef7548 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:13:29.899709 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 755/1506] 10.222.0.57 () {52 vars in 830 bytes} [Tue Aug 23 08:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:13:29.903314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a75d14-b6e0-4ec8-a717-e478356b4e43 service cinder] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:13:29.964241 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a75d14-b6e0-4ec8-a717-e478356b4e43 service cinder] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:13:29.968767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569c4f2-5d62-4b02-a3c1-7494f26b9ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:13:29.969382 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569c4f2-5d62-4b02-a3c1-7494f26b9ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:13:29.969662 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569c4f2-5d62-4b02-a3c1-7494f26b9ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:13:29.969936 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569c4f2-5d62-4b02-a3c1-7494f26b9ce9 admin admin] PATH_INFO: `/v3/users/0180710f05b04badac88a482b682c1d4` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:13:29.971195 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569c4f2-5d62-4b02-a3c1-7494f26b9ce9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0180710f05b04badac88a482b682c1d4)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:13:29.972264 dv-cinder-854070-4-smb devstack@keystone.service[81770]: WARNING py.warnings [None req-f569c4f2-5d62-4b02-a3c1-7494f26b9ce9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 08:13:29.972264 dv-cinder-854070-4-smb devstack@keystone.service[81770]: warnings.warn(msg) Aug 23 08:13:29.972264 dv-cinder-854070-4-smb devstack@keystone.service[81770]: Aug 23 08:13:29.973521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569c4f2-5d62-4b02-a3c1-7494f26b9ce9 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:13:30.192972 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-f569c4f2-5d62-4b02-a3c1-7494f26b9ce9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0180710f05b04badac88a482b682c1d4'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:13:30.193648 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-f569c4f2-5d62-4b02-a3c1-7494f26b9ce9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0180710f05b04badac88a482b682c1d4'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:13:30.195006 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-f569c4f2-5d62-4b02-a3c1-7494f26b9ce9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0180710f05b04badac88a482b682c1d4'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:13:30.280360 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-f569c4f2-5d62-4b02-a3c1-7494f26b9ce9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0180710f05b04badac88a482b682c1d4'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:13:30.295481 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-f569c4f2-5d62-4b02-a3c1-7494f26b9ce9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0180710f05b04badac88a482b682c1d4'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:13:30.319942 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:13:30.328112 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 752/1507] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:13:29 2022] DELETE /identity/v3/users/0180710f05b04badac88a482b682c1d4 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:13:30.337410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee08289-369b-4d20-b538-7659b46ddd28 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:13:30.337410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee08289-369b-4d20-b538-7659b46ddd28 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:13:30.337410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee08289-369b-4d20-b538-7659b46ddd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:13:30.351806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-eee08289-369b-4d20-b538-7659b46ddd28 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:13:30.352985 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-eee08289-369b-4d20-b538-7659b46ddd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:13:30.361974 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:13:30.409876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 756/1508] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:13:30.419665 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569c4f2-5d62-4b02-a3c1-7494f26b9ce9 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:13:30.421095 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-f569c4f2-5d62-4b02-a3c1-7494f26b9ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:13:30.499284 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569c4f2-5d62-4b02-a3c1-7494f26b9ce9 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:13:30.502913 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22b804-810f-41a0-95c9-71da6e65fb6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:13:30.503520 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22b804-810f-41a0-95c9-71da6e65fb6a service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:13:30.503796 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22b804-810f-41a0-95c9-71da6e65fb6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:13:30.504067 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22b804-810f-41a0-95c9-71da6e65fb6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:13:30.513122 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22b804-810f-41a0-95c9-71da6e65fb6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:13:30.514589 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22b804-810f-41a0-95c9-71da6e65fb6a service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:13:30.523849 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 753/1509] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:13:30.995328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee08289-369b-4d20-b538-7659b46ddd28 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:13:30.996803 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-eee08289-369b-4d20-b538-7659b46ddd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:13:31.008642 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee08289-369b-4d20-b538-7659b46ddd28 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:13:31.013400 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa83d01-3016-4234-a413-f5513ae373e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:13:31.014065 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa83d01-3016-4234-a413-f5513ae373e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:13:31.014253 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa83d01-3016-4234-a413-f5513ae373e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:13:31.014588 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa83d01-3016-4234-a413-f5513ae373e9 admin admin] PATH_INFO: `/v3/projects/51ff38162037469a98b9ec9d28622c48` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:13:31.015723 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa83d01-3016-4234-a413-f5513ae373e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51ff38162037469a98b9ec9d28622c48)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:13:31.016748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: WARNING py.warnings [None req-0aa83d01-3016-4234-a413-f5513ae373e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 08:13:31.016748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: warnings.warn(msg) Aug 23 08:13:31.016748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: Aug 23 08:13:31.017960 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa83d01-3016-4234-a413-f5513ae373e9 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:13:31.153650 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0aa83d01-3016-4234-a413-f5513ae373e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51ff38162037469a98b9ec9d28622c48', 'request_id': 'req-0aa83d01-3016-4234-a413-f5513ae373e9'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:13:31.159834 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0aa83d01-3016-4234-a413-f5513ae373e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51ff38162037469a98b9ec9d28622c48', 'request_id': 'req-0aa83d01-3016-4234-a413-f5513ae373e9'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:13:31.173549 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0aa83d01-3016-4234-a413-f5513ae373e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51ff38162037469a98b9ec9d28622c48', 'request_id': 'req-0aa83d01-3016-4234-a413-f5513ae373e9'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:13:31.263898 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0aa83d01-3016-4234-a413-f5513ae373e9 admin admin] The token cache is being invalidate because project 51ff38162037469a98b9ec9d28622c48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:13:31.264190 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0aa83d01-3016-4234-a413-f5513ae373e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:13:31.264859 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0aa83d01-3016-4234-a413-f5513ae373e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:13:31.266507 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 757/1510] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:13:30 2022] DELETE /identity/v3/projects/51ff38162037469a98b9ec9d28622c48 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:13:40.519726 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:13:41.260546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:15:05.447245 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0356a1-3458-46b5-89c0-3bb4a48a7c03 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:05.447803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0356a1-3458-46b5-89c0-3bb4a48a7c03 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:05.447803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0356a1-3458-46b5-89c0-3bb4a48a7c03 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:05.449289 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 08:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:15:05.454561 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734505fb-d5f1-4733-9c77-9c493b0e1501 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:05.455000 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734505fb-d5f1-4733-9c77-9c493b0e1501 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:05.455129 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734505fb-d5f1-4733-9c77-9c493b0e1501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:05.477078 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-734505fb-d5f1-4733-9c77-9c493b0e1501 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:15:05.478413 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-734505fb-d5f1-4733-9c77-9c493b0e1501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:15:05.536463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 08:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:15:05.693396 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0356a1-3458-46b5-89c0-3bb4a48a7c03 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:15:05.695241 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-7c0356a1-3458-46b5-89c0-3bb4a48a7c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:15:05.796912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0356a1-3458-46b5-89c0-3bb4a48a7c03 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:15:05.802478 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61812b5a-dc81-42c5-9a65-0d481d2691a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:15:05.803077 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61812b5a-dc81-42c5-9a65-0d481d2691a6 service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:05.803360 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61812b5a-dc81-42c5-9a65-0d481d2691a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:05.803636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61812b5a-dc81-42c5-9a65-0d481d2691a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:05.811693 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61812b5a-dc81-42c5-9a65-0d481d2691a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:15:05.813269 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61812b5a-dc81-42c5-9a65-0d481d2691a6 service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:15:05.822919 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 755/1513] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:15:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:15:06.662734 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc73d2-8cd3-45e4-a0ac-be70400a3c2d None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:06.663251 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc73d2-8cd3-45e4-a0ac-be70400a3c2d None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:06.663364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc73d2-8cd3-45e4-a0ac-be70400a3c2d None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:06.664679 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 08:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:15:06.669542 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03647d1b-cc7a-4a73-9bb8-c602917228aa None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:06.669966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03647d1b-cc7a-4a73-9bb8-c602917228aa None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:06.670108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03647d1b-cc7a-4a73-9bb8-c602917228aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:06.690637 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-03647d1b-cc7a-4a73-9bb8-c602917228aa None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:15:06.691843 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-03647d1b-cc7a-4a73-9bb8-c602917228aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:15:06.699952 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 08:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:15:06.854346 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc73d2-8cd3-45e4-a0ac-be70400a3c2d None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:15:06.869017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc73d2-8cd3-45e4-a0ac-be70400a3c2d None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:15:06.874403 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f7ef7-2230-4369-8bd6-8e9d8ce50ace service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:15:06.874995 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f7ef7-2230-4369-8bd6-8e9d8ce50ace service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:06.875273 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f7ef7-2230-4369-8bd6-8e9d8ce50ace service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:06.875544 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f7ef7-2230-4369-8bd6-8e9d8ce50ace service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:06.883492 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f7ef7-2230-4369-8bd6-8e9d8ce50ace service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:15:06.885081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f7ef7-2230-4369-8bd6-8e9d8ce50ace service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:15:06.894373 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 760/1516] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:15:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:15:07.279266 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d30dcd-da5c-43dd-9e10-9b1c68be8fe5 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:07.279551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d30dcd-da5c-43dd-9e10-9b1c68be8fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:07.279826 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d30dcd-da5c-43dd-9e10-9b1c68be8fe5 None None] PATH_INFO: `/v3` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:07.281097 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 757/1517] 10.222.0.40 () {54 vars in 925 bytes} [Tue Aug 23 08:15:07 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:15:07.287321 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2382d0-dd63-4c3e-951e-d3bb9f1cf744 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:07.287613 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2382d0-dd63-4c3e-951e-d3bb9f1cf744 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:07.287890 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2382d0-dd63-4c3e-951e-d3bb9f1cf744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:07.336250 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-2f2382d0-dd63-4c3e-951e-d3bb9f1cf744 None None] MFA Rules not processed for user `8e92560dd9da4c7cbcac5a84bcaca483`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:15:07.337457 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-2f2382d0-dd63-4c3e-951e-d3bb9f1cf744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:15:07.414613 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 761/1518] 10.222.0.40 () {58 vars in 1015 bytes} [Tue Aug 23 08:15:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:15:16.621080 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7de51-8240-4128-bd9a-9bdf5a1949a0 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:16.621651 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7de51-8240-4128-bd9a-9bdf5a1949a0 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:16.621651 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7de51-8240-4128-bd9a-9bdf5a1949a0 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:16.622880 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 758/1519] 10.222.0.57 () {54 vars in 961 bytes} [Tue Aug 23 08:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:15:16.627941 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8b2c8-ad08-4a19-81e7-e426ce8e9115 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:16.628456 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8b2c8-ad08-4a19-81e7-e426ce8e9115 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:16.628633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8b2c8-ad08-4a19-81e7-e426ce8e9115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:16.647823 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-a1a8b2c8-ad08-4a19-81e7-e426ce8e9115 None None] MFA Rules not processed for user `8e92560dd9da4c7cbcac5a84bcaca483`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:15:16.649093 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-a1a8b2c8-ad08-4a19-81e7-e426ce8e9115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:15:16.657824 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 762/1520] 10.222.0.57 () {58 vars in 1058 bytes} [Tue Aug 23 08:15:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:15:16.666070 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7de51-8240-4128-bd9a-9bdf5a1949a0 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:15:16.679945 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7de51-8240-4128-bd9a-9bdf5a1949a0 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:15:16.684811 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77031466-314a-4dae-8501-3182cff2f1c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e92560dd9da4c7cbcac5a84bcaca483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:15:16.685394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77031466-314a-4dae-8501-3182cff2f1c8 service placement] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:16.685671 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77031466-314a-4dae-8501-3182cff2f1c8 service placement] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:16.685954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77031466-314a-4dae-8501-3182cff2f1c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:16.694673 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77031466-314a-4dae-8501-3182cff2f1c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:15:16.696246 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77031466-314a-4dae-8501-3182cff2f1c8 service placement] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:15:16.705817 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 759/1521] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:15:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:15:18.136164 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319115fc-fd88-44a8-a7c8-865b174ac755 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:18.136759 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319115fc-fd88-44a8-a7c8-865b174ac755 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:18.136759 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319115fc-fd88-44a8-a7c8-865b174ac755 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:18.138067 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 08:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:15:18.143160 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2374e-4f39-449e-a318-1103087131a5 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:18.143566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2374e-4f39-449e-a318-1103087131a5 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:18.143710 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2374e-4f39-449e-a318-1103087131a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:18.163395 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-a8a2374e-4f39-449e-a318-1103087131a5 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:15:18.164597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a8a2374e-4f39-449e-a318-1103087131a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:15:18.172348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 08:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:15:18.327460 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319115fc-fd88-44a8-a7c8-865b174ac755 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:15:18.341803 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319115fc-fd88-44a8-a7c8-865b174ac755 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:15:18.347895 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f985d4-9a72-43f0-adca-666b737a22a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:15:18.348683 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f985d4-9a72-43f0-adca-666b737a22a1 service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:18.348967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f985d4-9a72-43f0-adca-666b737a22a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:18.349239 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f985d4-9a72-43f0-adca-666b737a22a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:18.357350 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f985d4-9a72-43f0-adca-666b737a22a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:15:18.358996 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f985d4-9a72-43f0-adca-666b737a22a1 service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:15:18.369134 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 764/1524] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:15:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:15:19.182625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3571b9-730f-4244-b542-a2e70f85ebc6 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:19.183139 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3571b9-730f-4244-b542-a2e70f85ebc6 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:19.183139 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3571b9-730f-4244-b542-a2e70f85ebc6 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:19.184449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 08:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 08:15:19.189344 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2d3bd-dca3-4bbb-b6ba-f148c574f9ba None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:19.189798 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2d3bd-dca3-4bbb-b6ba-f148c574f9ba None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:19.189908 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2d3bd-dca3-4bbb-b6ba-f148c574f9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:19.209495 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-1fd2d3bd-dca3-4bbb-b6ba-f148c574f9ba None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:15:19.210711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-1fd2d3bd-dca3-4bbb-b6ba-f148c574f9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:15:19.218504 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 08:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:15:19.381943 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3571b9-730f-4244-b542-a2e70f85ebc6 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:15:19.397044 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3571b9-730f-4244-b542-a2e70f85ebc6 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:15:19.402507 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c00d68-22e4-47b2-b8f6-a44358e44264 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:15:19.403107 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c00d68-22e4-47b2-b8f6-a44358e44264 service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:19.403389 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c00d68-22e4-47b2-b8f6-a44358e44264 service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:19.403665 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c00d68-22e4-47b2-b8f6-a44358e44264 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:19.412387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c00d68-22e4-47b2-b8f6-a44358e44264 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:15:19.413958 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c00d68-22e4-47b2-b8f6-a44358e44264 service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:15:19.423317 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 762/1527] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:15:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:15:23.235649 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09766d-9bf7-4dd9-8990-9c236fb2c842 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:23.236205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09766d-9bf7-4dd9-8990-9c236fb2c842 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:23.236205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09766d-9bf7-4dd9-8990-9c236fb2c842 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:23.237539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 08:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:15:23.242891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63833c-08d2-4d16-9a74-fa2cdcb0588c None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:23.243331 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63833c-08d2-4d16-9a74-fa2cdcb0588c None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:23.243440 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63833c-08d2-4d16-9a74-fa2cdcb0588c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:23.262856 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-de63833c-08d2-4d16-9a74-fa2cdcb0588c None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:15:23.264069 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-de63833c-08d2-4d16-9a74-fa2cdcb0588c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:15:23.272597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 08:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:15:23.562377 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09766d-9bf7-4dd9-8990-9c236fb2c842 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:15:23.564038 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-7c09766d-9bf7-4dd9-8990-9c236fb2c842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:15:23.592892 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:15:23.620712 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09766d-9bf7-4dd9-8990-9c236fb2c842 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:15:23.624636 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6048c5-8654-4fe4-b583-0787dda90187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:15:23.625226 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6048c5-8654-4fe4-b583-0787dda90187 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:23.625502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6048c5-8654-4fe4-b583-0787dda90187 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:23.625770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6048c5-8654-4fe4-b583-0787dda90187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:23.634973 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6048c5-8654-4fe4-b583-0787dda90187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:15:23.636430 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6048c5-8654-4fe4-b583-0787dda90187 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:15:23.646890 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 767/1530] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:15:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:15:25.568990 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b954661-d1f0-4640-bebe-c93cbdbb3812 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:25.569560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b954661-d1f0-4640-bebe-c93cbdbb3812 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:25.569560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b954661-d1f0-4640-bebe-c93cbdbb3812 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:25.570980 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 08:15:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:15:25.576593 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092107f5-c14a-4ac3-90e0-d9074320bd69 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:25.577023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092107f5-c14a-4ac3-90e0-d9074320bd69 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:25.577133 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092107f5-c14a-4ac3-90e0-d9074320bd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:25.596042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-092107f5-c14a-4ac3-90e0-d9074320bd69 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:15:25.597221 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-092107f5-c14a-4ac3-90e0-d9074320bd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:15:25.605557 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 08:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:15:25.887834 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b954661-d1f0-4640-bebe-c93cbdbb3812 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:15:25.889519 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-1b954661-d1f0-4640-bebe-c93cbdbb3812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:15:25.902547 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b954661-d1f0-4640-bebe-c93cbdbb3812 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:15:25.906171 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6aa9ab-6838-4d12-bb00-9fede603b787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:15:25.906851 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6aa9ab-6838-4d12-bb00-9fede603b787 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:25.907129 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6aa9ab-6838-4d12-bb00-9fede603b787 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:25.907397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6aa9ab-6838-4d12-bb00-9fede603b787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:25.917011 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6aa9ab-6838-4d12-bb00-9fede603b787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:15:25.918491 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6aa9ab-6838-4d12-bb00-9fede603b787 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:15:25.928516 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 765/1533] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:15:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:15:29.630824 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201c35b-2542-46ce-af32-8d8ab603ec10 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:29.631347 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201c35b-2542-46ce-af32-8d8ab603ec10 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:29.631347 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201c35b-2542-46ce-af32-8d8ab603ec10 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:29.632638 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 08:15:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:15:29.638059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962bd75-6085-43c5-8ea4-da84e9b99bb5 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:29.638534 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962bd75-6085-43c5-8ea4-da84e9b99bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:29.638642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962bd75-6085-43c5-8ea4-da84e9b99bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:29.658639 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-a962bd75-6085-43c5-8ea4-da84e9b99bb5 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:15:29.659859 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a962bd75-6085-43c5-8ea4-da84e9b99bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:15:29.668047 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 08:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:15:30.224730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201c35b-2542-46ce-af32-8d8ab603ec10 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:15:30.226434 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-8201c35b-2542-46ce-af32-8d8ab603ec10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:15:30.282853 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201c35b-2542-46ce-af32-8d8ab603ec10 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:15:30.286457 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396049db-f5b2-4956-ba98-37777da84f41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:15:30.287218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396049db-f5b2-4956-ba98-37777da84f41 service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:30.287499 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396049db-f5b2-4956-ba98-37777da84f41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:30.287772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396049db-f5b2-4956-ba98-37777da84f41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:30.296407 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396049db-f5b2-4956-ba98-37777da84f41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:15:30.297841 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396049db-f5b2-4956-ba98-37777da84f41 service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:15:30.307301 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 770/1536] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:15:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:15:32.244250 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f884cd9-befa-47cf-a5cf-e4d134beb8b9 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:32.244821 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f884cd9-befa-47cf-a5cf-e4d134beb8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:32.244821 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f884cd9-befa-47cf-a5cf-e4d134beb8b9 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:32.246189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 08:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:15:32.251457 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ed799-9f4c-477a-9691-642c83bd9bf0 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:32.251851 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ed799-9f4c-477a-9691-642c83bd9bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:32.252022 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ed799-9f4c-477a-9691-642c83bd9bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:32.271420 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-8f6ed799-9f4c-477a-9691-642c83bd9bf0 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:15:32.272682 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-8f6ed799-9f4c-477a-9691-642c83bd9bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:15:32.280354 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 08:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:15:32.842444 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f884cd9-befa-47cf-a5cf-e4d134beb8b9 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:15:32.845374 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-1f884cd9-befa-47cf-a5cf-e4d134beb8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:15:32.852131 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=77 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:15:32.857844 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f884cd9-befa-47cf-a5cf-e4d134beb8b9 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:15:32.861394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd535866-c3c7-4fc4-a3e9-0234f622d20c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:15:32.861991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd535866-c3c7-4fc4-a3e9-0234f622d20c service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:15:32.862273 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd535866-c3c7-4fc4-a3e9-0234f622d20c service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:15:32.862576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd535866-c3c7-4fc4-a3e9-0234f622d20c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:15:32.871982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd535866-c3c7-4fc4-a3e9-0234f622d20c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:15:32.873415 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd535866-c3c7-4fc4-a3e9-0234f622d20c service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:15:32.883451 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 768/1539] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:15:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:15:42.265716 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=47 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:15:42.994907 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=5 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:09.205643 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4f258-a7d6-4dc8-bbf9-64f91ed3e51e None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:09.206848 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4f258-a7d6-4dc8-bbf9-64f91ed3e51e None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:09.207352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4f258-a7d6-4dc8-bbf9-64f91ed3e51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:09.237124 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-53f4f258-a7d6-4dc8-bbf9-64f91ed3e51e None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:09.242509 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-53f4f258-a7d6-4dc8-bbf9-64f91ed3e51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:09.251446 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 772/1540] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:09.261741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa50476-c325-44e5-878a-1a6815acd80f None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:09.262855 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa50476-c325-44e5-878a-1a6815acd80f None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:09.263339 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa50476-c325-44e5-878a-1a6815acd80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:09.291542 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-caa50476-c325-44e5-878a-1a6815acd80f None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:09.293985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-caa50476-c325-44e5-878a-1a6815acd80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:09.304310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 769/1541] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:09.309771 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4f258-a7d6-4dc8-bbf9-64f91ed3e51e None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:09.325025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4f258-a7d6-4dc8-bbf9-64f91ed3e51e None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:09.332456 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39507bcb-7c6c-4979-bfe3-61736d7d69a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:09.333394 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39507bcb-7c6c-4979-bfe3-61736d7d69a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:09.333887 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39507bcb-7c6c-4979-bfe3-61736d7d69a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:09.334423 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39507bcb-7c6c-4979-bfe3-61736d7d69a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:09.335321 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39507bcb-7c6c-4979-bfe3-61736d7d69a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:17:09.335833 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39507bcb-7c6c-4979-bfe3-61736d7d69a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:09.337714 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39507bcb-7c6c-4979-bfe3-61736d7d69a6 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:09.355070 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 773/1542] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:17:09.364982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa50476-c325-44e5-878a-1a6815acd80f None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:09.376222 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa50476-c325-44e5-878a-1a6815acd80f None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:09.387315 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305616e8-1a0e-47b0-a7ca-b45fb4dfd79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:09.388317 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305616e8-1a0e-47b0-a7ca-b45fb4dfd79b admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:09.388801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305616e8-1a0e-47b0-a7ca-b45fb4dfd79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:09.389287 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305616e8-1a0e-47b0-a7ca-b45fb4dfd79b admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:09.390143 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305616e8-1a0e-47b0-a7ca-b45fb4dfd79b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:09.392379 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305616e8-1a0e-47b0-a7ca-b45fb4dfd79b admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:09.495441 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 770/1543] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:17:09 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:09.500151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39507bcb-7c6c-4979-bfe3-61736d7d69a6 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:09.515813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39507bcb-7c6c-4979-bfe3-61736d7d69a6 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:09.584064 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110df45-5ccd-4435-aa61-eaf11d6670d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:09.585071 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110df45-5ccd-4435-aa61-eaf11d6670d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:09.585544 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110df45-5ccd-4435-aa61-eaf11d6670d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:09.587468 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110df45-5ccd-4435-aa61-eaf11d6670d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:09.587711 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d674dfe-d6e1-42ab-bd40-d9d99b5eb7a2 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:09.588006 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d674dfe-d6e1-42ab-bd40-d9d99b5eb7a2 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:09.588287 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d674dfe-d6e1-42ab-bd40-d9d99b5eb7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:09.588963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110df45-5ccd-4435-aa61-eaf11d6670d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:09.591682 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110df45-5ccd-4435-aa61-eaf11d6670d5 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:09.630869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-4d674dfe-d6e1-42ab-bd40-d9d99b5eb7a2 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:09.632110 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-4d674dfe-d6e1-42ab-bd40-d9d99b5eb7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:09.643634 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 771/1544] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:09.647644 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90beda-8d6c-4f8d-8efa-ff67beb651fe None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:09.647644 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90beda-8d6c-4f8d-8efa-ff67beb651fe None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:09.647644 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90beda-8d6c-4f8d-8efa-ff67beb651fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:09.698762 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 774/1545] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:17:09 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:09.710328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcf2c9-17bf-48bb-a4e2-2d7154efb8ac None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:09.710328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcf2c9-17bf-48bb-a4e2-2d7154efb8ac None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:09.710328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcf2c9-17bf-48bb-a4e2-2d7154efb8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:09.710645 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-fb90beda-8d6c-4f8d-8efa-ff67beb651fe None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:09.710645 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-fb90beda-8d6c-4f8d-8efa-ff67beb651fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:09.716629 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 772/1546] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:09.718074 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43bf44-cd52-4dd2-a1ae-77a149ec9c9b None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:09.718478 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43bf44-cd52-4dd2-a1ae-77a149ec9c9b None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:09.718787 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43bf44-cd52-4dd2-a1ae-77a149ec9c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:09.735722 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-63fcf2c9-17bf-48bb-a4e2-2d7154efb8ac None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:09.745895 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-63fcf2c9-17bf-48bb-a4e2-2d7154efb8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:09.749220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-df43bf44-cd52-4dd2-a1ae-77a149ec9c9b None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:09.753200 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-df43bf44-cd52-4dd2-a1ae-77a149ec9c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:09.760070 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 775/1547] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:09.761358 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ad782-723f-4a1c-be3e-6c3cf7da994d None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:09.762200 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ad782-723f-4a1c-be3e-6c3cf7da994d None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:09.762523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ad782-723f-4a1c-be3e-6c3cf7da994d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:09.773316 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 773/1548] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:09.774178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43bf44-cd52-4dd2-a1ae-77a149ec9c9b None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:09.788376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-b44ad782-723f-4a1c-be3e-6c3cf7da994d None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:09.788699 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43bf44-cd52-4dd2-a1ae-77a149ec9c9b None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:09.789598 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-b44ad782-723f-4a1c-be3e-6c3cf7da994d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:09.794279 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695b759-bad4-46c9-aeac-dec64093cc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:09.794925 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695b759-bad4-46c9-aeac-dec64093cc0f admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:09.795201 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695b759-bad4-46c9-aeac-dec64093cc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:09.795474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695b759-bad4-46c9-aeac-dec64093cc0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:09.796131 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695b759-bad4-46c9-aeac-dec64093cc0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:09.797733 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695b759-bad4-46c9-aeac-dec64093cc0f admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:09.799624 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 776/1549] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:09.800953 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14c55d-1d91-4cc0-bb69-05b411e671d6 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:09.801248 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14c55d-1d91-4cc0-bb69-05b411e671d6 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:09.801525 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14c55d-1d91-4cc0-bb69-05b411e671d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:09.811471 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 774/1550] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:09.813021 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e048e2-91c2-4209-b8bb-128458f7d8c6 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:09.813509 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e048e2-91c2-4209-b8bb-128458f7d8c6 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:09.813984 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e048e2-91c2-4209-b8bb-128458f7d8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:09.822339 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-ba14c55d-1d91-4cc0-bb69-05b411e671d6 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:09.823539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-ba14c55d-1d91-4cc0-bb69-05b411e671d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:09.831791 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 777/1551] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:09.833191 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b601c4-a372-417a-81ea-75b5281fd55e None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:09.833482 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b601c4-a372-417a-81ea-75b5281fd55e None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:09.834321 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b601c4-a372-417a-81ea-75b5281fd55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:09.843744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-87e048e2-91c2-4209-b8bb-128458f7d8c6 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:09.846077 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-87e048e2-91c2-4209-b8bb-128458f7d8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:09.853455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 775/1552] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:09.854086 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-06b601c4-a372-417a-81ea-75b5281fd55e None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:09.854276 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e048e2-91c2-4209-b8bb-128458f7d8c6 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:09.855312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-06b601c4-a372-417a-81ea-75b5281fd55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:09.863999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 778/1553] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:09.864957 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e048e2-91c2-4209-b8bb-128458f7d8c6 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:09.865300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d1f83-da17-4a7a-a738-a26b2d3a2792 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:09.865595 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d1f83-da17-4a7a-a738-a26b2d3a2792 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:09.865888 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d1f83-da17-4a7a-a738-a26b2d3a2792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:09.875259 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77564e-81dd-45f4-b067-5f19591c0deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:09.875894 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77564e-81dd-45f4-b067-5f19591c0deb admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:09.876157 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77564e-81dd-45f4-b067-5f19591c0deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:09.876432 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77564e-81dd-45f4-b067-5f19591c0deb admin admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:09.877075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77564e-81dd-45f4-b067-5f19591c0deb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:17:09.877377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77564e-81dd-45f4-b067-5f19591c0deb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:09.878470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: WARNING py.warnings [None req-3e77564e-81dd-45f4-b067-5f19591c0deb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 08:17:09.878470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: warnings.warn(msg) Aug 23 08:17:09.878470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: Aug 23 08:17:09.879669 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77564e-81dd-45f4-b067-5f19591c0deb admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:09.886321 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-620d1f83-da17-4a7a-a738-a26b2d3a2792 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:09.888151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-620d1f83-da17-4a7a-a738-a26b2d3a2792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:09.891840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 776/1554] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:17:09.894810 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dab70-f0f5-4157-a884-0686a16ce92d None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:09.894810 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dab70-f0f5-4157-a884-0686a16ce92d None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:09.894810 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dab70-f0f5-4157-a884-0686a16ce92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:09.902048 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 779/1555] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:09.903443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d1f83-da17-4a7a-a738-a26b2d3a2792 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:09.913316 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d1f83-da17-4a7a-a738-a26b2d3a2792 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:09.913891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-4d5dab70-f0f5-4157-a884-0686a16ce92d None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:09.915136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-4d5dab70-f0f5-4157-a884-0686a16ce92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:09.918890 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9e3d1-c145-4b5a-97cd-fd297909154a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:09.919568 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9e3d1-c145-4b5a-97cd-fd297909154a admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:09.919854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9e3d1-c145-4b5a-97cd-fd297909154a admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:09.920131 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9e3d1-c145-4b5a-97cd-fd297909154a admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:09.920777 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9e3d1-c145-4b5a-97cd-fd297909154a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:09.922400 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9e3d1-c145-4b5a-97cd-fd297909154a admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:09.923871 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 777/1556] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:09.925201 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea2efd-a9a5-4221-bb0d-f1256a1fecec None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:09.925473 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea2efd-a9a5-4221-bb0d-f1256a1fecec None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:09.925746 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea2efd-a9a5-4221-bb0d-f1256a1fecec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:09.934213 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 780/1557] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:09.938203 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9e3d1-c145-4b5a-97cd-fd297909154a admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:09.945573 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-4bea2efd-a9a5-4221-bb0d-f1256a1fecec None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:09.946807 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-4bea2efd-a9a5-4221-bb0d-f1256a1fecec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:09.947970 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9e3d1-c145-4b5a-97cd-fd297909154a admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:09.952721 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54277198-6437-4016-b68e-69c0ebf0508a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:09.953346 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54277198-6437-4016-b68e-69c0ebf0508a admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:09.953587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54277198-6437-4016-b68e-69c0ebf0508a admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:09.953861 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54277198-6437-4016-b68e-69c0ebf0508a admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:09.954526 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54277198-6437-4016-b68e-69c0ebf0508a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:17:09.954632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 778/1558] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:09.954836 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54277198-6437-4016-b68e-69c0ebf0508a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:09.955387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea2efd-a9a5-4221-bb0d-f1256a1fecec None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:09.956492 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54277198-6437-4016-b68e-69c0ebf0508a admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:09.964716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea2efd-a9a5-4221-bb0d-f1256a1fecec None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:09.969379 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9079a7-8f1d-48b3-81a5-8ebd87062348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:09.977051 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 781/1559] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:17:09.977235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9079a7-8f1d-48b3-81a5-8ebd87062348 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:09.977235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9079a7-8f1d-48b3-81a5-8ebd87062348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:09.977235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9079a7-8f1d-48b3-81a5-8ebd87062348 admin admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:09.977585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44093cc-7391-4f5b-a7eb-b928171d9859 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:09.977678 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9079a7-8f1d-48b3-81a5-8ebd87062348 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:17:09.977771 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44093cc-7391-4f5b-a7eb-b928171d9859 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:09.977849 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9079a7-8f1d-48b3-81a5-8ebd87062348 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:09.977957 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44093cc-7391-4f5b-a7eb-b928171d9859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:09.978047 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9079a7-8f1d-48b3-81a5-8ebd87062348 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:09.989841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 779/1560] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:17:09.990750 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9079a7-8f1d-48b3-81a5-8ebd87062348 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:09.994862 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-a44093cc-7391-4f5b-a7eb-b928171d9859 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:09.996554 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-a44093cc-7391-4f5b-a7eb-b928171d9859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:10.001263 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9079a7-8f1d-48b3-81a5-8ebd87062348 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:10.005138 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 782/1561] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:10.006384 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76d744-0d30-4e3b-912d-7a2c48b86832 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:10.006673 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76d744-0d30-4e3b-912d-7a2c48b86832 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:10.006944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76d744-0d30-4e3b-912d-7a2c48b86832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:10.009671 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60d23a-1e1a-4386-8434-50b3cdf53e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:10.010272 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60d23a-1e1a-4386-8434-50b3cdf53e81 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:10.010581 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60d23a-1e1a-4386-8434-50b3cdf53e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:10.010858 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60d23a-1e1a-4386-8434-50b3cdf53e81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:10.011488 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60d23a-1e1a-4386-8434-50b3cdf53e81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:10.014152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60d23a-1e1a-4386-8434-50b3cdf53e81 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:10.027127 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-4f76d744-0d30-4e3b-912d-7a2c48b86832 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:10.028847 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-4f76d744-0d30-4e3b-912d-7a2c48b86832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:10.037098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 783/1562] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:10.041039 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76d744-0d30-4e3b-912d-7a2c48b86832 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:10.047768 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76d744-0d30-4e3b-912d-7a2c48b86832 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:10.052292 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee110f-4830-45c4-a694-fb38e59bd406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:10.052869 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee110f-4830-45c4-a694-fb38e59bd406 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:10.053184 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee110f-4830-45c4-a694-fb38e59bd406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:10.053462 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee110f-4830-45c4-a694-fb38e59bd406 admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:10.054097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee110f-4830-45c4-a694-fb38e59bd406 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:17:10.054437 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee110f-4830-45c4-a694-fb38e59bd406 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:10.056072 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee110f-4830-45c4-a694-fb38e59bd406 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:10.070112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 784/1563] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:17:10.077127 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee110f-4830-45c4-a694-fb38e59bd406 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:10.086223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee110f-4830-45c4-a694-fb38e59bd406 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:10.091160 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843fccb-4483-4e2d-a9ee-b06839e28b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:10.091816 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843fccb-4483-4e2d-a9ee-b06839e28b7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:10.092094 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843fccb-4483-4e2d-a9ee-b06839e28b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:10.092364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843fccb-4483-4e2d-a9ee-b06839e28b7c admin admin] PATH_INFO: `/v3/projects/f42bbc6ead054b49a84dea85315305f6/users/174ebadbeec64175bd09beb3e270c573/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:10.108265 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843fccb-4483-4e2d-a9ee-b06839e28b7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f42bbc6ead054b49a84dea85315305f6, user_id=174ebadbeec64175bd09beb3e270c573, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:10.110031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: WARNING py.warnings [None req-4843fccb-4483-4e2d-a9ee-b06839e28b7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 08:17:10.110031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: warnings.warn(msg) Aug 23 08:17:10.110031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: Aug 23 08:17:10.111388 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843fccb-4483-4e2d-a9ee-b06839e28b7c admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:10.156844 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 780/1564] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:17:09 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:10.156844 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40587199-5864-437c-8a67-b577d7d8df30 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:10.156844 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40587199-5864-437c-8a67-b577d7d8df30 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:10.156844 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40587199-5864-437c-8a67-b577d7d8df30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:10.175442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-40587199-5864-437c-8a67-b577d7d8df30 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:10.176757 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-40587199-5864-437c-8a67-b577d7d8df30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:10.221339 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 785/1565] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:10 2022] PUT /identity/v3/projects/f42bbc6ead054b49a84dea85315305f6/users/174ebadbeec64175bd09beb3e270c573/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:10.223190 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843fccb-4483-4e2d-a9ee-b06839e28b7c admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:10.236691 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 781/1566] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:10.237573 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40587199-5864-437c-8a67-b577d7d8df30 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:10.248265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40587199-5864-437c-8a67-b577d7d8df30 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:10.250423 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:10.278672 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:10.286722 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843fccb-4483-4e2d-a9ee-b06839e28b7c admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:10.291464 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbd056-1015-4de9-bcc6-33b65ab328db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:10.295154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbd056-1015-4de9-bcc6-33b65ab328db admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:10.295154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbd056-1015-4de9-bcc6-33b65ab328db admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:10.295154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbd056-1015-4de9-bcc6-33b65ab328db admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:10.295154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfbd056-1015-4de9-bcc6-33b65ab328db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:10.295676 dv-cinder-854070-4-smb devstack@keystone.service[81771]: WARNING py.warnings [None req-cbfbd056-1015-4de9-bcc6-33b65ab328db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 08:17:10.295676 dv-cinder-854070-4-smb devstack@keystone.service[81771]: warnings.warn(msg) Aug 23 08:17:10.295676 dv-cinder-854070-4-smb devstack@keystone.service[81771]: Aug 23 08:17:10.296735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfbd056-1015-4de9-bcc6-33b65ab328db admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:10.304141 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d65ec6-1d32-4eb0-939f-9f66d7041c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:10.304831 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d65ec6-1d32-4eb0-939f-9f66d7041c7d admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:10.305183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d65ec6-1d32-4eb0-939f-9f66d7041c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:10.305529 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d65ec6-1d32-4eb0-939f-9f66d7041c7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:10.306145 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d65ec6-1d32-4eb0-939f-9f66d7041c7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:10.308084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d65ec6-1d32-4eb0-939f-9f66d7041c7d admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:10.408864 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 786/1567] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:17:10 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:10.409785 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbd056-1015-4de9-bcc6-33b65ab328db admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:10.431922 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 782/1568] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:17:10 2022] POST /identity/v3/projects => generated 389 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:10.432785 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d65ec6-1d32-4eb0-939f-9f66d7041c7d admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:10.480083 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbd056-1015-4de9-bcc6-33b65ab328db admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:10.499039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d65ec6-1d32-4eb0-939f-9f66d7041c7d admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:10.503652 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd82859-2681-497c-ba32-602474422b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:10.504288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd82859-2681-497c-ba32-602474422b51 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:10.504568 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd82859-2681-497c-ba32-602474422b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:10.504843 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd82859-2681-497c-ba32-602474422b51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:10.505484 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd82859-2681-497c-ba32-602474422b51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:17:10.505785 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd82859-2681-497c-ba32-602474422b51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:10.507581 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd82859-2681-497c-ba32-602474422b51 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:10.519631 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 783/1569] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:17:10.520554 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd82859-2681-497c-ba32-602474422b51 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:10.533162 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd82859-2681-497c-ba32-602474422b51 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:10.535496 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aaa20f-749a-4305-ba9c-97d2be328838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:10.536083 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aaa20f-749a-4305-ba9c-97d2be328838 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:10.536364 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aaa20f-749a-4305-ba9c-97d2be328838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:10.536639 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aaa20f-749a-4305-ba9c-97d2be328838 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:10.537250 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aaa20f-749a-4305-ba9c-97d2be328838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:10.539222 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aaa20f-749a-4305-ba9c-97d2be328838 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:10.546527 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5a43f-7735-4c46-993d-08cffc326651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:10.547145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5a43f-7735-4c46-993d-08cffc326651 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:10.547427 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5a43f-7735-4c46-993d-08cffc326651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:10.547702 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5a43f-7735-4c46-993d-08cffc326651 admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:10.548343 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce5a43f-7735-4c46-993d-08cffc326651 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:17:10.548647 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce5a43f-7735-4c46-993d-08cffc326651 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:10.550251 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce5a43f-7735-4c46-993d-08cffc326651 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:10.561611 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 787/1570] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:17:10.563807 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5a43f-7735-4c46-993d-08cffc326651 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:10.571828 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5a43f-7735-4c46-993d-08cffc326651 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:10.577040 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff63260-b866-4372-897d-2597dd8f4699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:10.577615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff63260-b866-4372-897d-2597dd8f4699 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:10.577898 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff63260-b866-4372-897d-2597dd8f4699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:10.578173 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff63260-b866-4372-897d-2597dd8f4699 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:10.578827 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff63260-b866-4372-897d-2597dd8f4699 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:10.580722 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff63260-b866-4372-897d-2597dd8f4699 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:10.628364 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 784/1571] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:17:10 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:10.628364 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81003054-839c-41d4-88a0-52ccfe6c0443 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:10.628364 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81003054-839c-41d4-88a0-52ccfe6c0443 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:10.628364 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81003054-839c-41d4-88a0-52ccfe6c0443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:10.646769 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-81003054-839c-41d4-88a0-52ccfe6c0443 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:10.647992 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-81003054-839c-41d4-88a0-52ccfe6c0443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:10.689091 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 788/1572] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:17:10 2022] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:10.690073 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff63260-b866-4372-897d-2597dd8f4699 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:10.700683 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff63260-b866-4372-897d-2597dd8f4699 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:10.710961 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 785/1573] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:10.714379 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81003054-839c-41d4-88a0-52ccfe6c0443 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:10.722187 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81003054-839c-41d4-88a0-52ccfe6c0443 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:10.727334 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ec9f4-0ba0-4fc9-8c9e-4b843ac1fd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:10.728007 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ec9f4-0ba0-4fc9-8c9e-4b843ac1fd49 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:10.728198 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ec9f4-0ba0-4fc9-8c9e-4b843ac1fd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:10.728490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ec9f4-0ba0-4fc9-8c9e-4b843ac1fd49 admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:10.729133 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ec9f4-0ba0-4fc9-8c9e-4b843ac1fd49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:10.730144 dv-cinder-854070-4-smb devstack@keystone.service[81770]: WARNING py.warnings [None req-347ec9f4-0ba0-4fc9-8c9e-4b843ac1fd49 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 08:17:10.730144 dv-cinder-854070-4-smb devstack@keystone.service[81770]: warnings.warn(msg) Aug 23 08:17:10.730144 dv-cinder-854070-4-smb devstack@keystone.service[81770]: Aug 23 08:17:10.731525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ec9f4-0ba0-4fc9-8c9e-4b843ac1fd49 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:10.732227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:10.760208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb8851-82c0-46b3-8711-b40d055e2519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:10.760758 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb8851-82c0-46b3-8711-b40d055e2519 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:10.761044 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb8851-82c0-46b3-8711-b40d055e2519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:10.761320 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb8851-82c0-46b3-8711-b40d055e2519 admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:10.763013 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb8851-82c0-46b3-8711-b40d055e2519 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:17:10.763328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb8851-82c0-46b3-8711-b40d055e2519 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:10.765003 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb8851-82c0-46b3-8711-b40d055e2519 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:10.782238 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 789/1574] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:17:10.783412 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb8851-82c0-46b3-8711-b40d055e2519 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:10.793769 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb8851-82c0-46b3-8711-b40d055e2519 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:10.798468 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a458f9-2849-4335-aab1-1a2e87c2d0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:10.799081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a458f9-2849-4335-aab1-1a2e87c2d0dd admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:10.799359 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a458f9-2849-4335-aab1-1a2e87c2d0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:10.799631 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a458f9-2849-4335-aab1-1a2e87c2d0dd admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:10.800346 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a458f9-2849-4335-aab1-1a2e87c2d0dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:10.802271 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a458f9-2849-4335-aab1-1a2e87c2d0dd admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:10.863800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 786/1575] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:17:10 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:10.863800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ec9f4-0ba0-4fc9-8c9e-4b843ac1fd49 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:10.872064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ec9f4-0ba0-4fc9-8c9e-4b843ac1fd49 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:10.876741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a94d4-918c-4db2-847b-088d58d24fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:10.877313 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a94d4-918c-4db2-847b-088d58d24fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:10.877592 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a94d4-918c-4db2-847b-088d58d24fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:10.877865 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a94d4-918c-4db2-847b-088d58d24fd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:10.878492 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a94d4-918c-4db2-847b-088d58d24fd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:10.880423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a94d4-918c-4db2-847b-088d58d24fd8 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:10.892722 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:10.958353 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 790/1576] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:17:10 2022] POST /identity/v3/users => generated 295 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:10.959210 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a458f9-2849-4335-aab1-1a2e87c2d0dd admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:10.968688 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a458f9-2849-4335-aab1-1a2e87c2d0dd admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:10.973559 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd82c4-32bd-4015-8813-8e48300a0f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:10.974124 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd82c4-32bd-4015-8813-8e48300a0f0e admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:10.974448 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd82c4-32bd-4015-8813-8e48300a0f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:10.974722 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd82c4-32bd-4015-8813-8e48300a0f0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:10.975323 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd82c4-32bd-4015-8813-8e48300a0f0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:10.977218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd82c4-32bd-4015-8813-8e48300a0f0e admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:10.991246 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 787/1577] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:17:10 2022] POST /identity/v3/projects => generated 357 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:10.991246 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a94d4-918c-4db2-847b-088d58d24fd8 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:11.051467 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a94d4-918c-4db2-847b-088d58d24fd8 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:11.055980 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5dc94-cf4d-44a8-a211-e49ad824e7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:11.056579 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5dc94-cf4d-44a8-a211-e49ad824e7da admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:11.056858 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5dc94-cf4d-44a8-a211-e49ad824e7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:11.057129 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5dc94-cf4d-44a8-a211-e49ad824e7da admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:11.057733 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5dc94-cf4d-44a8-a211-e49ad824e7da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:11.060361 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5dc94-cf4d-44a8-a211-e49ad824e7da admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:11.084597 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 791/1578] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:17:10 2022] POST /identity/v3/projects => generated 393 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:11.085541 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd82c4-32bd-4015-8813-8e48300a0f0e admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:11.150780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd82c4-32bd-4015-8813-8e48300a0f0e admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:11.155641 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df618b65-e79f-44a4-afe6-128ec9df4eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:11.156252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df618b65-e79f-44a4-afe6-128ec9df4eff admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:11.156558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df618b65-e79f-44a4-afe6-128ec9df4eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:11.156860 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df618b65-e79f-44a4-afe6-128ec9df4eff admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:11.157496 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df618b65-e79f-44a4-afe6-128ec9df4eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:11.159231 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df618b65-e79f-44a4-afe6-128ec9df4eff admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:11.168908 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 792/1579] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:11.169752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df618b65-e79f-44a4-afe6-128ec9df4eff admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:11.178414 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 788/1580] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:17:10 2022] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:11.178414 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5dc94-cf4d-44a8-a211-e49ad824e7da admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:11.187508 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5dc94-cf4d-44a8-a211-e49ad824e7da admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:11.192164 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252bdb6-2f72-43f2-8bb8-169b9ee661ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:11.192756 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252bdb6-2f72-43f2-8bb8-169b9ee661ee admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:11.193040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252bdb6-2f72-43f2-8bb8-169b9ee661ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:11.193315 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252bdb6-2f72-43f2-8bb8-169b9ee661ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:11.193926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252bdb6-2f72-43f2-8bb8-169b9ee661ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:11.195877 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252bdb6-2f72-43f2-8bb8-169b9ee661ee admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:11.228709 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df618b65-e79f-44a4-afe6-128ec9df4eff admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:11.232874 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772a667-9536-46a8-9d33-ec887fb87813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:11.233479 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772a667-9536-46a8-9d33-ec887fb87813 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:11.233762 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772a667-9536-46a8-9d33-ec887fb87813 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:11.234038 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772a667-9536-46a8-9d33-ec887fb87813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:11.242899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772a667-9536-46a8-9d33-ec887fb87813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:11.244369 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772a667-9536-46a8-9d33-ec887fb87813 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:11.254177 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 793/1581] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:11.255168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772a667-9536-46a8-9d33-ec887fb87813 service neutron] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:11.264882 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772a667-9536-46a8-9d33-ec887fb87813 service neutron] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:11.271241 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909673c-f791-4f5f-a39d-3266714b249b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:11.272016 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909673c-f791-4f5f-a39d-3266714b249b admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:11.272396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909673c-f791-4f5f-a39d-3266714b249b admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:11.272732 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909673c-f791-4f5f-a39d-3266714b249b admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:11.273432 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909673c-f791-4f5f-a39d-3266714b249b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:11.279305 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 789/1582] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:17:11 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:11.279305 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252bdb6-2f72-43f2-8bb8-169b9ee661ee admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:11.280221 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909673c-f791-4f5f-a39d-3266714b249b admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:11.287967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 794/1583] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:11.288967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909673c-f791-4f5f-a39d-3266714b249b admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:11.300191 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909673c-f791-4f5f-a39d-3266714b249b admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:11.309367 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:11.345590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252bdb6-2f72-43f2-8bb8-169b9ee661ee admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:11.350613 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d02f88-7d1c-4318-a772-385d7e902167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:11.351303 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d02f88-7d1c-4318-a772-385d7e902167 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:11.351648 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d02f88-7d1c-4318-a772-385d7e902167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:11.351985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d02f88-7d1c-4318-a772-385d7e902167 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:11.352768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d02f88-7d1c-4318-a772-385d7e902167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:11.354525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d02f88-7d1c-4318-a772-385d7e902167 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:11.359295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5f420-40b0-42c5-b2f0-0ab0b9e2db75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:11.359917 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5f420-40b0-42c5-b2f0-0ab0b9e2db75 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:11.360205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5f420-40b0-42c5-b2f0-0ab0b9e2db75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:11.360479 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5f420-40b0-42c5-b2f0-0ab0b9e2db75 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:11.361107 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5f420-40b0-42c5-b2f0-0ab0b9e2db75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:11.363142 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5f420-40b0-42c5-b2f0-0ab0b9e2db75 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:11.368930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 790/1584] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:11.369902 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d02f88-7d1c-4318-a772-385d7e902167 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:11.379863 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d02f88-7d1c-4318-a772-385d7e902167 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:11.385420 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0c9f6-4055-4b3b-b8e2-b9bda11dbfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:11.386613 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0c9f6-4055-4b3b-b8e2-b9bda11dbfff admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:11.386613 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0c9f6-4055-4b3b-b8e2-b9bda11dbfff admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:11.387650 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0c9f6-4055-4b3b-b8e2-b9bda11dbfff admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:11.388490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf0c9f6-4055-4b3b-b8e2-b9bda11dbfff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:11.390695 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf0c9f6-4055-4b3b-b8e2-b9bda11dbfff admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:11.484248 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 795/1585] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:17:11 2022] POST /identity/v3/users => generated 279 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:11.485318 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5f420-40b0-42c5-b2f0-0ab0b9e2db75 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:11.494625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5f420-40b0-42c5-b2f0-0ab0b9e2db75 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:11.499469 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80dba4-a5a2-4eb2-8130-09100ff45ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:11.500045 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80dba4-a5a2-4eb2-8130-09100ff45ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:11.500329 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80dba4-a5a2-4eb2-8130-09100ff45ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:11.500605 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80dba4-a5a2-4eb2-8130-09100ff45ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:11.501233 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80dba4-a5a2-4eb2-8130-09100ff45ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:11.502860 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80dba4-a5a2-4eb2-8130-09100ff45ac7 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:11.513778 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 796/1586] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:11.515027 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80dba4-a5a2-4eb2-8130-09100ff45ac7 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:11.522489 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 791/1587] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:17:11 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:11.523560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0c9f6-4055-4b3b-b8e2-b9bda11dbfff admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:11.526823 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80dba4-a5a2-4eb2-8130-09100ff45ac7 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:11.531432 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27e6c9-121b-4506-b002-76e54c184182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:11.532025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27e6c9-121b-4506-b002-76e54c184182 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:11.532303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27e6c9-121b-4506-b002-76e54c184182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:11.532577 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27e6c9-121b-4506-b002-76e54c184182 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:11.533204 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27e6c9-121b-4506-b002-76e54c184182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:11.533923 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0c9f6-4055-4b3b-b8e2-b9bda11dbfff admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:11.534833 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27e6c9-121b-4506-b002-76e54c184182 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:11.539356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f21b27-fca7-4a1b-9e41-2c6b6908f3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:11.540496 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f21b27-fca7-4a1b-9e41-2c6b6908f3f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:11.540496 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f21b27-fca7-4a1b-9e41-2c6b6908f3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:11.540728 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f21b27-fca7-4a1b-9e41-2c6b6908f3f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:11.541259 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f21b27-fca7-4a1b-9e41-2c6b6908f3f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:11.543455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f21b27-fca7-4a1b-9e41-2c6b6908f3f4 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:11.545008 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 797/1588] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:11.548873 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27e6c9-121b-4506-b002-76e54c184182 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:11.558566 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27e6c9-121b-4506-b002-76e54c184182 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:11.565347 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5ba69-0585-4185-a57f-44851b5500ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:11.565347 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5ba69-0585-4185-a57f-44851b5500ed admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:11.565347 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5ba69-0585-4185-a57f-44851b5500ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:11.565347 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5ba69-0585-4185-a57f-44851b5500ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:11.565757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5ba69-0585-4185-a57f-44851b5500ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:11.566791 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5ba69-0585-4185-a57f-44851b5500ed admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:11.577225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 798/1589] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:11.578077 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5ba69-0585-4185-a57f-44851b5500ed admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:11.587315 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5ba69-0585-4185-a57f-44851b5500ed admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:11.592528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fb2c6-282c-4293-a733-a441d024c0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:11.593080 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fb2c6-282c-4293-a733-a441d024c0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:11.593362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fb2c6-282c-4293-a733-a441d024c0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:11.593639 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fb2c6-282c-4293-a733-a441d024c0d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:11.594325 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86fb2c6-282c-4293-a733-a441d024c0d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:11.596024 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86fb2c6-282c-4293-a733-a441d024c0d7 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:11.607577 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 799/1590] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:11.607577 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fb2c6-282c-4293-a733-a441d024c0d7 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:11.617256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fb2c6-282c-4293-a733-a441d024c0d7 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:11.622572 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0ff83-0c0e-4539-b9a9-ca5589349ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:11.623363 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0ff83-0c0e-4539-b9a9-ca5589349ecc admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:11.623652 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0ff83-0c0e-4539-b9a9-ca5589349ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:11.623929 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0ff83-0c0e-4539-b9a9-ca5589349ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:11.624559 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0ff83-0c0e-4539-b9a9-ca5589349ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:11.626162 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0ff83-0c0e-4539-b9a9-ca5589349ecc admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:11.636499 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 800/1591] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:11.637834 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0ff83-0c0e-4539-b9a9-ca5589349ecc admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:11.646049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 792/1592] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:17:11 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:11.647609 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f21b27-fca7-4a1b-9e41-2c6b6908f3f4 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:11.653935 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0ff83-0c0e-4539-b9a9-ca5589349ecc admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:11.659355 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f21b27-fca7-4a1b-9e41-2c6b6908f3f4 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:11.662508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fb730-e385-4f0f-8bfc-d812d6cc8e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:11.663182 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fb730-e385-4f0f-8bfc-d812d6cc8e69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:11.663466 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fb730-e385-4f0f-8bfc-d812d6cc8e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:11.663741 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fb730-e385-4f0f-8bfc-d812d6cc8e69 admin admin] PATH_INFO: `/v3/projects/48e4f0bf4c884513bbae7a74064f7c10/users/20fa4aecb1f54543876f02afbef57280/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:11.665399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de13a5b-a000-4a10-93dc-2485a9b0059e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:11.666229 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de13a5b-a000-4a10-93dc-2485a9b0059e admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:11.666557 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de13a5b-a000-4a10-93dc-2485a9b0059e admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:11.666944 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de13a5b-a000-4a10-93dc-2485a9b0059e admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:11.668012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de13a5b-a000-4a10-93dc-2485a9b0059e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:11.669615 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de13a5b-a000-4a10-93dc-2485a9b0059e admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:11.680009 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fb730-e385-4f0f-8bfc-d812d6cc8e69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e4f0bf4c884513bbae7a74064f7c10, user_id=20fa4aecb1f54543876f02afbef57280, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:11.683266 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 793/1593] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:11.683360 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fb730-e385-4f0f-8bfc-d812d6cc8e69 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:11.683445 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de13a5b-a000-4a10-93dc-2485a9b0059e admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:11.708284 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de13a5b-a000-4a10-93dc-2485a9b0059e admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:11.712879 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1a890-cdfc-4b19-9441-2d6c94b36430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:11.713483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1a890-cdfc-4b19-9441-2d6c94b36430 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:11.713764 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1a890-cdfc-4b19-9441-2d6c94b36430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:11.714038 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1a890-cdfc-4b19-9441-2d6c94b36430 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:11.714713 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1a890-cdfc-4b19-9441-2d6c94b36430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:11.716500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1a890-cdfc-4b19-9441-2d6c94b36430 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:11.718749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:11.731849 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 794/1594] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:11.731849 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1a890-cdfc-4b19-9441-2d6c94b36430 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:11.739660 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1a890-cdfc-4b19-9441-2d6c94b36430 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:11.744220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6b383-4c67-4d2b-a236-38de72d67d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:11.744861 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6b383-4c67-4d2b-a236-38de72d67d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:11.745144 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6b383-4c67-4d2b-a236-38de72d67d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:11.745453 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6b383-4c67-4d2b-a236-38de72d67d4f admin admin] PATH_INFO: `/v3/projects/3d453e5d935b49479d77a1a637fb4eb1/users/004f95e4e97741eaaef6cc04ca0717ac/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:11.760208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6b383-4c67-4d2b-a236-38de72d67d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d453e5d935b49479d77a1a637fb4eb1, user_id=004f95e4e97741eaaef6cc04ca0717ac, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:11.763780 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6b383-4c67-4d2b-a236-38de72d67d4f admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:11.832993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 801/1595] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:11 2022] PUT /identity/v3/projects/48e4f0bf4c884513bbae7a74064f7c10/users/20fa4aecb1f54543876f02afbef57280/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:11.833834 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fb730-e385-4f0f-8bfc-d812d6cc8e69 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:11.867598 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 795/1596] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:11 2022] PUT /identity/v3/projects/3d453e5d935b49479d77a1a637fb4eb1/users/004f95e4e97741eaaef6cc04ca0717ac/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:11.872465 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6b383-4c67-4d2b-a236-38de72d67d4f admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:11.901962 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fb730-e385-4f0f-8bfc-d812d6cc8e69 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:11.934762 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:11.938881 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6b383-4c67-4d2b-a236-38de72d67d4f admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:11.944973 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5c0a0-62f9-466b-835d-aa689311eb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:11.945755 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5c0a0-62f9-466b-835d-aa689311eb9e admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:11.946032 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5c0a0-62f9-466b-835d-aa689311eb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:11.946325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5c0a0-62f9-466b-835d-aa689311eb9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:11.947051 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5c0a0-62f9-466b-835d-aa689311eb9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:11.961672 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5c0a0-62f9-466b-835d-aa689311eb9e admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:11.969010 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab300c4-c53b-4135-8475-39c76e4bf87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:11.969705 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab300c4-c53b-4135-8475-39c76e4bf87d admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:11.969991 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab300c4-c53b-4135-8475-39c76e4bf87d admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:11.970367 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab300c4-c53b-4135-8475-39c76e4bf87d admin admin] PATH_INFO: `/v3/projects/76a91d6db2d94343870cdd6ed45f5a8a/users/6c5865eae95b490b8e421153873457bb/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:11.976886 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 796/1597] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:11.977807 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5c0a0-62f9-466b-835d-aa689311eb9e admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:11.989058 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab300c4-c53b-4135-8475-39c76e4bf87d admin admin] RBAC: Authorizing `identity:create_grant(project_id=76a91d6db2d94343870cdd6ed45f5a8a, user_id=6c5865eae95b490b8e421153873457bb, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:11.991610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5c0a0-62f9-466b-835d-aa689311eb9e admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:11.992098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab300c4-c53b-4135-8475-39c76e4bf87d admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:11.998631 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee5b20-79ff-458b-9359-31155ef9749f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:11.998631 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee5b20-79ff-458b-9359-31155ef9749f admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:11.998631 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee5b20-79ff-458b-9359-31155ef9749f admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:11.998631 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee5b20-79ff-458b-9359-31155ef9749f admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:11.999080 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee5b20-79ff-458b-9359-31155ef9749f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:12.000423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee5b20-79ff-458b-9359-31155ef9749f admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:12.010579 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 797/1598] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:12.022086 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee5b20-79ff-458b-9359-31155ef9749f admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:12.024133 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee5b20-79ff-458b-9359-31155ef9749f admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:12.029349 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b2dee-74d4-4a52-93a1-e80366a3464a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:12.029968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b2dee-74d4-4a52-93a1-e80366a3464a admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:12.030255 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b2dee-74d4-4a52-93a1-e80366a3464a admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:12.030582 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b2dee-74d4-4a52-93a1-e80366a3464a admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:12.031226 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b2dee-74d4-4a52-93a1-e80366a3464a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:12.033137 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b2dee-74d4-4a52-93a1-e80366a3464a admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:12.044723 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 798/1599] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:12.045937 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b2dee-74d4-4a52-93a1-e80366a3464a admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:12.055852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b2dee-74d4-4a52-93a1-e80366a3464a admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:12.061238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094230d3-8728-43d8-99ca-66e30195c34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:12.061924 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094230d3-8728-43d8-99ca-66e30195c34a admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:12.062211 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094230d3-8728-43d8-99ca-66e30195c34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:12.062520 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094230d3-8728-43d8-99ca-66e30195c34a admin admin] PATH_INFO: `/v3/projects/6e83c6ea71bc4411a2d85eeab5c99625/users/047a2c5c77d9417ab40abacae2c3386e/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:12.076848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094230d3-8728-43d8-99ca-66e30195c34a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e83c6ea71bc4411a2d85eeab5c99625, user_id=047a2c5c77d9417ab40abacae2c3386e, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:12.079563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094230d3-8728-43d8-99ca-66e30195c34a admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:12.112931 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 802/1600] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:11 2022] PUT /identity/v3/projects/76a91d6db2d94343870cdd6ed45f5a8a/users/6c5865eae95b490b8e421153873457bb/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:12.114602 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52abc97-7585-417a-a93f-ac2d9cc4534b None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:12.114889 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52abc97-7585-417a-a93f-ac2d9cc4534b None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:12.115161 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52abc97-7585-417a-a93f-ac2d9cc4534b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:12.145608 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-a52abc97-7585-417a-a93f-ac2d9cc4534b None None] MFA Rules not processed for user `20fa4aecb1f54543876f02afbef57280`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:12.146927 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-a52abc97-7585-417a-a93f-ac2d9cc4534b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:12.197056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 799/1601] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:12 2022] PUT /identity/v3/projects/6e83c6ea71bc4411a2d85eeab5c99625/users/047a2c5c77d9417ab40abacae2c3386e/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:12.198406 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1d636-2419-44cf-99ba-35448820b602 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:12.198691 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1d636-2419-44cf-99ba-35448820b602 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:12.198964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1d636-2419-44cf-99ba-35448820b602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:12.226199 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 803/1602] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:12.233602 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-76d1d636-2419-44cf-99ba-35448820b602 None None] MFA Rules not processed for user `004f95e4e97741eaaef6cc04ca0717ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:12.233722 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52abc97-7585-417a-a93f-ac2d9cc4534b None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:12.233816 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-76d1d636-2419-44cf-99ba-35448820b602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:12.305827 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 800/1603] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:12.311122 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52abc97-7585-417a-a93f-ac2d9cc4534b None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:12.311251 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1d636-2419-44cf-99ba-35448820b602 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:12.324487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:12.363320 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:12.373630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e5931-2014-47bd-9a24-ba36eb10f662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:12.374724 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e5931-2014-47bd-9a24-ba36eb10f662 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:12.375001 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e5931-2014-47bd-9a24-ba36eb10f662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:12.375303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e5931-2014-47bd-9a24-ba36eb10f662 admin admin] PATH_INFO: `/v3/projects/c7532623915f469aaa8f813ce2c92247/users/74c90664f7c2403083a459748d97275d/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:12.377151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1d636-2419-44cf-99ba-35448820b602 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:12.382896 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6cb3e-13d0-4ec4-ba65-3da464d882fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:12.383621 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6cb3e-13d0-4ec4-ba65-3da464d882fe admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:12.383959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6cb3e-13d0-4ec4-ba65-3da464d882fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:12.384542 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6cb3e-13d0-4ec4-ba65-3da464d882fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:12.384894 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6cb3e-13d0-4ec4-ba65-3da464d882fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:12.386543 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6cb3e-13d0-4ec4-ba65-3da464d882fe admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:12.391166 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e5931-2014-47bd-9a24-ba36eb10f662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7532623915f469aaa8f813ce2c92247, user_id=74c90664f7c2403083a459748d97275d, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:12.393831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e5931-2014-47bd-9a24-ba36eb10f662 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:12.396831 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 801/1604] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:12.400863 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6cb3e-13d0-4ec4-ba65-3da464d882fe admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:12.411710 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6cb3e-13d0-4ec4-ba65-3da464d882fe admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:12.416636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0b362-f6c4-44c7-96c3-a3ee5bc05f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:12.417320 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0b362-f6c4-44c7-96c3-a3ee5bc05f2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:12.417666 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0b362-f6c4-44c7-96c3-a3ee5bc05f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:12.418062 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0b362-f6c4-44c7-96c3-a3ee5bc05f2b admin admin] PATH_INFO: `/v3/projects/06caa62599e941d98d4c08605d50e6fe/users/8926315ca58e466ba6ce873f4833f06b/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:12.433523 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b0b362-f6c4-44c7-96c3-a3ee5bc05f2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=06caa62599e941d98d4c08605d50e6fe, user_id=8926315ca58e466ba6ce873f4833f06b, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:12.437259 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b0b362-f6c4-44c7-96c3-a3ee5bc05f2b admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:12.479380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 804/1605] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:12 2022] PUT /identity/v3/projects/c7532623915f469aaa8f813ce2c92247/users/74c90664f7c2403083a459748d97275d/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:12.485294 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bf14a-18da-4040-ba4b-f86ea3a724b5 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:12.485585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bf14a-18da-4040-ba4b-f86ea3a724b5 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:12.485865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bf14a-18da-4040-ba4b-f86ea3a724b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:12.507441 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-320bf14a-18da-4040-ba4b-f86ea3a724b5 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:12.509484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-320bf14a-18da-4040-ba4b-f86ea3a724b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:12.567383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 805/1606] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:12.568865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fea1ff-1b5e-4763-ab26-72fe3f96f9c0 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:12.569157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fea1ff-1b5e-4763-ab26-72fe3f96f9c0 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:12.569435 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fea1ff-1b5e-4763-ab26-72fe3f96f9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:12.579616 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 802/1607] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:12 2022] PUT /identity/v3/projects/06caa62599e941d98d4c08605d50e6fe/users/8926315ca58e466ba6ce873f4833f06b/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:12.579616 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0b362-f6c4-44c7-96c3-a3ee5bc05f2b admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:12.598057 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-37fea1ff-1b5e-4763-ab26-72fe3f96f9c0 None None] MFA Rules not processed for user `047a2c5c77d9417ab40abacae2c3386e`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:12.599568 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-37fea1ff-1b5e-4763-ab26-72fe3f96f9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:12.641388 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0b362-f6c4-44c7-96c3-a3ee5bc05f2b admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:12.649697 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d3b52-ca4f-4e32-bb41-93ff807d4125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:12.650336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d3b52-ca4f-4e32-bb41-93ff807d4125 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:12.650625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d3b52-ca4f-4e32-bb41-93ff807d4125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:12.650907 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d3b52-ca4f-4e32-bb41-93ff807d4125 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:12.651649 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d3b52-ca4f-4e32-bb41-93ff807d4125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:12.653869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d3b52-ca4f-4e32-bb41-93ff807d4125 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:12.665764 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 806/1608] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:12.665764 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bca647-43d5-40da-86e1-b0e2968bd593 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:12.665764 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bca647-43d5-40da-86e1-b0e2968bd593 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:12.665764 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bca647-43d5-40da-86e1-b0e2968bd593 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:12.666160 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 807/1609] 10.222.0.57 () {54 vars in 962 bytes} [Tue Aug 23 08:17:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:17:12.666963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bca647-43d5-40da-86e1-b0e2968bd593 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:12.682000 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bca647-43d5-40da-86e1-b0e2968bd593 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:12.687656 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f7732-73e2-4870-b93b-221e2ccdad00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:12.688323 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f7732-73e2-4870-b93b-221e2ccdad00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:12.688608 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f7732-73e2-4870-b93b-221e2ccdad00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:12.688883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f7732-73e2-4870-b93b-221e2ccdad00 admin admin] PATH_INFO: `/v3/projects/5bd118a2368e43cda4de3b820d9cbdf2/users/256afdbdf6c240af87478fe03996f5c0/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:12.704614 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f7732-73e2-4870-b93b-221e2ccdad00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd118a2368e43cda4de3b820d9cbdf2, user_id=256afdbdf6c240af87478fe03996f5c0, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:12.707430 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f7732-73e2-4870-b93b-221e2ccdad00 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:12.833368 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 808/1610] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:12 2022] PUT /identity/v3/projects/5bd118a2368e43cda4de3b820d9cbdf2/users/256afdbdf6c240af87478fe03996f5c0/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:12.835035 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ea427-6a93-4c00-9500-27d01d6cc7c5 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:12.835321 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ea427-6a93-4c00-9500-27d01d6cc7c5 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:12.835790 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ea427-6a93-4c00-9500-27d01d6cc7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:12.841906 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 803/1611] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:17:12 2022] POST /identity/v3/projects => generated 377 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:12.841906 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d3b52-ca4f-4e32-bb41-93ff807d4125 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:12.873088 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-fb0ea427-6a93-4c00-9500-27d01d6cc7c5 None None] MFA Rules not processed for user `74c90664f7c2403083a459748d97275d`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:12.874438 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-fb0ea427-6a93-4c00-9500-27d01d6cc7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:12.908387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d3b52-ca4f-4e32-bb41-93ff807d4125 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:12.911263 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:12.912716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bafaf3-6a84-4fe0-9649-297174601e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:12.913423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bafaf3-6a84-4fe0-9649-297174601e6b service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:12.913784 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bafaf3-6a84-4fe0-9649-297174601e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:12.914123 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bafaf3-6a84-4fe0-9649-297174601e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:12.947805 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:12.955429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 809/1612] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:12.955429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e495d-e81e-456b-83ed-b50033d1f794 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:12.955429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e495d-e81e-456b-83ed-b50033d1f794 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:12.955429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e495d-e81e-456b-83ed-b50033d1f794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:12.976241 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-412e495d-e81e-456b-83ed-b50033d1f794 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:12.977691 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-412e495d-e81e-456b-83ed-b50033d1f794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:13.009459 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bafaf3-6a84-4fe0-9649-297174601e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:13.011636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bafaf3-6a84-4fe0-9649-297174601e6b service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:13.025770 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 804/1613] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:13.026631 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bafaf3-6a84-4fe0-9649-297174601e6b service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:13.039473 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bafaf3-6a84-4fe0-9649-297174601e6b service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:13.046763 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883f65a-c166-4439-883a-e873135c204a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:13.047392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883f65a-c166-4439-883a-e873135c204a admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:13.047723 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883f65a-c166-4439-883a-e873135c204a admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:13.048424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883f65a-c166-4439-883a-e873135c204a admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:13.048919 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883f65a-c166-4439-883a-e873135c204a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:13.051083 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883f65a-c166-4439-883a-e873135c204a admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:13.053683 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 810/1614] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:13.055331 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3ae33-4452-4d8f-b45b-a4acc259f9aa None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:13.055792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3ae33-4452-4d8f-b45b-a4acc259f9aa None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:13.057167 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3ae33-4452-4d8f-b45b-a4acc259f9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:13.176041 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 805/1615] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:17:13 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:13.179813 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950ce9c-d7b5-4654-9b38-970eda870c1d None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:13.179813 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950ce9c-d7b5-4654-9b38-970eda870c1d None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:13.179813 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950ce9c-d7b5-4654-9b38-970eda870c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:13.190237 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-d5b3ae33-4452-4d8f-b45b-a4acc259f9aa None None] MFA Rules not processed for user `b5c55e5c1cea47f29d378ea457384a31`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:13.191481 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-d5b3ae33-4452-4d8f-b45b-a4acc259f9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:13.198090 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-d950ce9c-d7b5-4654-9b38-970eda870c1d None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:13.199521 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-d950ce9c-d7b5-4654-9b38-970eda870c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:13.282445 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 806/1616] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:13.282445 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950ce9c-d7b5-4654-9b38-970eda870c1d None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:13.300175 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950ce9c-d7b5-4654-9b38-970eda870c1d None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:13.305779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04590ae0-b791-4481-ae5f-ddd575ec40b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:13.306968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04590ae0-b791-4481-ae5f-ddd575ec40b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:13.307525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04590ae0-b791-4481-ae5f-ddd575ec40b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:13.307708 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04590ae0-b791-4481-ae5f-ddd575ec40b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:13.308487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04590ae0-b791-4481-ae5f-ddd575ec40b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:13.310713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 811/1617] 10.222.0.57 () {58 vars in 1059 bytes} [Tue Aug 23 08:17:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:13.311622 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04590ae0-b791-4481-ae5f-ddd575ec40b2 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:13.311746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3ae33-4452-4d8f-b45b-a4acc259f9aa None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:13.324619 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3ae33-4452-4d8f-b45b-a4acc259f9aa None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:13.331447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa92a6b-3f73-4189-9249-4bafa4c40d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:13.332059 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa92a6b-3f73-4189-9249-4bafa4c40d67 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:13.332339 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa92a6b-3f73-4189-9249-4bafa4c40d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:13.332612 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa92a6b-3f73-4189-9249-4bafa4c40d67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:13.333236 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa92a6b-3f73-4189-9249-4bafa4c40d67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:13.335347 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa92a6b-3f73-4189-9249-4bafa4c40d67 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:13.401614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 807/1618] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:17:13 2022] POST /identity/v3/users => generated 295 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:13.401614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04590ae0-b791-4481-ae5f-ddd575ec40b2 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:13.433252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 812/1619] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:17:13 2022] POST /identity/v3/projects => generated 357 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:13.434151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa92a6b-3f73-4189-9249-4bafa4c40d67 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:13.464069 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04590ae0-b791-4481-ae5f-ddd575ec40b2 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:13.472557 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:13.499871 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:13.506970 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa92a6b-3f73-4189-9249-4bafa4c40d67 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:13.512074 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4bfa5-d95a-448d-a035-5051bc5794b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:13.513502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4bfa5-d95a-448d-a035-5051bc5794b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:13.513794 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4bfa5-d95a-448d-a035-5051bc5794b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:13.514068 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4bfa5-d95a-448d-a035-5051bc5794b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:13.514733 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4bfa5-d95a-448d-a035-5051bc5794b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:13.516739 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4bfa5-d95a-448d-a035-5051bc5794b8 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:13.517299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4bc67-f23d-4e6d-8ba7-289c452e2a04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:13.517917 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4bc67-f23d-4e6d-8ba7-289c452e2a04 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:13.518205 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4bc67-f23d-4e6d-8ba7-289c452e2a04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:13.518558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4bc67-f23d-4e6d-8ba7-289c452e2a04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:13.528860 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4bc67-f23d-4e6d-8ba7-289c452e2a04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:13.530692 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4bc67-f23d-4e6d-8ba7-289c452e2a04 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:13.540722 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 808/1620] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:13.543241 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4bc67-f23d-4e6d-8ba7-289c452e2a04 service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:13.552312 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4bc67-f23d-4e6d-8ba7-289c452e2a04 service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:13.556257 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5acced-1b25-44b8-9d8e-0bf133307f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:13.556880 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5acced-1b25-44b8-9d8e-0bf133307f7d service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:13.557161 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5acced-1b25-44b8-9d8e-0bf133307f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:13.557436 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5acced-1b25-44b8-9d8e-0bf133307f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:13.568485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5acced-1b25-44b8-9d8e-0bf133307f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:13.569957 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5acced-1b25-44b8-9d8e-0bf133307f7d service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:13.584283 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 809/1621] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:13.584283 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5acced-1b25-44b8-9d8e-0bf133307f7d service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:13.611825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 813/1622] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:17:13 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:13.612687 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4bfa5-d95a-448d-a035-5051bc5794b8 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:13.635823 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4bfa5-d95a-448d-a035-5051bc5794b8 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:13.650558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102b573-220c-421f-96dc-fd0e71e2b468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:13.651393 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102b573-220c-421f-96dc-fd0e71e2b468 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:13.651624 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102b573-220c-421f-96dc-fd0e71e2b468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:13.651910 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102b573-220c-421f-96dc-fd0e71e2b468 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:13.652574 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102b573-220c-421f-96dc-fd0e71e2b468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:13.655943 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102b573-220c-421f-96dc-fd0e71e2b468 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:13.672037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 814/1623] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:13.672037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102b573-220c-421f-96dc-fd0e71e2b468 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:13.688326 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102b573-220c-421f-96dc-fd0e71e2b468 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:13.691721 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329701b-d947-4c0e-b320-b7b3d9ccbca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:13.692618 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329701b-d947-4c0e-b320-b7b3d9ccbca3 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:13.693119 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329701b-d947-4c0e-b320-b7b3d9ccbca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:13.693610 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329701b-d947-4c0e-b320-b7b3d9ccbca3 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:13.694441 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329701b-d947-4c0e-b320-b7b3d9ccbca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:13.696778 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329701b-d947-4c0e-b320-b7b3d9ccbca3 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:13.718641 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5acced-1b25-44b8-9d8e-0bf133307f7d service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:13.726758 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4eee78-1cbc-48b8-b0cf-73af7df2ecdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:13.727841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4eee78-1cbc-48b8-b0cf-73af7df2ecdd service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:13.727841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4eee78-1cbc-48b8-b0cf-73af7df2ecdd service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:13.728203 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4eee78-1cbc-48b8-b0cf-73af7df2ecdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:13.810631 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4eee78-1cbc-48b8-b0cf-73af7df2ecdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:13.812903 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4eee78-1cbc-48b8-b0cf-73af7df2ecdd service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:13.818147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 815/1624] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:17:13 2022] POST /identity/v3/users => generated 285 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:13.818147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329701b-d947-4c0e-b320-b7b3d9ccbca3 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:13.838509 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 810/1625] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:13.840472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329701b-d947-4c0e-b320-b7b3d9ccbca3 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:13.840868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4eee78-1cbc-48b8-b0cf-73af7df2ecdd service nova] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:13.854073 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ddb94a-a448-4f5a-a03e-110f254e6b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:13.854365 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddb94a-a448-4f5a-a03e-110f254e6b2b admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:13.854652 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddb94a-a448-4f5a-a03e-110f254e6b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:13.855328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddb94a-a448-4f5a-a03e-110f254e6b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:13.855602 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ddb94a-a448-4f5a-a03e-110f254e6b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:13.857776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ddb94a-a448-4f5a-a03e-110f254e6b2b admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:13.870506 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4eee78-1cbc-48b8-b0cf-73af7df2ecdd service nova] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:13.877206 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2642101-0349-4d5c-b5d3-972e5e913f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:13.889114 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2642101-0349-4d5c-b5d3-972e5e913f73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:13.889114 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2642101-0349-4d5c-b5d3-972e5e913f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:13.889114 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2642101-0349-4d5c-b5d3-972e5e913f73 admin admin] PATH_INFO: `/v3/projects/ebd2389fc7ad461c8e0fa8141e87803a/users/7515c8fd8e5c4c0fbf470afb0723604e/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:13.889416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 816/1626] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:13.889416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ddb94a-a448-4f5a-a03e-110f254e6b2b admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:14.055234 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ddb94a-a448-4f5a-a03e-110f254e6b2b admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:14.055234 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74c010-a316-46ee-bb0f-e1170670617d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:14.055234 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74c010-a316-46ee-bb0f-e1170670617d admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:14.055234 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74c010-a316-46ee-bb0f-e1170670617d admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:14.058876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74c010-a316-46ee-bb0f-e1170670617d admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:14.060387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2642101-0349-4d5c-b5d3-972e5e913f73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebd2389fc7ad461c8e0fa8141e87803a, user_id=7515c8fd8e5c4c0fbf470afb0723604e, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:14.060879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74c010-a316-46ee-bb0f-e1170670617d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:14.060879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74c010-a316-46ee-bb0f-e1170670617d admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:14.061429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2642101-0349-4d5c-b5d3-972e5e913f73 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:14.061537 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 817/1627] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:14.061537 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74c010-a316-46ee-bb0f-e1170670617d admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:14.061537 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74c010-a316-46ee-bb0f-e1170670617d admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:14.061537 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e2981-d44a-4aa8-8104-7296535e9670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:14.061893 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e2981-d44a-4aa8-8104-7296535e9670 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:14.061893 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e2981-d44a-4aa8-8104-7296535e9670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:14.061893 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e2981-d44a-4aa8-8104-7296535e9670 admin admin] PATH_INFO: `/v3/projects/61c332c1241e4074b11c06c4f565e5f9/users/4e6248ada25c4a6aa7dfe89b97c65c48/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:14.061893 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e2981-d44a-4aa8-8104-7296535e9670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c332c1241e4074b11c06c4f565e5f9, user_id=4e6248ada25c4a6aa7dfe89b97c65c48, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:14.061893 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e2981-d44a-4aa8-8104-7296535e9670 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:14.194121 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 811/1629] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:13 2022] PUT /identity/v3/projects/ebd2389fc7ad461c8e0fa8141e87803a/users/7515c8fd8e5c4c0fbf470afb0723604e/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:14.195280 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2642101-0349-4d5c-b5d3-972e5e913f73 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:14.197074 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 818/1629] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:13 2022] PUT /identity/v3/projects/61c332c1241e4074b11c06c4f565e5f9/users/4e6248ada25c4a6aa7dfe89b97c65c48/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:14.198175 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e2981-d44a-4aa8-8104-7296535e9670 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:14.274799 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:14.285487 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e2981-d44a-4aa8-8104-7296535e9670 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:14.315675 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2642101-0349-4d5c-b5d3-972e5e913f73 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:14.329801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68793d89-a481-4665-aa17-9fa0e00dc365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:14.330838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68793d89-a481-4665-aa17-9fa0e00dc365 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:14.332326 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68793d89-a481-4665-aa17-9fa0e00dc365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:14.332782 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68793d89-a481-4665-aa17-9fa0e00dc365 admin admin] PATH_INFO: `/v3/projects/07f29f8e4c0c4c9ca0c668304d110ea2/users/325bb1e53f4140a6928cb8988ab0bbef/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:14.352666 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:14.360463 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68793d89-a481-4665-aa17-9fa0e00dc365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f29f8e4c0c4c9ca0c668304d110ea2, user_id=325bb1e53f4140a6928cb8988ab0bbef, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:14.365783 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68793d89-a481-4665-aa17-9fa0e00dc365 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:14.369252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e278d9-c544-459a-99f1-0baf67d1d7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:14.370862 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e278d9-c544-459a-99f1-0baf67d1d7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:14.371415 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e278d9-c544-459a-99f1-0baf67d1d7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:14.371867 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e278d9-c544-459a-99f1-0baf67d1d7e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:14.372773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e278d9-c544-459a-99f1-0baf67d1d7e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:14.374951 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e278d9-c544-459a-99f1-0baf67d1d7e4 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:14.387243 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 819/1630] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:14.388987 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e278d9-c544-459a-99f1-0baf67d1d7e4 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:14.400268 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e278d9-c544-459a-99f1-0baf67d1d7e4 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:14.405199 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce6d25-59e9-41ef-b621-485986422d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:14.405814 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce6d25-59e9-41ef-b621-485986422d6f admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:14.406235 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce6d25-59e9-41ef-b621-485986422d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:14.406742 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce6d25-59e9-41ef-b621-485986422d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:14.407393 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce6d25-59e9-41ef-b621-485986422d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:14.409144 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce6d25-59e9-41ef-b621-485986422d6f admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:14.420950 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 820/1631] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:14.422723 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ff3cf-d635-4c68-98ce-6c177dc0e60a None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:14.423197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ff3cf-d635-4c68-98ce-6c177dc0e60a None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:14.423643 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ff3cf-d635-4c68-98ce-6c177dc0e60a None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:14.425741 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 821/1632] 10.222.0.57 () {54 vars in 912 bytes} [Tue Aug 23 08:17:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:17:14.426724 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ff3cf-d635-4c68-98ce-6c177dc0e60a None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:14.440212 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ff3cf-d635-4c68-98ce-6c177dc0e60a None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:14.447019 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab6321-8aa0-449d-9d17-2c28ca8b73ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:14.447688 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab6321-8aa0-449d-9d17-2c28ca8b73ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:14.447986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab6321-8aa0-449d-9d17-2c28ca8b73ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:14.448457 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab6321-8aa0-449d-9d17-2c28ca8b73ab admin admin] PATH_INFO: `/v3/projects/ebd2389fc7ad461c8e0fa8141e87803a/users/7515c8fd8e5c4c0fbf470afb0723604e/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:14.451344 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab6321-8aa0-449d-9d17-2c28ca8b73ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebd2389fc7ad461c8e0fa8141e87803a, user_id=7515c8fd8e5c4c0fbf470afb0723604e, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:14.454002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab6321-8aa0-449d-9d17-2c28ca8b73ab admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:14.466068 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 822/1633] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:14 2022] PUT /identity/v3/projects/ebd2389fc7ad461c8e0fa8141e87803a/users/7515c8fd8e5c4c0fbf470afb0723604e/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:14.472982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab6321-8aa0-449d-9d17-2c28ca8b73ab admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:14.512593 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 812/1634] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:14 2022] PUT /identity/v3/projects/07f29f8e4c0c4c9ca0c668304d110ea2/users/325bb1e53f4140a6928cb8988ab0bbef/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:14.514177 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79519b-30a6-4229-a44b-e4c16d049925 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:14.520812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79519b-30a6-4229-a44b-e4c16d049925 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:14.520812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79519b-30a6-4229-a44b-e4c16d049925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:14.572329 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-0a79519b-30a6-4229-a44b-e4c16d049925 None None] MFA Rules not processed for user `b5c55e5c1cea47f29d378ea457384a31`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:14.572329 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-0a79519b-30a6-4229-a44b-e4c16d049925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:14.902827 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab6321-8aa0-449d-9d17-2c28ca8b73ab admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:14.902827 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4e1e2-ca01-4f9a-8ffd-314a53557f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:14.902827 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4e1e2-ca01-4f9a-8ffd-314a53557f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:14.902827 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4e1e2-ca01-4f9a-8ffd-314a53557f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:14.904017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4e1e2-ca01-4f9a-8ffd-314a53557f1d admin admin] PATH_INFO: `/v3/projects/61c332c1241e4074b11c06c4f565e5f9/users/4e6248ada25c4a6aa7dfe89b97c65c48/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:14.904017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4e1e2-ca01-4f9a-8ffd-314a53557f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c332c1241e4074b11c06c4f565e5f9, user_id=4e6248ada25c4a6aa7dfe89b97c65c48, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:14.904017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4e1e2-ca01-4f9a-8ffd-314a53557f1d admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:14.904285 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 813/1635] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 23 08:17:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:14.904285 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de216ff2-13c3-4f0e-aedd-7534ab779926 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:14.904285 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de216ff2-13c3-4f0e-aedd-7534ab779926 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:14.904285 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de216ff2-13c3-4f0e-aedd-7534ab779926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:14.904530 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 823/1636] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:14 2022] PUT /identity/v3/projects/61c332c1241e4074b11c06c4f565e5f9/users/4e6248ada25c4a6aa7dfe89b97c65c48/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:14.904530 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4e1e2-ca01-4f9a-8ffd-314a53557f1d admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:14.904663 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-de216ff2-13c3-4f0e-aedd-7534ab779926 None None] MFA Rules not processed for user `7515c8fd8e5c4c0fbf470afb0723604e`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:14.904663 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-de216ff2-13c3-4f0e-aedd-7534ab779926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:14.905368 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4e1e2-ca01-4f9a-8ffd-314a53557f1d admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:14.905368 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50750bb2-233e-467f-bdb0-2797eebf0385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:14.905368 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50750bb2-233e-467f-bdb0-2797eebf0385 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:14.905368 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50750bb2-233e-467f-bdb0-2797eebf0385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:14.905717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50750bb2-233e-467f-bdb0-2797eebf0385 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:14.905717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50750bb2-233e-467f-bdb0-2797eebf0385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:14.905717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50750bb2-233e-467f-bdb0-2797eebf0385 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:14.905717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 824/1637] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:14.905717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50750bb2-233e-467f-bdb0-2797eebf0385 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:14.906015 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 814/1638] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:14.906015 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428407ad-01cb-440b-9c48-3373e72636de None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:14.906015 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428407ad-01cb-440b-9c48-3373e72636de None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:14.906015 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428407ad-01cb-440b-9c48-3373e72636de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:14.906015 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-428407ad-01cb-440b-9c48-3373e72636de None None] MFA Rules not processed for user `4e6248ada25c4a6aa7dfe89b97c65c48`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:14.906015 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-428407ad-01cb-440b-9c48-3373e72636de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:14.927161 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50750bb2-233e-467f-bdb0-2797eebf0385 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:14.932782 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67b550-a502-4795-88c5-39580e355a05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:14.933868 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67b550-a502-4795-88c5-39580e355a05 service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:14.934274 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67b550-a502-4795-88c5-39580e355a05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:14.935221 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67b550-a502-4795-88c5-39580e355a05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:15.038312 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 815/1639] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:15.038312 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428407ad-01cb-440b-9c48-3373e72636de None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:15.076557 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428407ad-01cb-440b-9c48-3373e72636de None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:15.092259 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67b550-a502-4795-88c5-39580e355a05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:15.094234 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67b550-a502-4795-88c5-39580e355a05 service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:15.103765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a6234-8837-46d4-a94b-f033563efbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:15.104798 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a6234-8837-46d4-a94b-f033563efbcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:15.106105 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a6234-8837-46d4-a94b-f033563efbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:15.106702 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a6234-8837-46d4-a94b-f033563efbcd admin admin] PATH_INFO: `/v3/projects/07f29f8e4c0c4c9ca0c668304d110ea2/users/325bb1e53f4140a6928cb8988ab0bbef/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:15.114676 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a6234-8837-46d4-a94b-f033563efbcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f29f8e4c0c4c9ca0c668304d110ea2, user_id=325bb1e53f4140a6928cb8988ab0bbef, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:15.117539 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a6234-8837-46d4-a94b-f033563efbcd admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:15.120959 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 825/1640] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:15.123470 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67b550-a502-4795-88c5-39580e355a05 service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:15.143672 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:15.144649 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67b550-a502-4795-88c5-39580e355a05 service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:15.149423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 816/1641] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:15 2022] PUT /identity/v3/projects/07f29f8e4c0c4c9ca0c668304d110ea2/users/325bb1e53f4140a6928cb8988ab0bbef/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:15.161003 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc4f8c-3af9-468a-a935-29df26145844 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:15.161003 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc4f8c-3af9-468a-a935-29df26145844 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:15.161200 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc4f8c-3af9-468a-a935-29df26145844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:15.222626 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-6acc4f8c-3af9-468a-a935-29df26145844 None None] MFA Rules not processed for user `325bb1e53f4140a6928cb8988ab0bbef`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:15.223986 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-6acc4f8c-3af9-468a-a935-29df26145844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:15.225090 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d6b24-c0c1-46a7-aeec-9157f8319c4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:15.225827 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d6b24-c0c1-46a7-aeec-9157f8319c4f service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:15.226209 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d6b24-c0c1-46a7-aeec-9157f8319c4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:15.226565 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d6b24-c0c1-46a7-aeec-9157f8319c4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:15.247695 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:15.321897 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d6b24-c0c1-46a7-aeec-9157f8319c4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:15.324015 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d6b24-c0c1-46a7-aeec-9157f8319c4f service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:15.325156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 817/1642] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:15 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:17:15.341611 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 826/1643] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:16.314934 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc4f8c-3af9-468a-a935-29df26145844 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:16.332004 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc4f8c-3af9-468a-a935-29df26145844 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:16.335840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cfc6f-8754-4e44-b13f-6ed596dc3f3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:16.336387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cfc6f-8754-4e44-b13f-6ed596dc3f3d service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:16.336667 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cfc6f-8754-4e44-b13f-6ed596dc3f3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:16.336942 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cfc6f-8754-4e44-b13f-6ed596dc3f3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:16.452285 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894cfc6f-8754-4e44-b13f-6ed596dc3f3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:16.454930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894cfc6f-8754-4e44-b13f-6ed596dc3f3d service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:16.471527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 818/1644] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:16.727045 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d6b24-c0c1-46a7-aeec-9157f8319c4f service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:16.740280 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:16.741467 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d6b24-c0c1-46a7-aeec-9157f8319c4f service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:16.750712 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5925e9-08cc-4280-92a4-c01e6e647217 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:16.751443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5925e9-08cc-4280-92a4-c01e6e647217 service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:16.754977 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5925e9-08cc-4280-92a4-c01e6e647217 service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:16.755376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5925e9-08cc-4280-92a4-c01e6e647217 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:16.772994 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5925e9-08cc-4280-92a4-c01e6e647217 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:16.775722 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5925e9-08cc-4280-92a4-c01e6e647217 service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:16.790599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 827/1645] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:16 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:17.264858 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b549bd6-145f-4187-b287-dba2d46e07a0 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:17.265148 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b549bd6-145f-4187-b287-dba2d46e07a0 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:17.265422 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b549bd6-145f-4187-b287-dba2d46e07a0 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:17.266822 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 819/1646] 10.222.0.57 () {54 vars in 962 bytes} [Tue Aug 23 08:17:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:17:17.275769 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79d17a-4288-43d4-88d6-f35658b27477 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:17.276939 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79d17a-4288-43d4-88d6-f35658b27477 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:17.277621 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79d17a-4288-43d4-88d6-f35658b27477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:17.318757 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b549bd6-145f-4187-b287-dba2d46e07a0 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:17.339017 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b549bd6-145f-4187-b287-dba2d46e07a0 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:17.352785 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd8767-86ea-4928-b53a-db31f2bbaadc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:17.355288 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-bc79d17a-4288-43d4-88d6-f35658b27477 None None] MFA Rules not processed for user `b5c55e5c1cea47f29d378ea457384a31`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:17.356103 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd8767-86ea-4928-b53a-db31f2bbaadc service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:17.356532 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd8767-86ea-4928-b53a-db31f2bbaadc service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:17.359473 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd8767-86ea-4928-b53a-db31f2bbaadc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:17.364227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-bc79d17a-4288-43d4-88d6-f35658b27477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:17.426776 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:17.461151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 828/1647] 10.222.0.57 () {58 vars in 1059 bytes} [Tue Aug 23 08:17:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:17.468154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bbe5c-4c34-487d-8481-00494f11158e None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:17.468443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bbe5c-4c34-487d-8481-00494f11158e None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:17.468722 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bbe5c-4c34-487d-8481-00494f11158e None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:17.470079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 829/1648] 10.222.0.57 () {54 vars in 912 bytes} [Tue Aug 23 08:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:17:17.476927 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c46c95-7665-45a2-be30-8c6caeaec95c None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:17.477217 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c46c95-7665-45a2-be30-8c6caeaec95c None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:17.477496 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c46c95-7665-45a2-be30-8c6caeaec95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:17.500219 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd8767-86ea-4928-b53a-db31f2bbaadc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:17.505700 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd8767-86ea-4928-b53a-db31f2bbaadc service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:17.519338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-58c46c95-7665-45a2-be30-8c6caeaec95c None None] MFA Rules not processed for user `b5c55e5c1cea47f29d378ea457384a31`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:17.524713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-58c46c95-7665-45a2-be30-8c6caeaec95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:17.534233 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 820/1649] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:17 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:17.550003 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 830/1650] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 23 08:17:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:17:17.637434 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd8767-86ea-4928-b53a-db31f2bbaadc service cinder] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:17.664551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd8767-86ea-4928-b53a-db31f2bbaadc service cinder] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:17.671197 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d73635-8678-4588-a7ad-150ff16b371a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:17.672073 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d73635-8678-4588-a7ad-150ff16b371a service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:17.672500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d73635-8678-4588-a7ad-150ff16b371a service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:17.673060 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d73635-8678-4588-a7ad-150ff16b371a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:17.685751 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d73635-8678-4588-a7ad-150ff16b371a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:17.687686 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d73635-8678-4588-a7ad-150ff16b371a service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:17.701648 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 821/1651] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:18.789168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c46c95-7665-45a2-be30-8c6caeaec95c None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:19.002598 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c46c95-7665-45a2-be30-8c6caeaec95c None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:19.021248 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c718a-ed37-492b-bc5b-9e96ff79a65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:19.022030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c718a-ed37-492b-bc5b-9e96ff79a65f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:19.022351 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c718a-ed37-492b-bc5b-9e96ff79a65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:19.026139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c718a-ed37-492b-bc5b-9e96ff79a65f admin admin] PATH_INFO: `/v3/users/047a2c5c77d9417ab40abacae2c3386e` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:19.044522 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c718a-ed37-492b-bc5b-9e96ff79a65f admin admin] RBAC: Authorizing `identity:delete_user(user_id=047a2c5c77d9417ab40abacae2c3386e)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:19.048712 dv-cinder-854070-4-smb devstack@keystone.service[81771]: WARNING py.warnings [None req-0a1c718a-ed37-492b-bc5b-9e96ff79a65f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 08:17:19.048712 dv-cinder-854070-4-smb devstack@keystone.service[81771]: warnings.warn(msg) Aug 23 08:17:19.048712 dv-cinder-854070-4-smb devstack@keystone.service[81771]: Aug 23 08:17:19.052211 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c718a-ed37-492b-bc5b-9e96ff79a65f admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:19.563135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0a1c718a-ed37-492b-bc5b-9e96ff79a65f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '047a2c5c77d9417ab40abacae2c3386e'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:19.563982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0a1c718a-ed37-492b-bc5b-9e96ff79a65f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '047a2c5c77d9417ab40abacae2c3386e'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:19.566034 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0a1c718a-ed37-492b-bc5b-9e96ff79a65f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '047a2c5c77d9417ab40abacae2c3386e'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:19.650842 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0a1c718a-ed37-492b-bc5b-9e96ff79a65f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '047a2c5c77d9417ab40abacae2c3386e'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:19.742476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:19.749418 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0a1c718a-ed37-492b-bc5b-9e96ff79a65f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '047a2c5c77d9417ab40abacae2c3386e'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:19.805065 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 831/1652] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:17:18 2022] DELETE /identity/v3/users/047a2c5c77d9417ab40abacae2c3386e => generated 0 bytes in 1013 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:19.806638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e9cad-f10e-47e3-a111-4830360d203e None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:19.807057 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e9cad-f10e-47e3-a111-4830360d203e None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:19.807324 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e9cad-f10e-47e3-a111-4830360d203e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:19.852240 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-6f1e9cad-f10e-47e3-a111-4830360d203e None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:19.866747 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-6f1e9cad-f10e-47e3-a111-4830360d203e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:20.039904 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 822/1653] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:20.094472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c718a-ed37-492b-bc5b-9e96ff79a65f admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:20.096109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-0a1c718a-ed37-492b-bc5b-9e96ff79a65f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:20.258969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c718a-ed37-492b-bc5b-9e96ff79a65f admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:20.263051 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da037b-b99b-484a-b7d0-4c2a0c0d0797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:20.264434 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da037b-b99b-484a-b7d0-4c2a0c0d0797 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:20.264991 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da037b-b99b-484a-b7d0-4c2a0c0d0797 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:20.265936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da037b-b99b-484a-b7d0-4c2a0c0d0797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:20.278627 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da037b-b99b-484a-b7d0-4c2a0c0d0797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:20.281699 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da037b-b99b-484a-b7d0-4c2a0c0d0797 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:20.309032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 832/1654] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:20.667376 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e9cad-f10e-47e3-a111-4830360d203e None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:20.669559 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-6f1e9cad-f10e-47e3-a111-4830360d203e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:20.866522 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e9cad-f10e-47e3-a111-4830360d203e None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:20.866522 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2401877-d294-4d8b-9798-40a0fbb494d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:20.866522 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2401877-d294-4d8b-9798-40a0fbb494d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:20.866522 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2401877-d294-4d8b-9798-40a0fbb494d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:20.867611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2401877-d294-4d8b-9798-40a0fbb494d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:20.870720 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a2401877-d294-4d8b-9798-40a0fbb494d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:20.976383 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2401877-d294-4d8b-9798-40a0fbb494d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:20.983395 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2401877-d294-4d8b-9798-40a0fbb494d4 service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:21.001627 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 823/1655] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:21.915455 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da037b-b99b-484a-b7d0-4c2a0c0d0797 service neutron] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:21.917168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-f8da037b-b99b-484a-b7d0-4c2a0c0d0797 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:21.942634 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da037b-b99b-484a-b7d0-4c2a0c0d0797 service neutron] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:21.956547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafd7ee-3b0b-4e54-8574-991c13139741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:21.959020 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafd7ee-3b0b-4e54-8574-991c13139741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:21.959314 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafd7ee-3b0b-4e54-8574-991c13139741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:21.960731 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafd7ee-3b0b-4e54-8574-991c13139741 admin admin] PATH_INFO: `/v3/projects/6e83c6ea71bc4411a2d85eeab5c99625` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:21.964055 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafd7ee-3b0b-4e54-8574-991c13139741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e83c6ea71bc4411a2d85eeab5c99625)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:21.970928 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafd7ee-3b0b-4e54-8574-991c13139741 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:22.214647 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-fcafd7ee-3b0b-4e54-8574-991c13139741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e83c6ea71bc4411a2d85eeab5c99625', 'request_id': 'req-fcafd7ee-3b0b-4e54-8574-991c13139741'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:22.220770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-fcafd7ee-3b0b-4e54-8574-991c13139741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e83c6ea71bc4411a2d85eeab5c99625', 'request_id': 'req-fcafd7ee-3b0b-4e54-8574-991c13139741'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:22.230926 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-fcafd7ee-3b0b-4e54-8574-991c13139741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e83c6ea71bc4411a2d85eeab5c99625', 'request_id': 'req-fcafd7ee-3b0b-4e54-8574-991c13139741'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:22.393910 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-fcafd7ee-3b0b-4e54-8574-991c13139741 admin admin] The token cache is being invalidate because project 6e83c6ea71bc4411a2d85eeab5c99625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:17:22.394505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-fcafd7ee-3b0b-4e54-8574-991c13139741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:22.396685 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-fcafd7ee-3b0b-4e54-8574-991c13139741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:22.404230 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2401877-d294-4d8b-9798-40a0fbb494d4 service cinder] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:22.405936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 833/1656] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:17:21 2022] DELETE /identity/v3/projects/6e83c6ea71bc4411a2d85eeab5c99625 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:22.423396 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2401877-d294-4d8b-9798-40a0fbb494d4 service cinder] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:22.430566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:22.571896 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21daed91-36f6-4fea-af0f-0c7732585db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:22.572668 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21daed91-36f6-4fea-af0f-0c7732585db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:22.572995 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21daed91-36f6-4fea-af0f-0c7732585db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:22.575203 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21daed91-36f6-4fea-af0f-0c7732585db8 admin admin] PATH_INFO: `/v3/users/4e6248ada25c4a6aa7dfe89b97c65c48` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:22.577558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21daed91-36f6-4fea-af0f-0c7732585db8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e6248ada25c4a6aa7dfe89b97c65c48)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:22.586996 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21daed91-36f6-4fea-af0f-0c7732585db8 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:22.984047 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-21daed91-36f6-4fea-af0f-0c7732585db8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e6248ada25c4a6aa7dfe89b97c65c48'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:22.984752 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-21daed91-36f6-4fea-af0f-0c7732585db8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e6248ada25c4a6aa7dfe89b97c65c48'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:22.985556 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-21daed91-36f6-4fea-af0f-0c7732585db8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e6248ada25c4a6aa7dfe89b97c65c48'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:23.099161 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-21daed91-36f6-4fea-af0f-0c7732585db8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e6248ada25c4a6aa7dfe89b97c65c48'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:23.119610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-21daed91-36f6-4fea-af0f-0c7732585db8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e6248ada25c4a6aa7dfe89b97c65c48'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:23.156287 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 824/1657] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:17:22 2022] DELETE /identity/v3/users/4e6248ada25c4a6aa7dfe89b97c65c48 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:23.682678 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266a10a-81b8-44e7-803d-1dcbec2916f0 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:23.683377 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266a10a-81b8-44e7-803d-1dcbec2916f0 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:23.683377 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266a10a-81b8-44e7-803d-1dcbec2916f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:23.745358 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-c266a10a-81b8-44e7-803d-1dcbec2916f0 None None] MFA Rules not processed for user `8926315ca58e466ba6ce873f4833f06b`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:23.745358 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c266a10a-81b8-44e7-803d-1dcbec2916f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:23.842437 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:23.850386 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 834/1658] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:23.868514 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecfef4-cf9c-4b4b-8a95-b1d1bf5801b0 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:23.869546 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecfef4-cf9c-4b4b-8a95-b1d1bf5801b0 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:23.881031 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecfef4-cf9c-4b4b-8a95-b1d1bf5801b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:23.928511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-bbecfef4-cf9c-4b4b-8a95-b1d1bf5801b0 None None] MFA Rules not processed for user `8926315ca58e466ba6ce873f4833f06b`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:23.930414 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-bbecfef4-cf9c-4b4b-8a95-b1d1bf5801b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:23.946224 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 825/1659] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:23.957687 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266a10a-81b8-44e7-803d-1dcbec2916f0 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:23.963152 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c266a10a-81b8-44e7-803d-1dcbec2916f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:24.068604 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266a10a-81b8-44e7-803d-1dcbec2916f0 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:24.077215 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b25ab1-2f93-41bb-93df-aa5f4c367ec2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:24.078563 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b25ab1-2f93-41bb-93df-aa5f4c367ec2 service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:24.079122 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b25ab1-2f93-41bb-93df-aa5f4c367ec2 service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:24.079613 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b25ab1-2f93-41bb-93df-aa5f4c367ec2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:24.092609 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b25ab1-2f93-41bb-93df-aa5f4c367ec2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:24.094669 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b25ab1-2f93-41bb-93df-aa5f4c367ec2 service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:24.110730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 835/1660] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:23 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:24.625341 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecfef4-cf9c-4b4b-8a95-b1d1bf5801b0 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:24.627045 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-bbecfef4-cf9c-4b4b-8a95-b1d1bf5801b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:24.769460 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467b9b9-a502-47c7-b595-2859644a21ac None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:24.778140 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467b9b9-a502-47c7-b595-2859644a21ac None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:24.778140 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467b9b9-a502-47c7-b595-2859644a21ac None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:24.778140 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 836/1661] 10.222.0.57 () {54 vars in 912 bytes} [Tue Aug 23 08:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 08:17:24.778140 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c29f2d-c8d2-4a6f-a61f-165eac75b7ec None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:24.778140 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c29f2d-c8d2-4a6f-a61f-165eac75b7ec None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:24.778140 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c29f2d-c8d2-4a6f-a61f-165eac75b7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:24.811960 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecfef4-cf9c-4b4b-8a95-b1d1bf5801b0 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:24.825569 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5f517-e791-47e3-ad51-1d26bbdf3dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:24.826479 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5f517-e791-47e3-ad51-1d26bbdf3dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:24.826922 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5f517-e791-47e3-ad51-1d26bbdf3dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:24.829159 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5f517-e791-47e3-ad51-1d26bbdf3dd7 admin admin] PATH_INFO: `/v3/projects/61c332c1241e4074b11c06c4f565e5f9` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:24.830790 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5f517-e791-47e3-ad51-1d26bbdf3dd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61c332c1241e4074b11c06c4f565e5f9)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:24.831962 dv-cinder-854070-4-smb devstack@keystone.service[81770]: WARNING py.warnings [None req-deb5f517-e791-47e3-ad51-1d26bbdf3dd7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 08:17:24.831962 dv-cinder-854070-4-smb devstack@keystone.service[81770]: warnings.warn(msg) Aug 23 08:17:24.831962 dv-cinder-854070-4-smb devstack@keystone.service[81770]: Aug 23 08:17:24.833801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5f517-e791-47e3-ad51-1d26bbdf3dd7 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:24.868916 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:24.900650 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-02c29f2d-c8d2-4a6f-a61f-165eac75b7ec None None] MFA Rules not processed for user `4239cee14f954e95b4a6b0af2e8799b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:24.903814 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-02c29f2d-c8d2-4a6f-a61f-165eac75b7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:25.080922 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-deb5f517-e791-47e3-ad51-1d26bbdf3dd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61c332c1241e4074b11c06c4f565e5f9', 'request_id': 'req-deb5f517-e791-47e3-ad51-1d26bbdf3dd7'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:25.102136 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 837/1662] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 23 08:17:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:17:25.103712 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae55eff-96ce-42ed-baa4-7e00212e9ce8 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:25.104206 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae55eff-96ce-42ed-baa4-7e00212e9ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:25.105251 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae55eff-96ce-42ed-baa4-7e00212e9ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:25.125914 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-deb5f517-e791-47e3-ad51-1d26bbdf3dd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61c332c1241e4074b11c06c4f565e5f9', 'request_id': 'req-deb5f517-e791-47e3-ad51-1d26bbdf3dd7'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:25.175327 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-cae55eff-96ce-42ed-baa4-7e00212e9ce8 None None] MFA Rules not processed for user `174ebadbeec64175bd09beb3e270c573`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:25.176566 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-cae55eff-96ce-42ed-baa4-7e00212e9ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:25.184942 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-deb5f517-e791-47e3-ad51-1d26bbdf3dd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61c332c1241e4074b11c06c4f565e5f9', 'request_id': 'req-deb5f517-e791-47e3-ad51-1d26bbdf3dd7'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:25.305155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-deb5f517-e791-47e3-ad51-1d26bbdf3dd7 admin admin] The token cache is being invalidate because project 61c332c1241e4074b11c06c4f565e5f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:17:25.305515 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-deb5f517-e791-47e3-ad51-1d26bbdf3dd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:25.306253 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-deb5f517-e791-47e3-ad51-1d26bbdf3dd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:25.311562 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 826/1663] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:17:24 2022] DELETE /identity/v3/projects/61c332c1241e4074b11c06c4f565e5f9 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:25.317865 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984a83f-ea51-4bce-a148-39faeb0e3dfc None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:25.318527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984a83f-ea51-4bce-a148-39faeb0e3dfc None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:25.319075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984a83f-ea51-4bce-a148-39faeb0e3dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:25.366614 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 838/1664] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:25.387085 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae55eff-96ce-42ed-baa4-7e00212e9ce8 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:25.388690 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-cae55eff-96ce-42ed-baa4-7e00212e9ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:25.390992 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-5984a83f-ea51-4bce-a148-39faeb0e3dfc None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:25.393634 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-5984a83f-ea51-4bce-a148-39faeb0e3dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:25.528578 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae55eff-96ce-42ed-baa4-7e00212e9ce8 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:25.534943 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 827/1665] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:25.544420 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209e46d-af78-4e93-b0a1-dd0c83928a45 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:25.544943 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209e46d-af78-4e93-b0a1-dd0c83928a45 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:25.545371 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209e46d-af78-4e93-b0a1-dd0c83928a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:25.555078 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e465eb-d215-4325-8377-c8124d31c675 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:25.555711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e465eb-d215-4325-8377-c8124d31c675 service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:25.556204 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e465eb-d215-4325-8377-c8124d31c675 service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:25.556662 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e465eb-d215-4325-8377-c8124d31c675 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:25.573270 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-d209e46d-af78-4e93-b0a1-dd0c83928a45 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:25.573270 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-d209e46d-af78-4e93-b0a1-dd0c83928a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:25.573446 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e465eb-d215-4325-8377-c8124d31c675 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:25.575599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e465eb-d215-4325-8377-c8124d31c675 service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:25.586084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 828/1666] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:25.587872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209e46d-af78-4e93-b0a1-dd0c83928a45 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:25.597792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 839/1667] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:25.609160 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e465eb-d215-4325-8377-c8124d31c675 service nova] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:25.610883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-70e465eb-d215-4325-8377-c8124d31c675 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:25.617601 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209e46d-af78-4e93-b0a1-dd0c83928a45 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:25.630119 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3fa77-8d0c-4473-a35f-1b8629948deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:25.631165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3fa77-8d0c-4473-a35f-1b8629948deb admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:25.631633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3fa77-8d0c-4473-a35f-1b8629948deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:25.632023 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3fa77-8d0c-4473-a35f-1b8629948deb admin admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:25.632962 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3fa77-8d0c-4473-a35f-1b8629948deb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:17:25.633336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3fa77-8d0c-4473-a35f-1b8629948deb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:25.637147 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3fa77-8d0c-4473-a35f-1b8629948deb admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:25.710066 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 829/1668] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 08:17:25.716242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3fa77-8d0c-4473-a35f-1b8629948deb admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:25.740565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3fa77-8d0c-4473-a35f-1b8629948deb admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:25.743799 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:25.755959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09282133-84a8-4b19-bb6f-a44e0635dff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:25.756608 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09282133-84a8-4b19-bb6f-a44e0635dff3 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:25.756895 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09282133-84a8-4b19-bb6f-a44e0635dff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:25.757171 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09282133-84a8-4b19-bb6f-a44e0635dff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:25.763368 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09282133-84a8-4b19-bb6f-a44e0635dff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:25.768889 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09282133-84a8-4b19-bb6f-a44e0635dff3 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:25.795882 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e465eb-d215-4325-8377-c8124d31c675 service nova] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:25.805587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e98bff-bc4e-4ab8-98d4-37194f79ecb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:25.806205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e98bff-bc4e-4ab8-98d4-37194f79ecb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:25.806518 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e98bff-bc4e-4ab8-98d4-37194f79ecb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:25.806795 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e98bff-bc4e-4ab8-98d4-37194f79ecb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:25.810705 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-85e98bff-bc4e-4ab8-98d4-37194f79ecb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:25.823334 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e98bff-bc4e-4ab8-98d4-37194f79ecb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:25.824800 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e98bff-bc4e-4ab8-98d4-37194f79ecb7 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:25.835523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 840/1669] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:17:25.887317 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 830/1670] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:17:25 2022] POST /identity/v3/projects => generated 393 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:25.892356 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e98bff-bc4e-4ab8-98d4-37194f79ecb7 service neutron] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:25.942012 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e98bff-bc4e-4ab8-98d4-37194f79ecb7 service neutron] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:26.176026 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47086d-4bb0-4834-bea9-384bea05ddc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:26.176783 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47086d-4bb0-4834-bea9-384bea05ddc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:26.177068 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47086d-4bb0-4834-bea9-384bea05ddc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:26.177344 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47086d-4bb0-4834-bea9-384bea05ddc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:26.177984 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47086d-4bb0-4834-bea9-384bea05ddc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:26.191086 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47086d-4bb0-4834-bea9-384bea05ddc8 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:26.245349 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09282133-84a8-4b19-bb6f-a44e0635dff3 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:26.248881 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-09282133-84a8-4b19-bb6f-a44e0635dff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:26.280061 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09282133-84a8-4b19-bb6f-a44e0635dff3 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:26.292416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf6b79-086e-4755-b764-6e15dd43abb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:26.293357 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf6b79-086e-4755-b764-6e15dd43abb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:26.293961 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf6b79-086e-4755-b764-6e15dd43abb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:26.294458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf6b79-086e-4755-b764-6e15dd43abb7 admin admin] PATH_INFO: `/v3/users/004f95e4e97741eaaef6cc04ca0717ac` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:26.295926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf6b79-086e-4755-b764-6e15dd43abb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=004f95e4e97741eaaef6cc04ca0717ac)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:26.299287 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf6b79-086e-4755-b764-6e15dd43abb7 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:26.352752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 841/1671] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:17:25 2022] POST /identity/v3/users => generated 297 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:26.353842 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47086d-4bb0-4834-bea9-384bea05ddc8 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:26.384711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47086d-4bb0-4834-bea9-384bea05ddc8 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:26.397325 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fdf79-b04d-4847-b5e4-47cb6b50f6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:26.398347 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fdf79-b04d-4847-b5e4-47cb6b50f6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:26.398799 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fdf79-b04d-4847-b5e4-47cb6b50f6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:26.399225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fdf79-b04d-4847-b5e4-47cb6b50f6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:26.400195 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fdf79-b04d-4847-b5e4-47cb6b50f6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:26.403728 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fdf79-b04d-4847-b5e4-47cb6b50f6f8 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:26.443303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 842/1672] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:17:26.444321 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fdf79-b04d-4847-b5e4-47cb6b50f6f8 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:26.464574 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fdf79-b04d-4847-b5e4-47cb6b50f6f8 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:26.479471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036f1c6-c048-42a4-bb77-a94b13efa645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:26.481314 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036f1c6-c048-42a4-bb77-a94b13efa645 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:26.481848 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036f1c6-c048-42a4-bb77-a94b13efa645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:26.482342 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036f1c6-c048-42a4-bb77-a94b13efa645 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:26.483269 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7036f1c6-c048-42a4-bb77-a94b13efa645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:26.485262 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7036f1c6-c048-42a4-bb77-a94b13efa645 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:26.510369 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 843/1673] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:26.519231 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036f1c6-c048-42a4-bb77-a94b13efa645 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:26.536497 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036f1c6-c048-42a4-bb77-a94b13efa645 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:26.547869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-0ebf6b79-086e-4755-b764-6e15dd43abb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '004f95e4e97741eaaef6cc04ca0717ac'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:26.550432 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-0ebf6b79-086e-4755-b764-6e15dd43abb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '004f95e4e97741eaaef6cc04ca0717ac'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:26.552339 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-0ebf6b79-086e-4755-b764-6e15dd43abb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '004f95e4e97741eaaef6cc04ca0717ac'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:26.553378 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8e157-a764-413f-857a-759a9edec960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:26.558816 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8e157-a764-413f-857a-759a9edec960 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:26.559520 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8e157-a764-413f-857a-759a9edec960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:26.559955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8e157-a764-413f-857a-759a9edec960 admin admin] PATH_INFO: `/v3/projects/d716c9235da544abbbf5d1b035a88044/users/92d7532e27534c1a9edbb9a1e39a5b12/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:26.564973 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:26.620584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8e157-a764-413f-857a-759a9edec960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d716c9235da544abbbf5d1b035a88044, user_id=92d7532e27534c1a9edbb9a1e39a5b12, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:26.627927 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8e157-a764-413f-857a-759a9edec960 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:26.673665 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-0ebf6b79-086e-4755-b764-6e15dd43abb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '004f95e4e97741eaaef6cc04ca0717ac'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:26.685271 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-0ebf6b79-086e-4755-b764-6e15dd43abb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '004f95e4e97741eaaef6cc04ca0717ac'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:26.688241 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:26.726873 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 844/1674] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:26 2022] PUT /identity/v3/projects/d716c9235da544abbbf5d1b035a88044/users/92d7532e27534c1a9edbb9a1e39a5b12/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:26.729579 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a9c80-159e-4422-8c7e-7d4df6ca2262 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:26.729936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a9c80-159e-4422-8c7e-7d4df6ca2262 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:26.730305 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a9c80-159e-4422-8c7e-7d4df6ca2262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:26.761709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 831/1675] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:17:26 2022] DELETE /identity/v3/users/004f95e4e97741eaaef6cc04ca0717ac => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:26.764434 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bb439-a578-465c-9722-ed6a11158815 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:26.764729 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bb439-a578-465c-9722-ed6a11158815 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:26.765010 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bb439-a578-465c-9722-ed6a11158815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:26.807890 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-536a9c80-159e-4422-8c7e-7d4df6ca2262 None None] MFA Rules not processed for user `92d7532e27534c1a9edbb9a1e39a5b12`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:26.814703 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-536a9c80-159e-4422-8c7e-7d4df6ca2262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:26.846836 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-209bb439-a578-465c-9722-ed6a11158815 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:26.852841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-209bb439-a578-465c-9722-ed6a11158815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:27.018796 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 832/1676] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:27.042799 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bb439-a578-465c-9722-ed6a11158815 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:27.045855 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-209bb439-a578-465c-9722-ed6a11158815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:27.089475 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 845/1677] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:17:27.095922 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a9c80-159e-4422-8c7e-7d4df6ca2262 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:27.101681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-536a9c80-159e-4422-8c7e-7d4df6ca2262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:27.164006 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a9c80-159e-4422-8c7e-7d4df6ca2262 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:27.181378 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513cc262-9003-41c8-9b4e-669c8512a5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:27.184489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cc262-9003-41c8-9b4e-669c8512a5ee admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:27.186759 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cc262-9003-41c8-9b4e-669c8512a5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:27.187148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cc262-9003-41c8-9b4e-669c8512a5ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:27.191114 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513cc262-9003-41c8-9b4e-669c8512a5ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:27.193875 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bb439-a578-465c-9722-ed6a11158815 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:27.197975 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513cc262-9003-41c8-9b4e-669c8512a5ee admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:27.200688 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86a96b-43bf-4d6c-895f-65f2a6e4e250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:27.201696 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86a96b-43bf-4d6c-895f-65f2a6e4e250 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:27.202373 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86a96b-43bf-4d6c-895f-65f2a6e4e250 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:27.203349 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86a96b-43bf-4d6c-895f-65f2a6e4e250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:27.221710 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86a96b-43bf-4d6c-895f-65f2a6e4e250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:27.232350 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86a96b-43bf-4d6c-895f-65f2a6e4e250 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:27.247767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 833/1678] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:27.417574 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 846/1679] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:17:27 2022] POST /identity/v3/projects => generated 393 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:27.418363 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86a96b-43bf-4d6c-895f-65f2a6e4e250 service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:27.458230 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86a96b-43bf-4d6c-895f-65f2a6e4e250 service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:27.618970 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a022b-317d-418b-a4b7-1f087acb85bc None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:27.619550 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a022b-317d-418b-a4b7-1f087acb85bc None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:27.621057 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a022b-317d-418b-a4b7-1f087acb85bc None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:27.621459 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 847/1680] 10.222.0.57 () {54 vars in 961 bytes} [Tue Aug 23 08:17:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:17:27.627584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daac67-ce07-4fa7-ada5-a23fca913297 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:27.627881 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daac67-ce07-4fa7-ada5-a23fca913297 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:27.628134 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daac67-ce07-4fa7-ada5-a23fca913297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:27.668970 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1d839-f2ba-4d32-a188-6e136902a48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:27.672916 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1d839-f2ba-4d32-a188-6e136902a48f admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:27.673415 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1d839-f2ba-4d32-a188-6e136902a48f admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:27.675288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1d839-f2ba-4d32-a188-6e136902a48f admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:27.676047 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1d839-f2ba-4d32-a188-6e136902a48f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:27.680749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1d839-f2ba-4d32-a188-6e136902a48f admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:27.683516 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-c4daac67-ce07-4fa7-ada5-a23fca913297 None None] MFA Rules not processed for user `8e92560dd9da4c7cbcac5a84bcaca483`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:27.684778 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c4daac67-ce07-4fa7-ada5-a23fca913297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:27.817053 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 834/1681] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:17:27 2022] POST /identity/v3/users => generated 303 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:27.817053 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a3684-8d3b-41e5-8b09-5c17cf120a41 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:27.817053 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a3684-8d3b-41e5-8b09-5c17cf120a41 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:27.817053 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a3684-8d3b-41e5-8b09-5c17cf120a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:27.836998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 848/1682] 10.222.0.57 () {58 vars in 1058 bytes} [Tue Aug 23 08:17:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:27.838024 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4daac67-ce07-4fa7-ada5-a23fca913297 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:27.852948 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4daac67-ce07-4fa7-ada5-a23fca913297 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:27.860828 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ac2de-05fb-414d-a5a0-7f2f6039d84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:27.861876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ac2de-05fb-414d-a5a0-7f2f6039d84f admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:27.862307 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ac2de-05fb-414d-a5a0-7f2f6039d84f admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:27.862687 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ac2de-05fb-414d-a5a0-7f2f6039d84f admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:27.863521 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ac2de-05fb-414d-a5a0-7f2f6039d84f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:27.867058 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ac2de-05fb-414d-a5a0-7f2f6039d84f admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:27.880388 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-b35a3684-8d3b-41e5-8b09-5c17cf120a41 None None] MFA Rules not processed for user `8926315ca58e466ba6ce873f4833f06b`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:27.881650 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-b35a3684-8d3b-41e5-8b09-5c17cf120a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:27.885285 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 849/1683] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:27.885285 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ac2de-05fb-414d-a5a0-7f2f6039d84f admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:27.902680 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ac2de-05fb-414d-a5a0-7f2f6039d84f admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:27.915052 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94532df7-4499-4c64-8ba1-67cd8747973a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e92560dd9da4c7cbcac5a84bcaca483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:27.918700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94532df7-4499-4c64-8ba1-67cd8747973a service placement] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:27.919282 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94532df7-4499-4c64-8ba1-67cd8747973a service placement] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:27.919661 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94532df7-4499-4c64-8ba1-67cd8747973a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:27.922755 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-94532df7-4499-4c64-8ba1-67cd8747973a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:27.936970 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94532df7-4499-4c64-8ba1-67cd8747973a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:27.938810 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94532df7-4499-4c64-8ba1-67cd8747973a service placement] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:27.951022 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 850/1684] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:27.952196 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94532df7-4499-4c64-8ba1-67cd8747973a service placement] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:27.966880 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94532df7-4499-4c64-8ba1-67cd8747973a service placement] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:27.987106 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77b8a5-d795-4e15-a8ea-e5f79f76126d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:27.989019 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77b8a5-d795-4e15-a8ea-e5f79f76126d admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:27.990528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77b8a5-d795-4e15-a8ea-e5f79f76126d admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:27.990920 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77b8a5-d795-4e15-a8ea-e5f79f76126d admin admin] PATH_INFO: `/v3/projects/7448931658c34d59bfafb94bd7a0fc7a/users/250d4f931e364d4a94518dbfe0af68f2/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:28.047879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77b8a5-d795-4e15-a8ea-e5f79f76126d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7448931658c34d59bfafb94bd7a0fc7a, user_id=250d4f931e364d4a94518dbfe0af68f2, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:28.065099 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77b8a5-d795-4e15-a8ea-e5f79f76126d admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:28.107236 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 835/1685] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:28.254120 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 851/1686] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:27 2022] PUT /identity/v3/projects/7448931658c34d59bfafb94bd7a0fc7a/users/250d4f931e364d4a94518dbfe0af68f2/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:28.258931 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a3684-8d3b-41e5-8b09-5c17cf120a41 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:28.275803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a3684-8d3b-41e5-8b09-5c17cf120a41 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:28.284095 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:28.493013 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbbff7e-a0ef-446d-bc7c-e714809a2ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:28.494170 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbff7e-a0ef-446d-bc7c-e714809a2ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:28.496816 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbff7e-a0ef-446d-bc7c-e714809a2ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:28.497714 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbff7e-a0ef-446d-bc7c-e714809a2ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:28.499868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbbff7e-a0ef-446d-bc7c-e714809a2ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:28.502728 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbbff7e-a0ef-446d-bc7c-e714809a2ca9 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:28.540968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 836/1687] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:28.546912 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77b8a5-d795-4e15-a8ea-e5f79f76126d admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:28.560237 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77b8a5-d795-4e15-a8ea-e5f79f76126d admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:28.578462 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89ded5-ba1f-4bdb-b59b-7be538b431c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:28.579724 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89ded5-ba1f-4bdb-b59b-7be538b431c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:28.581384 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89ded5-ba1f-4bdb-b59b-7be538b431c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:28.581934 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89ded5-ba1f-4bdb-b59b-7be538b431c8 admin admin] PATH_INFO: `/v3/projects/7448931658c34d59bfafb94bd7a0fc7a/users/250d4f931e364d4a94518dbfe0af68f2/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:28.586863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89ded5-ba1f-4bdb-b59b-7be538b431c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7448931658c34d59bfafb94bd7a0fc7a, user_id=250d4f931e364d4a94518dbfe0af68f2, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:28.595549 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89ded5-ba1f-4bdb-b59b-7be538b431c8 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:28.621341 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 852/1688] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:28 2022] PUT /identity/v3/projects/7448931658c34d59bfafb94bd7a0fc7a/users/250d4f931e364d4a94518dbfe0af68f2/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:28.633947 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7bd6f-94db-4859-810e-5acebede82d3 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:28.634387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7bd6f-94db-4859-810e-5acebede82d3 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:28.644641 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7bd6f-94db-4859-810e-5acebede82d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:28.691907 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-dda7bd6f-94db-4859-810e-5acebede82d3 None None] MFA Rules not processed for user `250d4f931e364d4a94518dbfe0af68f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:28.693542 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-dda7bd6f-94db-4859-810e-5acebede82d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:28.798391 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 837/1689] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:28 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:28.808252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89ded5-ba1f-4bdb-b59b-7be538b431c8 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:28.810534 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-5d89ded5-ba1f-4bdb-b59b-7be538b431c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:28.905593 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7bd6f-94db-4859-810e-5acebede82d3 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:28.909954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-dda7bd6f-94db-4859-810e-5acebede82d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:28.964191 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89ded5-ba1f-4bdb-b59b-7be538b431c8 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:28.981547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f1534-4551-4e45-929f-493d6a8f7203 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:28.981951 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f1534-4551-4e45-929f-493d6a8f7203 service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:28.982389 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f1534-4551-4e45-929f-493d6a8f7203 service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:28.982668 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f1534-4551-4e45-929f-493d6a8f7203 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:29.009317 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f1534-4551-4e45-929f-493d6a8f7203 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:29.011297 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f1534-4551-4e45-929f-493d6a8f7203 service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:29.035984 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 853/1690] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:28 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:29.111654 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7bd6f-94db-4859-810e-5acebede82d3 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:29.118932 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802e6af-ad25-467c-805c-d7ba0f5c9d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:29.119774 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802e6af-ad25-467c-805c-d7ba0f5c9d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:29.120232 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802e6af-ad25-467c-805c-d7ba0f5c9d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:29.120664 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802e6af-ad25-467c-805c-d7ba0f5c9d62 admin admin] PATH_INFO: `/v3/projects/3d453e5d935b49479d77a1a637fb4eb1` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:29.123007 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802e6af-ad25-467c-805c-d7ba0f5c9d62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d453e5d935b49479d77a1a637fb4eb1)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:29.131018 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802e6af-ad25-467c-805c-d7ba0f5c9d62 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:29.148607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f1534-4551-4e45-929f-493d6a8f7203 service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:29.164324 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f1534-4551-4e45-929f-493d6a8f7203 service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:29.172735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745adb7-95db-4497-bc0d-c64434cd28c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:29.173812 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745adb7-95db-4497-bc0d-c64434cd28c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:29.174511 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745adb7-95db-4497-bc0d-c64434cd28c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:29.175368 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745adb7-95db-4497-bc0d-c64434cd28c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:29.320229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745adb7-95db-4497-bc0d-c64434cd28c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:29.321973 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745adb7-95db-4497-bc0d-c64434cd28c0 service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:29.371596 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-3802e6af-ad25-467c-805c-d7ba0f5c9d62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d453e5d935b49479d77a1a637fb4eb1', 'request_id': 'req-3802e6af-ad25-467c-805c-d7ba0f5c9d62'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:29.381534 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-3802e6af-ad25-467c-805c-d7ba0f5c9d62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d453e5d935b49479d77a1a637fb4eb1', 'request_id': 'req-3802e6af-ad25-467c-805c-d7ba0f5c9d62'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:29.382155 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 854/1691] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:29 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:17:29.397721 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-3802e6af-ad25-467c-805c-d7ba0f5c9d62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d453e5d935b49479d77a1a637fb4eb1', 'request_id': 'req-3802e6af-ad25-467c-805c-d7ba0f5c9d62'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:29.525909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-3802e6af-ad25-467c-805c-d7ba0f5c9d62 admin admin] The token cache is being invalidate because project 3d453e5d935b49479d77a1a637fb4eb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:17:29.526375 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-3802e6af-ad25-467c-805c-d7ba0f5c9d62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:29.527393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-3802e6af-ad25-467c-805c-d7ba0f5c9d62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:29.530173 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 838/1692] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:17:28 2022] DELETE /identity/v3/projects/3d453e5d935b49479d77a1a637fb4eb1 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:29.534963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c1474-cec3-418c-9b4f-ee9ae7e3a527 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:29.535403 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c1474-cec3-418c-9b4f-ee9ae7e3a527 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:29.535673 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:29.535955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c1474-cec3-418c-9b4f-ee9ae7e3a527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:29.587468 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-c57c1474-cec3-418c-9b4f-ee9ae7e3a527 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:29.588746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c57c1474-cec3-418c-9b4f-ee9ae7e3a527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:29.783536 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 855/1693] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:29.786060 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5abafa-8a18-446a-8c2a-b8977b37ce0f None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:29.786410 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5abafa-8a18-446a-8c2a-b8977b37ce0f None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:29.786661 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5abafa-8a18-446a-8c2a-b8977b37ce0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:29.839382 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-ee5abafa-8a18-446a-8c2a-b8977b37ce0f None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:29.841741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-ee5abafa-8a18-446a-8c2a-b8977b37ce0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:29.863613 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 839/1694] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:29.867245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c1474-cec3-418c-9b4f-ee9ae7e3a527 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:29.899195 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c1474-cec3-418c-9b4f-ee9ae7e3a527 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:29.930689 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661acf9-15e6-4e47-84bb-324c70c850cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:29.930689 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661acf9-15e6-4e47-84bb-324c70c850cf admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:29.930689 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661acf9-15e6-4e47-84bb-324c70c850cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:29.930689 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661acf9-15e6-4e47-84bb-324c70c850cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:29.931171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661acf9-15e6-4e47-84bb-324c70c850cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:17:29.931171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661acf9-15e6-4e47-84bb-324c70c850cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:29.935192 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661acf9-15e6-4e47-84bb-324c70c850cf admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:29.973045 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 856/1695] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:17:29.978389 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5abafa-8a18-446a-8c2a-b8977b37ce0f None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:29.996162 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5abafa-8a18-446a-8c2a-b8977b37ce0f None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:30.015694 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fededd-d241-45d7-b456-980e5e511940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:30.018081 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fededd-d241-45d7-b456-980e5e511940 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:30.020111 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fededd-d241-45d7-b456-980e5e511940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:30.024387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fededd-d241-45d7-b456-980e5e511940 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:30.026413 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fededd-d241-45d7-b456-980e5e511940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:30.050662 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fededd-d241-45d7-b456-980e5e511940 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:30.215623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 840/1696] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:17:29 2022] POST /identity/v3/projects => generated 405 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:30.216653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661acf9-15e6-4e47-84bb-324c70c850cf admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:30.233852 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661acf9-15e6-4e47-84bb-324c70c850cf admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:30.273550 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:30.449753 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4280cb-cdb2-405e-8883-8ee9e7d95b30 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:30.450408 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4280cb-cdb2-405e-8883-8ee9e7d95b30 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:30.451455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4280cb-cdb2-405e-8883-8ee9e7d95b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:30.466924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440204b-5483-459f-923c-e25c99bc9954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:30.467592 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440204b-5483-459f-923c-e25c99bc9954 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:30.467880 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440204b-5483-459f-923c-e25c99bc9954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:30.468162 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440204b-5483-459f-923c-e25c99bc9954 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:30.468817 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440204b-5483-459f-923c-e25c99bc9954 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:30.471660 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440204b-5483-459f-923c-e25c99bc9954 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:30.517872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-ea4280cb-cdb2-405e-8883-8ee9e7d95b30 None None] MFA Rules not processed for user `6c5865eae95b490b8e421153873457bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:30.521229 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-ea4280cb-cdb2-405e-8883-8ee9e7d95b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:30.594631 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 857/1697] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:17:30 2022] POST /identity/v3/users => generated 303 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:30.600131 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440204b-5483-459f-923c-e25c99bc9954 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:30.636886 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440204b-5483-459f-923c-e25c99bc9954 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:30.658825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4455c8b-c5c1-4292-bed1-f5645d4b094d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:30.663921 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4455c8b-c5c1-4292-bed1-f5645d4b094d admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:30.663921 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4455c8b-c5c1-4292-bed1-f5645d4b094d admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:30.663921 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4455c8b-c5c1-4292-bed1-f5645d4b094d admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:30.663921 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4455c8b-c5c1-4292-bed1-f5645d4b094d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:30.663921 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4455c8b-c5c1-4292-bed1-f5645d4b094d admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:30.697297 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 858/1698] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:30.699679 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4455c8b-c5c1-4292-bed1-f5645d4b094d admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:30.715165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 841/1699] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:17:30.733923 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4455c8b-c5c1-4292-bed1-f5645d4b094d admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:30.734535 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4280cb-cdb2-405e-8883-8ee9e7d95b30 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:30.737026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-ea4280cb-cdb2-405e-8883-8ee9e7d95b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:30.748197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380a3e6-abb9-491c-b55c-6e9f3503d96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:30.749495 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380a3e6-abb9-491c-b55c-6e9f3503d96a admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:30.749792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380a3e6-abb9-491c-b55c-6e9f3503d96a admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:30.750072 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380a3e6-abb9-491c-b55c-6e9f3503d96a admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:30.751746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380a3e6-abb9-491c-b55c-6e9f3503d96a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:30.754650 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380a3e6-abb9-491c-b55c-6e9f3503d96a admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:30.818149 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 859/1700] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:30.826062 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380a3e6-abb9-491c-b55c-6e9f3503d96a admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:30.887879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380a3e6-abb9-491c-b55c-6e9f3503d96a admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:30.909499 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0110972-348d-4d2f-bde0-f8ad97253c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:30.916868 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0110972-348d-4d2f-bde0-f8ad97253c0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:30.938996 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0110972-348d-4d2f-bde0-f8ad97253c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:30.939289 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0110972-348d-4d2f-bde0-f8ad97253c0a admin admin] PATH_INFO: `/v3/projects/8dc2619c2a2a4a4c855fa07b03041440/users/01cba8c3e1374935b03bf3785ef6fb80/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:31.001698 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0110972-348d-4d2f-bde0-f8ad97253c0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc2619c2a2a4a4c855fa07b03041440, user_id=01cba8c3e1374935b03bf3785ef6fb80, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:31.004448 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0110972-348d-4d2f-bde0-f8ad97253c0a admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:31.056219 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4280cb-cdb2-405e-8883-8ee9e7d95b30 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:31.089206 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a17da-433f-4f07-9c16-8f9f4e5d1929 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:31.089871 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a17da-433f-4f07-9c16-8f9f4e5d1929 service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:31.090156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a17da-433f-4f07-9c16-8f9f4e5d1929 service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:31.097778 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a17da-433f-4f07-9c16-8f9f4e5d1929 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:31.119341 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a17da-433f-4f07-9c16-8f9f4e5d1929 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:31.120989 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a17da-433f-4f07-9c16-8f9f4e5d1929 service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:31.147116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 842/1701] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:31.199454 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8bdec-d759-4d46-9890-7251e7a1b87b None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:31.200301 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8bdec-d759-4d46-9890-7251e7a1b87b None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:31.200804 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8bdec-d759-4d46-9890-7251e7a1b87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:31.217839 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 860/1702] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:30 2022] PUT /identity/v3/projects/8dc2619c2a2a4a4c855fa07b03041440/users/01cba8c3e1374935b03bf3785ef6fb80/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:31.306647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-d1e8bdec-d759-4d46-9890-7251e7a1b87b None None] MFA Rules not processed for user `01cba8c3e1374935b03bf3785ef6fb80`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:31.311533 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-d1e8bdec-d759-4d46-9890-7251e7a1b87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:31.709860 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 843/1703] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:31 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 511 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:17:31.714582 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0110972-348d-4d2f-bde0-f8ad97253c0a admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:31.948563 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0110972-348d-4d2f-bde0-f8ad97253c0a admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:31.970114 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450aa956-b98f-4c98-b147-fa02e182e1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:31.971083 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450aa956-b98f-4c98-b147-fa02e182e1ef admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:31.973032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450aa956-b98f-4c98-b147-fa02e182e1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:31.973032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450aa956-b98f-4c98-b147-fa02e182e1ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:31.973032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450aa956-b98f-4c98-b147-fa02e182e1ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:31.974504 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450aa956-b98f-4c98-b147-fa02e182e1ef admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:32.155514 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 861/1704] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:17:31 2022] POST /identity/v3/projects => generated 403 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:32.160427 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8bdec-d759-4d46-9890-7251e7a1b87b None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:32.172386 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8bdec-d759-4d46-9890-7251e7a1b87b None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:32.353033 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e00467-010d-4dd7-82db-84f86f44ddf8 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:32.353858 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e00467-010d-4dd7-82db-84f86f44ddf8 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:32.354276 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e00467-010d-4dd7-82db-84f86f44ddf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:32.360555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64349bcd-6fdc-4d0d-878b-af995e604a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:32.362032 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64349bcd-6fdc-4d0d-878b-af995e604a4f admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:32.362608 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64349bcd-6fdc-4d0d-878b-af995e604a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:32.363089 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64349bcd-6fdc-4d0d-878b-af995e604a4f admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:32.363940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64349bcd-6fdc-4d0d-878b-af995e604a4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:32.366251 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64349bcd-6fdc-4d0d-878b-af995e604a4f admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:32.425440 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-67e00467-010d-4dd7-82db-84f86f44ddf8 None None] MFA Rules not processed for user `256afdbdf6c240af87478fe03996f5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:32.436594 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-67e00467-010d-4dd7-82db-84f86f44ddf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:32.510220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 844/1705] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:17:32 2022] POST /identity/v3/users => generated 308 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:17:32.513747 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64349bcd-6fdc-4d0d-878b-af995e604a4f admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:32.543994 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64349bcd-6fdc-4d0d-878b-af995e604a4f admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:32.557178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff122f-47b3-4dec-ac27-226f3166f86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:32.559095 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff122f-47b3-4dec-ac27-226f3166f86a admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:32.560122 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff122f-47b3-4dec-ac27-226f3166f86a admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:32.560869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff122f-47b3-4dec-ac27-226f3166f86a admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:32.563041 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff122f-47b3-4dec-ac27-226f3166f86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:32.566129 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff122f-47b3-4dec-ac27-226f3166f86a admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:32.627866 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:32.632728 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 845/1706] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:32.648425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff122f-47b3-4dec-ac27-226f3166f86a admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:32.704570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 862/1707] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:32.713606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff122f-47b3-4dec-ac27-226f3166f86a admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:32.714197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ace975-1a8b-4fe9-ba1d-7d480c5cfc88 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:32.714607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ace975-1a8b-4fe9-ba1d-7d480c5cfc88 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:32.714978 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ace975-1a8b-4fe9-ba1d-7d480c5cfc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:32.737668 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500841cb-305d-43e9-b570-4cbbe2a9eed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:32.738433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500841cb-305d-43e9-b570-4cbbe2a9eed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:32.738722 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500841cb-305d-43e9-b570-4cbbe2a9eed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:32.739009 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500841cb-305d-43e9-b570-4cbbe2a9eed1 admin admin] PATH_INFO: `/v3/projects/93562e66a0314198bf469a5740869a69/users/a8ee555dd2dd47cfbba6f470e5145e31/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:32.781140 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-96ace975-1a8b-4fe9-ba1d-7d480c5cfc88 None None] MFA Rules not processed for user `256afdbdf6c240af87478fe03996f5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:32.797083 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-96ace975-1a8b-4fe9-ba1d-7d480c5cfc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:32.799221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500841cb-305d-43e9-b570-4cbbe2a9eed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93562e66a0314198bf469a5740869a69, user_id=a8ee555dd2dd47cfbba6f470e5145e31, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:32.818560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500841cb-305d-43e9-b570-4cbbe2a9eed1 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:32.822237 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 863/1708] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:17:32.833318 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ace975-1a8b-4fe9-ba1d-7d480c5cfc88 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:32.834718 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-96ace975-1a8b-4fe9-ba1d-7d480c5cfc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:32.926218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 846/1709] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:32 2022] PUT /identity/v3/projects/93562e66a0314198bf469a5740869a69/users/a8ee555dd2dd47cfbba6f470e5145e31/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:17:32.930324 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500841cb-305d-43e9-b570-4cbbe2a9eed1 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:33.049891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:33.135569 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ace975-1a8b-4fe9-ba1d-7d480c5cfc88 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:33.256120 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500841cb-305d-43e9-b570-4cbbe2a9eed1 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:33.289315 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac4c61-bdd4-4857-b8ee-2224982ce5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:33.290177 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac4c61-bdd4-4857-b8ee-2224982ce5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:33.292698 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac4c61-bdd4-4857-b8ee-2224982ce5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:33.293140 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac4c61-bdd4-4857-b8ee-2224982ce5f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:33.294157 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac4c61-bdd4-4857-b8ee-2224982ce5f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:33.297317 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac4c61-bdd4-4857-b8ee-2224982ce5f1 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:33.358726 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 847/1710] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:33.359935 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac4c61-bdd4-4857-b8ee-2224982ce5f1 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:33.401666 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac4c61-bdd4-4857-b8ee-2224982ce5f1 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:33.415857 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036fcb7-9cb1-4dff-ae72-240d5d810db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:33.420948 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036fcb7-9cb1-4dff-ae72-240d5d810db6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:33.421903 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036fcb7-9cb1-4dff-ae72-240d5d810db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:33.425848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036fcb7-9cb1-4dff-ae72-240d5d810db6 admin admin] PATH_INFO: `/v3/projects/93562e66a0314198bf469a5740869a69/users/a8ee555dd2dd47cfbba6f470e5145e31/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:33.432786 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f73c88-2035-4707-b54f-75da1c61d5d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:33.433413 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f73c88-2035-4707-b54f-75da1c61d5d4 service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:33.433663 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036fcb7-9cb1-4dff-ae72-240d5d810db6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93562e66a0314198bf469a5740869a69, user_id=a8ee555dd2dd47cfbba6f470e5145e31, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:33.433855 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f73c88-2035-4707-b54f-75da1c61d5d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:33.434308 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f73c88-2035-4707-b54f-75da1c61d5d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:33.436918 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036fcb7-9cb1-4dff-ae72-240d5d810db6 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:33.470734 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 848/1711] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:33 2022] PUT /identity/v3/projects/93562e66a0314198bf469a5740869a69/users/a8ee555dd2dd47cfbba6f470e5145e31/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:33.483318 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a503f-ad4f-4848-89ca-fc479adcc3a3 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:33.483955 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a503f-ad4f-4848-89ca-fc479adcc3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:33.485118 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a503f-ad4f-4848-89ca-fc479adcc3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:33.583279 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-173a503f-ad4f-4848-89ca-fc479adcc3a3 None None] MFA Rules not processed for user `a8ee555dd2dd47cfbba6f470e5145e31`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:33.589367 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-173a503f-ad4f-4848-89ca-fc479adcc3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:33.607488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f73c88-2035-4707-b54f-75da1c61d5d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:33.612385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f73c88-2035-4707-b54f-75da1c61d5d4 service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:33.632448 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 864/1712] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 800 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:17:33.669459 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9f02a-d60d-4f27-a412-6a392073e583 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:33.672143 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9f02a-d60d-4f27-a412-6a392073e583 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:33.672472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9f02a-d60d-4f27-a412-6a392073e583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:33.788753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-e4c9f02a-d60d-4f27-a412-6a392073e583 None None] MFA Rules not processed for user `174ebadbeec64175bd09beb3e270c573`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:33.791983 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 849/1713] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:33 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:33.797632 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-e4c9f02a-d60d-4f27-a412-6a392073e583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:33.932116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a503f-ad4f-4848-89ca-fc479adcc3a3 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:33.934986 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-173a503f-ad4f-4848-89ca-fc479adcc3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:33.958323 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 865/1714] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:34.106595 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a503f-ad4f-4848-89ca-fc479adcc3a3 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:34.118180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25025098-6683-4271-9158-7f10c0d754ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:34.119105 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25025098-6683-4271-9158-7f10c0d754ff service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:34.119490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25025098-6683-4271-9158-7f10c0d754ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:34.122044 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25025098-6683-4271-9158-7f10c0d754ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:34.143540 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25025098-6683-4271-9158-7f10c0d754ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:34.148596 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25025098-6683-4271-9158-7f10c0d754ff service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:34.173381 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 850/1715] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:33 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:34.369923 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:34.680245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b66cb-7b68-4c81-b137-3953423c7c37 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:34.680759 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b66cb-7b68-4c81-b137-3953423c7c37 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:34.680759 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b66cb-7b68-4c81-b137-3953423c7c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:34.769811 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25025098-6683-4271-9158-7f10c0d754ff service cinder] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:34.782526 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-501b66cb-7b68-4c81-b137-3953423c7c37 None None] MFA Rules not processed for user `970300b51d504a2bbc48158855f02f34`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:34.782526 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-501b66cb-7b68-4c81-b137-3953423c7c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:34.904383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 866/1716] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 23 08:17:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:34.922910 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25025098-6683-4271-9158-7f10c0d754ff service cinder] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:34.928703 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8566e9-3762-454a-a8ad-b0b675c87774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:34.929429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8566e9-3762-454a-a8ad-b0b675c87774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:34.931849 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8566e9-3762-454a-a8ad-b0b675c87774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:34.931849 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8566e9-3762-454a-a8ad-b0b675c87774 admin admin] PATH_INFO: `/v3/users/01cba8c3e1374935b03bf3785ef6fb80` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:34.932600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8566e9-3762-454a-a8ad-b0b675c87774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01cba8c3e1374935b03bf3785ef6fb80)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:34.935277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8566e9-3762-454a-a8ad-b0b675c87774 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:35.231457 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-7a8566e9-3762-454a-a8ad-b0b675c87774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01cba8c3e1374935b03bf3785ef6fb80'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:35.238779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-7a8566e9-3762-454a-a8ad-b0b675c87774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01cba8c3e1374935b03bf3785ef6fb80'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:35.239533 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-7a8566e9-3762-454a-a8ad-b0b675c87774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01cba8c3e1374935b03bf3785ef6fb80'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:35.320046 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:35.369370 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-7a8566e9-3762-454a-a8ad-b0b675c87774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01cba8c3e1374935b03bf3785ef6fb80'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:35.381048 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-7a8566e9-3762-454a-a8ad-b0b675c87774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01cba8c3e1374935b03bf3785ef6fb80'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:35.438679 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b66cb-7b68-4c81-b137-3953423c7c37 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:35.440356 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-501b66cb-7b68-4c81-b137-3953423c7c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:35.449264 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 851/1717] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:17:34 2022] DELETE /identity/v3/users/01cba8c3e1374935b03bf3785ef6fb80 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:35.456361 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab648740-df09-4949-8e15-d2875365289e None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:35.456923 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab648740-df09-4949-8e15-d2875365289e None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:35.457310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab648740-df09-4949-8e15-d2875365289e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:35.525777 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-ab648740-df09-4949-8e15-d2875365289e None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:35.527058 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-ab648740-df09-4949-8e15-d2875365289e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:35.748550 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b66cb-7b68-4c81-b137-3953423c7c37 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:35.812157 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 852/1718] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:35.824847 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab648740-df09-4949-8e15-d2875365289e None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:35.828895 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-ab648740-df09-4949-8e15-d2875365289e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:35.847660 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d696909-1888-4731-b55d-de8cdc2b32cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4718cad0c0b9461d9c4152d7ea4b385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:35.848847 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d696909-1888-4731-b55d-de8cdc2b32cc service swift] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:35.849140 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d696909-1888-4731-b55d-de8cdc2b32cc service swift] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:35.849552 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d696909-1888-4731-b55d-de8cdc2b32cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:35.852728 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-0d696909-1888-4731-b55d-de8cdc2b32cc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:36.029672 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d696909-1888-4731-b55d-de8cdc2b32cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:36.032267 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d696909-1888-4731-b55d-de8cdc2b32cc service swift] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:36.057514 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab648740-df09-4949-8e15-d2875365289e None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:36.071073 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 867/1719] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 23 08:17:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 08:17:36.107710 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c9778-76ad-4444-aa8d-cb76805a1900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:36.118014 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c9778-76ad-4444-aa8d-cb76805a1900 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:36.123763 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c9778-76ad-4444-aa8d-cb76805a1900 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:36.123763 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c9778-76ad-4444-aa8d-cb76805a1900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:36.139467 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e0193-e92e-493f-8536-d08bc92ed4b9 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:36.145665 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e0193-e92e-493f-8536-d08bc92ed4b9 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:36.145665 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e0193-e92e-493f-8536-d08bc92ed4b9 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:36.173599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 868/1720] 10.222.0.57 () {54 vars in 912 bytes} [Tue Aug 23 08:17:36 2022] GET /identity => generated 270 bytes in 30 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:17:36.175806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5caf958-0abf-4e46-9ab4-7bb6a40cb3c4 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:36.176734 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5caf958-0abf-4e46-9ab4-7bb6a40cb3c4 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:36.177819 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5caf958-0abf-4e46-9ab4-7bb6a40cb3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:36.196158 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c9778-76ad-4444-aa8d-cb76805a1900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:36.197715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c9778-76ad-4444-aa8d-cb76805a1900 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:36.249735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 853/1721] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:17:36.258818 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-b5caf958-0abf-4e46-9ab4-7bb6a40cb3c4 None None] MFA Rules not processed for user `4239cee14f954e95b4a6b0af2e8799b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:36.261968 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-b5caf958-0abf-4e46-9ab4-7bb6a40cb3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:36.286841 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 869/1722] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 23 08:17:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:36.294378 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c9778-76ad-4444-aa8d-cb76805a1900 service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:36.296622 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-e01c9778-76ad-4444-aa8d-cb76805a1900 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:36.310358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c9778-76ad-4444-aa8d-cb76805a1900 service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:36.315777 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96d72e-4be7-4a8b-b4c3-e892e63b140e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:36.316774 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96d72e-4be7-4a8b-b4c3-e892e63b140e service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:36.317275 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96d72e-4be7-4a8b-b4c3-e892e63b140e service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:36.317803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96d72e-4be7-4a8b-b4c3-e892e63b140e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:36.328205 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96d72e-4be7-4a8b-b4c3-e892e63b140e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:36.331765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96d72e-4be7-4a8b-b4c3-e892e63b140e service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:36.343463 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 854/1723] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:36.427917 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:37.591968 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5caf958-0abf-4e46-9ab4-7bb6a40cb3c4 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:37.594448 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-b5caf958-0abf-4e46-9ab4-7bb6a40cb3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:37.611852 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5caf958-0abf-4e46-9ab4-7bb6a40cb3c4 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:37.617052 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54334f76-b01a-451f-81d6-da398ae63de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:37.617920 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54334f76-b01a-451f-81d6-da398ae63de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:37.618462 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54334f76-b01a-451f-81d6-da398ae63de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:37.618876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54334f76-b01a-451f-81d6-da398ae63de0 admin admin] PATH_INFO: `/v3/projects/8dc2619c2a2a4a4c855fa07b03041440` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:37.620197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54334f76-b01a-451f-81d6-da398ae63de0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dc2619c2a2a4a4c855fa07b03041440)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:37.622321 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54334f76-b01a-451f-81d6-da398ae63de0 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:38.012343 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-54334f76-b01a-451f-81d6-da398ae63de0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dc2619c2a2a4a4c855fa07b03041440', 'request_id': 'req-54334f76-b01a-451f-81d6-da398ae63de0'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:38.093593 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-54334f76-b01a-451f-81d6-da398ae63de0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dc2619c2a2a4a4c855fa07b03041440', 'request_id': 'req-54334f76-b01a-451f-81d6-da398ae63de0'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:38.093593 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-54334f76-b01a-451f-81d6-da398ae63de0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dc2619c2a2a4a4c855fa07b03041440', 'request_id': 'req-54334f76-b01a-451f-81d6-da398ae63de0'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:38.530638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:38.541800 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-54334f76-b01a-451f-81d6-da398ae63de0 admin admin] The token cache is being invalidate because project 8dc2619c2a2a4a4c855fa07b03041440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:17:38.541800 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-54334f76-b01a-451f-81d6-da398ae63de0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:38.541800 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-54334f76-b01a-451f-81d6-da398ae63de0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:38.544243 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 870/1724] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:17:37 2022] DELETE /identity/v3/projects/8dc2619c2a2a4a4c855fa07b03041440 => generated 0 bytes in 953 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:38.548432 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96d72e-4be7-4a8b-b4c3-e892e63b140e service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:38.601317 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96d72e-4be7-4a8b-b4c3-e892e63b140e service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:38.630191 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4fc9a-e9af-40cc-beea-9425eb5ec63d None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:38.631215 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4fc9a-e9af-40cc-beea-9425eb5ec63d None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:38.631716 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4fc9a-e9af-40cc-beea-9425eb5ec63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:38.693918 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-d9e4fc9a-e9af-40cc-beea-9425eb5ec63d None None] MFA Rules not processed for user `4239cee14f954e95b4a6b0af2e8799b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:38.699366 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-d9e4fc9a-e9af-40cc-beea-9425eb5ec63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:38.731772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:38.835725 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2378316-f3f3-4aa9-afea-3d6411c59442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:38.836676 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2378316-f3f3-4aa9-afea-3d6411c59442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:38.837132 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2378316-f3f3-4aa9-afea-3d6411c59442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:38.837582 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2378316-f3f3-4aa9-afea-3d6411c59442 admin admin] PATH_INFO: `/v3/users/a8ee555dd2dd47cfbba6f470e5145e31` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:38.839218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2378316-f3f3-4aa9-afea-3d6411c59442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8ee555dd2dd47cfbba6f470e5145e31)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:38.841551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2378316-f3f3-4aa9-afea-3d6411c59442 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:38.938671 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 871/1725] 10.222.0.40 () {58 vars in 1015 bytes} [Tue Aug 23 08:17:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:17:38.988809 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4fc9a-e9af-40cc-beea-9425eb5ec63d None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:38.990329 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-d9e4fc9a-e9af-40cc-beea-9425eb5ec63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:39.007832 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4fc9a-e9af-40cc-beea-9425eb5ec63d None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:39.035335 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415f3f7-5060-4f6c-a13f-3b90231b542f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:39.035984 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415f3f7-5060-4f6c-a13f-3b90231b542f service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:39.036269 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415f3f7-5060-4f6c-a13f-3b90231b542f service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:39.036566 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415f3f7-5060-4f6c-a13f-3b90231b542f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:39.104672 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415f3f7-5060-4f6c-a13f-3b90231b542f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:39.107570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415f3f7-5060-4f6c-a13f-3b90231b542f service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:39.188136 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 872/1726] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:39.397809 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-d2378316-f3f3-4aa9-afea-3d6411c59442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8ee555dd2dd47cfbba6f470e5145e31'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:39.399454 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-d2378316-f3f3-4aa9-afea-3d6411c59442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8ee555dd2dd47cfbba6f470e5145e31'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:39.401728 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-d2378316-f3f3-4aa9-afea-3d6411c59442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8ee555dd2dd47cfbba6f470e5145e31'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:39.497590 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415f3f7-5060-4f6c-a13f-3b90231b542f service neutron] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:39.499937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-1415f3f7-5060-4f6c-a13f-3b90231b542f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:39.533213 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415f3f7-5060-4f6c-a13f-3b90231b542f service neutron] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:39.548303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab1470-e6e5-4a9a-89af-f3bc8912be2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:39.550513 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab1470-e6e5-4a9a-89af-f3bc8912be2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:39.556934 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab1470-e6e5-4a9a-89af-f3bc8912be2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:39.556934 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab1470-e6e5-4a9a-89af-f3bc8912be2b admin admin] PATH_INFO: `/v3/users/92d7532e27534c1a9edbb9a1e39a5b12` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:39.556934 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab1470-e6e5-4a9a-89af-f3bc8912be2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=92d7532e27534c1a9edbb9a1e39a5b12)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:39.556934 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab1470-e6e5-4a9a-89af-f3bc8912be2b admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:39.587371 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-d2378316-f3f3-4aa9-afea-3d6411c59442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8ee555dd2dd47cfbba6f470e5145e31'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:39.610705 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-d2378316-f3f3-4aa9-afea-3d6411c59442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8ee555dd2dd47cfbba6f470e5145e31'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:39.783054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 855/1727] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:17:38 2022] DELETE /identity/v3/users/a8ee555dd2dd47cfbba6f470e5145e31 => generated 0 bytes in 1235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:17:39.902808 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-15ab1470-e6e5-4a9a-89af-f3bc8912be2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92d7532e27534c1a9edbb9a1e39a5b12'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:39.906554 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-15ab1470-e6e5-4a9a-89af-f3bc8912be2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92d7532e27534c1a9edbb9a1e39a5b12'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:39.907882 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-15ab1470-e6e5-4a9a-89af-f3bc8912be2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92d7532e27534c1a9edbb9a1e39a5b12'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:39.999030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-15ab1470-e6e5-4a9a-89af-f3bc8912be2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92d7532e27534c1a9edbb9a1e39a5b12'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:40.065505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-15ab1470-e6e5-4a9a-89af-f3bc8912be2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92d7532e27534c1a9edbb9a1e39a5b12'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:40.118645 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 873/1728] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:17:39 2022] DELETE /identity/v3/users/92d7532e27534c1a9edbb9a1e39a5b12 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:40.119673 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e11ab-06e3-486f-8347-06f2c44c3109 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:40.120104 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e11ab-06e3-486f-8347-06f2c44c3109 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:40.120546 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e11ab-06e3-486f-8347-06f2c44c3109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:40.209223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-a97e11ab-06e3-486f-8347-06f2c44c3109 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:40.214845 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a97e11ab-06e3-486f-8347-06f2c44c3109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:40.379560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 856/1729] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:17:40.399895 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab1470-e6e5-4a9a-89af-f3bc8912be2b admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:40.401459 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-15ab1470-e6e5-4a9a-89af-f3bc8912be2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:40.595452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab1470-e6e5-4a9a-89af-f3bc8912be2b admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:40.607551 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60685fc8-241d-422d-a998-a38c92117316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:40.610351 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60685fc8-241d-422d-a998-a38c92117316 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:40.619637 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60685fc8-241d-422d-a998-a38c92117316 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:40.619637 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60685fc8-241d-422d-a998-a38c92117316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:40.627191 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60685fc8-241d-422d-a998-a38c92117316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:40.629992 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60685fc8-241d-422d-a998-a38c92117316 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:40.644149 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 874/1730] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:41.179243 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1433504-fa50-4856-81d5-1a8f8b527a87 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:41.180938 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1433504-fa50-4856-81d5-1a8f8b527a87 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:41.181370 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1433504-fa50-4856-81d5-1a8f8b527a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:41.261661 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-a1433504-fa50-4856-81d5-1a8f8b527a87 None None] MFA Rules not processed for user `6c5865eae95b490b8e421153873457bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:41.290512 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a1433504-fa50-4856-81d5-1a8f8b527a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:41.523647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:41.553434 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 857/1731] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:42.137597 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60685fc8-241d-422d-a998-a38c92117316 service neutron] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:42.141261 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-60685fc8-241d-422d-a998-a38c92117316 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:42.194116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60685fc8-241d-422d-a998-a38c92117316 service neutron] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:42.211792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22572e-f8cc-4d32-a0e7-41a483dcfd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:42.213769 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22572e-f8cc-4d32-a0e7-41a483dcfd1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:42.214071 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22572e-f8cc-4d32-a0e7-41a483dcfd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:42.214378 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22572e-f8cc-4d32-a0e7-41a483dcfd1f admin admin] PATH_INFO: `/v3/projects/93562e66a0314198bf469a5740869a69` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:42.215877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22572e-f8cc-4d32-a0e7-41a483dcfd1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=93562e66a0314198bf469a5740869a69)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:42.218000 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22572e-f8cc-4d32-a0e7-41a483dcfd1f admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:42.476468 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9f22572e-f8cc-4d32-a0e7-41a483dcfd1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93562e66a0314198bf469a5740869a69', 'request_id': 'req-9f22572e-f8cc-4d32-a0e7-41a483dcfd1f'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:42.516568 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9f22572e-f8cc-4d32-a0e7-41a483dcfd1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93562e66a0314198bf469a5740869a69', 'request_id': 'req-9f22572e-f8cc-4d32-a0e7-41a483dcfd1f'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:42.535716 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9f22572e-f8cc-4d32-a0e7-41a483dcfd1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93562e66a0314198bf469a5740869a69', 'request_id': 'req-9f22572e-f8cc-4d32-a0e7-41a483dcfd1f'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:42.630191 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9f22572e-f8cc-4d32-a0e7-41a483dcfd1f admin admin] The token cache is being invalidate because project 93562e66a0314198bf469a5740869a69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:17:42.630541 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9f22572e-f8cc-4d32-a0e7-41a483dcfd1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:42.633147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9f22572e-f8cc-4d32-a0e7-41a483dcfd1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:42.635380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 875/1732] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:17:42 2022] DELETE /identity/v3/projects/93562e66a0314198bf469a5740869a69 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:42.642895 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71e824-66ee-452c-a8da-4398bc451eab None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:42.644783 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71e824-66ee-452c-a8da-4398bc451eab None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:42.645454 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71e824-66ee-452c-a8da-4398bc451eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:42.700676 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-6e71e824-66ee-452c-a8da-4398bc451eab None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:42.702594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-6e71e824-66ee-452c-a8da-4398bc451eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:42.851248 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:42.927290 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 858/1733] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:42.935383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1a5f9-4b90-4768-836b-bca5a8b4e9bd None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:42.935672 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1a5f9-4b90-4768-836b-bca5a8b4e9bd None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:42.936109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1a5f9-4b90-4768-836b-bca5a8b4e9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:43.017045 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-6dd1a5f9-4b90-4768-836b-bca5a8b4e9bd None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:43.017045 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-6dd1a5f9-4b90-4768-836b-bca5a8b4e9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:43.059711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 876/1734] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:43.064175 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71e824-66ee-452c-a8da-4398bc451eab None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:43.077060 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71e824-66ee-452c-a8da-4398bc451eab None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:43.121631 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66755e1f-e17d-47b0-a462-7bd3d6c62b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:43.125947 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66755e1f-e17d-47b0-a462-7bd3d6c62b6a admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:43.126484 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66755e1f-e17d-47b0-a462-7bd3d6c62b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:43.127339 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66755e1f-e17d-47b0-a462-7bd3d6c62b6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:43.128403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66755e1f-e17d-47b0-a462-7bd3d6c62b6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:17:43.128944 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66755e1f-e17d-47b0-a462-7bd3d6c62b6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:43.131347 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66755e1f-e17d-47b0-a462-7bd3d6c62b6a admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:43.170167 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60401a-7e94-4c82-80e8-3e34fbc7f2d6 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:43.171370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60401a-7e94-4c82-80e8-3e34fbc7f2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:43.171792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60401a-7e94-4c82-80e8-3e34fbc7f2d6 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:43.173336 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 877/1735] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 23 08:17:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:17:43.191030 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 859/1736] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 08:17:43.194590 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60401a-7e94-4c82-80e8-3e34fbc7f2d6 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:43.228779 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60401a-7e94-4c82-80e8-3e34fbc7f2d6 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:43.240340 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66755e1f-e17d-47b0-a462-7bd3d6c62b6a admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:43.242135 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-66755e1f-e17d-47b0-a462-7bd3d6c62b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:43.255461 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44807e-ffca-471f-bef6-0719ad29c92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:43.256409 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44807e-ffca-471f-bef6-0719ad29c92a admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:43.257702 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44807e-ffca-471f-bef6-0719ad29c92a admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:43.259435 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44807e-ffca-471f-bef6-0719ad29c92a admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:43.260355 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44807e-ffca-471f-bef6-0719ad29c92a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:43.265465 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44807e-ffca-471f-bef6-0719ad29c92a admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:43.288009 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66755e1f-e17d-47b0-a462-7bd3d6c62b6a admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:43.304259 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a97d6-ba8d-47eb-9c02-70d160102ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:43.304945 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a97d6-ba8d-47eb-9c02-70d160102ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:43.305229 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a97d6-ba8d-47eb-9c02-70d160102ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:43.305502 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a97d6-ba8d-47eb-9c02-70d160102ced admin admin] PATH_INFO: `/v3/projects/d716c9235da544abbbf5d1b035a88044` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:43.307501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a97d6-ba8d-47eb-9c02-70d160102ced admin admin] RBAC: Authorizing `identity:delete_project(project_id=d716c9235da544abbbf5d1b035a88044)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:43.310478 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a97d6-ba8d-47eb-9c02-70d160102ced admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:43.538143 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 878/1737] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:17:43 2022] POST /identity/v3/projects => generated 365 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:43.539749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afa12a-c4d4-4058-bc26-70cf57aef46c None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:43.543593 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afa12a-c4d4-4058-bc26-70cf57aef46c None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:43.544735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afa12a-c4d4-4058-bc26-70cf57aef46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:43.560013 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-2e4a97d6-ba8d-47eb-9c02-70d160102ced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd716c9235da544abbbf5d1b035a88044', 'request_id': 'req-2e4a97d6-ba8d-47eb-9c02-70d160102ced'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:43.579258 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-2e4a97d6-ba8d-47eb-9c02-70d160102ced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd716c9235da544abbbf5d1b035a88044', 'request_id': 'req-2e4a97d6-ba8d-47eb-9c02-70d160102ced'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:43.594562 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-2e4a97d6-ba8d-47eb-9c02-70d160102ced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd716c9235da544abbbf5d1b035a88044', 'request_id': 'req-2e4a97d6-ba8d-47eb-9c02-70d160102ced'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:43.623840 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-37afa12a-c4d4-4058-bc26-70cf57aef46c None None] MFA Rules not processed for user `b5c55e5c1cea47f29d378ea457384a31`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:43.634375 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-37afa12a-c4d4-4058-bc26-70cf57aef46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:43.725789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-2e4a97d6-ba8d-47eb-9c02-70d160102ced admin admin] The token cache is being invalidate because project d716c9235da544abbbf5d1b035a88044 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:17:43.726452 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-2e4a97d6-ba8d-47eb-9c02-70d160102ced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:43.727332 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-2e4a97d6-ba8d-47eb-9c02-70d160102ced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:43.732455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 860/1738] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:17:43 2022] DELETE /identity/v3/projects/d716c9235da544abbbf5d1b035a88044 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:17:43.732455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a97d6-ba8d-47eb-9c02-70d160102ced admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:43.735825 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-2e4a97d6-ba8d-47eb-9c02-70d160102ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:43.867441 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 879/1739] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 23 08:17:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:43.870220 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afa12a-c4d4-4058-bc26-70cf57aef46c None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:43.872299 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-37afa12a-c4d4-4058-bc26-70cf57aef46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:43.945702 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a97d6-ba8d-47eb-9c02-70d160102ced admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:43.961100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:44.104882 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afa12a-c4d4-4058-bc26-70cf57aef46c None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:44.127158 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5971cc-8def-4359-afac-e977a60b22d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:44.127158 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5971cc-8def-4359-afac-e977a60b22d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:44.127453 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace21cb9-b961-4827-8d7f-70cc1b7dc725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:44.127453 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace21cb9-b961-4827-8d7f-70cc1b7dc725 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:44.127453 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace21cb9-b961-4827-8d7f-70cc1b7dc725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:44.127453 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace21cb9-b961-4827-8d7f-70cc1b7dc725 admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:44.130642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace21cb9-b961-4827-8d7f-70cc1b7dc725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:44.130784 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5971cc-8def-4359-afac-e977a60b22d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:44.131063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5971cc-8def-4359-afac-e977a60b22d7 admin admin] PATH_INFO: `/v3/users/250d4f931e364d4a94518dbfe0af68f2` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:44.132748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace21cb9-b961-4827-8d7f-70cc1b7dc725 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:44.137694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5971cc-8def-4359-afac-e977a60b22d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=250d4f931e364d4a94518dbfe0af68f2)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:44.151332 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5971cc-8def-4359-afac-e977a60b22d7 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:44.299169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 861/1740] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:17:43 2022] POST /identity/v3/users => generated 283 bytes in 569 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:44.300368 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace21cb9-b961-4827-8d7f-70cc1b7dc725 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:44.336560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace21cb9-b961-4827-8d7f-70cc1b7dc725 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:44.392943 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc996a2-c98a-4a14-b3a0-2da2ff52060b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:44.394671 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc996a2-c98a-4a14-b3a0-2da2ff52060b admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:44.395161 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc996a2-c98a-4a14-b3a0-2da2ff52060b admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:44.395566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc996a2-c98a-4a14-b3a0-2da2ff52060b admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:44.396310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc996a2-c98a-4a14-b3a0-2da2ff52060b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:44.398033 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc996a2-c98a-4a14-b3a0-2da2ff52060b admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:44.423066 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 862/1741] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:44.427536 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc996a2-c98a-4a14-b3a0-2da2ff52060b admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:44.469470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc996a2-c98a-4a14-b3a0-2da2ff52060b admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:44.489215 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a926a4-e64e-4a25-b850-73b5f3d84ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:44.490787 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a926a4-e64e-4a25-b850-73b5f3d84ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:44.490787 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a926a4-e64e-4a25-b850-73b5f3d84ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:44.490787 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a926a4-e64e-4a25-b850-73b5f3d84ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:44.499350 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a926a4-e64e-4a25-b850-73b5f3d84ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:44.503153 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a926a4-e64e-4a25-b850-73b5f3d84ae8 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:44.559062 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 863/1742] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:44.571154 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a926a4-e64e-4a25-b850-73b5f3d84ae8 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:44.592044 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-ac5971cc-8def-4359-afac-e977a60b22d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '250d4f931e364d4a94518dbfe0af68f2'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:44.593621 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-ac5971cc-8def-4359-afac-e977a60b22d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '250d4f931e364d4a94518dbfe0af68f2'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:44.594510 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-ac5971cc-8def-4359-afac-e977a60b22d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '250d4f931e364d4a94518dbfe0af68f2'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:44.628803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a926a4-e64e-4a25-b850-73b5f3d84ae8 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:44.662855 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f431935-ce37-4012-b6fc-08b5189c169f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:44.665426 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f431935-ce37-4012-b6fc-08b5189c169f admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:44.665871 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f431935-ce37-4012-b6fc-08b5189c169f admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:44.666158 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f431935-ce37-4012-b6fc-08b5189c169f admin admin] PATH_INFO: `/v3/projects/6b01639cd55a4cb9b907a50ee947c6df/users/a09c0f1acfee4ced91c2df5db14ee5fb/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:44.717984 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f431935-ce37-4012-b6fc-08b5189c169f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b01639cd55a4cb9b907a50ee947c6df, user_id=a09c0f1acfee4ced91c2df5db14ee5fb, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:44.721119 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f431935-ce37-4012-b6fc-08b5189c169f admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:44.724776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-ac5971cc-8def-4359-afac-e977a60b22d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '250d4f931e364d4a94518dbfe0af68f2'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:44.752208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-ac5971cc-8def-4359-afac-e977a60b22d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '250d4f931e364d4a94518dbfe0af68f2'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:44.784554 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 880/1743] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:17:43 2022] DELETE /identity/v3/users/250d4f931e364d4a94518dbfe0af68f2 => generated 0 bytes in 913 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:44.789315 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c7ae1-debd-4364-a0c8-2d4314e875ec None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:44.793556 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c7ae1-debd-4364-a0c8-2d4314e875ec None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:44.794394 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c7ae1-debd-4364-a0c8-2d4314e875ec None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:44.797547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 881/1744] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 23 08:17:44 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:17:44.870394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 864/1745] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:44 2022] PUT /identity/v3/projects/6b01639cd55a4cb9b907a50ee947c6df/users/a09c0f1acfee4ced91c2df5db14ee5fb/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:44.873253 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad138f5-e6d1-4471-9c20-c29551997356 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:44.873725 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad138f5-e6d1-4471-9c20-c29551997356 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:44.874261 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad138f5-e6d1-4471-9c20-c29551997356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:44.886348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b3835-9f2d-45a7-8c2d-43a91eb484fd None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:44.888181 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b3835-9f2d-45a7-8c2d-43a91eb484fd None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:44.888610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b3835-9f2d-45a7-8c2d-43a91eb484fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:44.959981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-3ad138f5-e6d1-4471-9c20-c29551997356 None None] MFA Rules not processed for user `b5c55e5c1cea47f29d378ea457384a31`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:44.966442 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-3ad138f5-e6d1-4471-9c20-c29551997356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:45.044975 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-4e0b3835-9f2d-45a7-8c2d-43a91eb484fd None None] MFA Rules not processed for user `a09c0f1acfee4ced91c2df5db14ee5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:45.053290 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-4e0b3835-9f2d-45a7-8c2d-43a91eb484fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:45.252441 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 882/1746] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 23 08:17:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:45.376125 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad138f5-e6d1-4471-9c20-c29551997356 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:45.380785 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-3ad138f5-e6d1-4471-9c20-c29551997356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:45.383828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 865/1747] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 498 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:45.458644 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b3835-9f2d-45a7-8c2d-43a91eb484fd None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:45.460673 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-4e0b3835-9f2d-45a7-8c2d-43a91eb484fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:45.500796 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b3835-9f2d-45a7-8c2d-43a91eb484fd None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:45.524820 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27b944-a54f-4804-8a5a-2370abc74947 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:45.525756 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27b944-a54f-4804-8a5a-2370abc74947 service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:45.525756 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27b944-a54f-4804-8a5a-2370abc74947 service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:45.526161 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27b944-a54f-4804-8a5a-2370abc74947 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:45.531516 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-9d27b944-a54f-4804-8a5a-2370abc74947 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:45.575828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27b944-a54f-4804-8a5a-2370abc74947 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:45.582953 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27b944-a54f-4804-8a5a-2370abc74947 service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:45.607767 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad138f5-e6d1-4471-9c20-c29551997356 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:45.623350 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f225dc-2666-40e6-a8e0-b8f54314ee79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:45.624259 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f225dc-2666-40e6-a8e0-b8f54314ee79 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:45.624703 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f225dc-2666-40e6-a8e0-b8f54314ee79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:45.625171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f225dc-2666-40e6-a8e0-b8f54314ee79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:45.625942 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f225dc-2666-40e6-a8e0-b8f54314ee79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:45.628060 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f225dc-2666-40e6-a8e0-b8f54314ee79 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:45.638913 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 866/1748] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:17:45.776746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 883/1749] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:17:45 2022] POST /identity/v3/projects => generated 365 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:45.779814 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27b944-a54f-4804-8a5a-2370abc74947 service nova] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:45.804894 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27b944-a54f-4804-8a5a-2370abc74947 service nova] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:46.033752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f225dc-2666-40e6-a8e0-b8f54314ee79 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:46.036484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-50f225dc-2666-40e6-a8e0-b8f54314ee79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:46.058911 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfc2f9-ef5b-410c-ab7e-e6d8f2734b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:46.061257 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfc2f9-ef5b-410c-ab7e-e6d8f2734b90 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:46.072345 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfc2f9-ef5b-410c-ab7e-e6d8f2734b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:46.072345 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfc2f9-ef5b-410c-ab7e-e6d8f2734b90 admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:46.072345 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfc2f9-ef5b-410c-ab7e-e6d8f2734b90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:46.072345 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfc2f9-ef5b-410c-ab7e-e6d8f2734b90 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:46.104867 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f225dc-2666-40e6-a8e0-b8f54314ee79 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:46.116224 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc376bed-595b-4ee2-8579-8dca15927764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:46.117313 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc376bed-595b-4ee2-8579-8dca15927764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:46.117862 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc376bed-595b-4ee2-8579-8dca15927764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:46.118468 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc376bed-595b-4ee2-8579-8dca15927764 admin admin] PATH_INFO: `/v3/users/20fa4aecb1f54543876f02afbef57280` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:46.120061 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc376bed-595b-4ee2-8579-8dca15927764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20fa4aecb1f54543876f02afbef57280)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:46.124249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc376bed-595b-4ee2-8579-8dca15927764 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:46.181412 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:46.216358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 867/1750] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:17:45 2022] POST /identity/v3/users => generated 289 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:46.220945 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfc2f9-ef5b-410c-ab7e-e6d8f2734b90 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:46.247168 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfc2f9-ef5b-410c-ab7e-e6d8f2734b90 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:46.263085 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593ec99-8570-4b1c-9d17-4362feb9e77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:46.264128 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593ec99-8570-4b1c-9d17-4362feb9e77d admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:46.264746 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593ec99-8570-4b1c-9d17-4362feb9e77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:46.265301 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593ec99-8570-4b1c-9d17-4362feb9e77d admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:46.266475 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593ec99-8570-4b1c-9d17-4362feb9e77d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:46.268511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593ec99-8570-4b1c-9d17-4362feb9e77d admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:46.284131 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 868/1751] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:46.288544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593ec99-8570-4b1c-9d17-4362feb9e77d admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:46.318185 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593ec99-8570-4b1c-9d17-4362feb9e77d admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:46.336854 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4bcaa5-21f0-49c2-b184-4101c53db341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:46.340501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bcaa5-21f0-49c2-b184-4101c53db341 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:46.340501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bcaa5-21f0-49c2-b184-4101c53db341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:46.340501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bcaa5-21f0-49c2-b184-4101c53db341 admin admin] PATH_INFO: `/v3/projects/7b88c0a76a904dbe9b261b7786869be5/users/63d5756d22d94abba55389b461f813d0/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:46.382898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4bcaa5-21f0-49c2-b184-4101c53db341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b88c0a76a904dbe9b261b7786869be5, user_id=63d5756d22d94abba55389b461f813d0, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:46.387943 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4bcaa5-21f0-49c2-b184-4101c53db341 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:46.497098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-bc376bed-595b-4ee2-8579-8dca15927764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20fa4aecb1f54543876f02afbef57280'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:46.498051 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-bc376bed-595b-4ee2-8579-8dca15927764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20fa4aecb1f54543876f02afbef57280'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:46.499032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-bc376bed-595b-4ee2-8579-8dca15927764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20fa4aecb1f54543876f02afbef57280'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:46.563832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 869/1752] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:46 2022] PUT /identity/v3/projects/7b88c0a76a904dbe9b261b7786869be5/users/63d5756d22d94abba55389b461f813d0/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:46.570529 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4bcaa5-21f0-49c2-b184-4101c53db341 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:46.573856 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-8c4bcaa5-21f0-49c2-b184-4101c53db341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:46.623121 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-bc376bed-595b-4ee2-8579-8dca15927764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20fa4aecb1f54543876f02afbef57280'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:46.665501 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-bc376bed-595b-4ee2-8579-8dca15927764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20fa4aecb1f54543876f02afbef57280'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:46.705581 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 884/1753] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:17:46 2022] DELETE /identity/v3/users/20fa4aecb1f54543876f02afbef57280 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:46.716301 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c092c34-c266-4a7d-84e5-8cc12c9676d8 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:46.716545 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c092c34-c266-4a7d-84e5-8cc12c9676d8 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:46.717045 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c092c34-c266-4a7d-84e5-8cc12c9676d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:46.763729 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4bcaa5-21f0-49c2-b184-4101c53db341 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:46.768336 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-0c092c34-c266-4a7d-84e5-8cc12c9676d8 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:46.769605 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-0c092c34-c266-4a7d-84e5-8cc12c9676d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:46.873034 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:46.944085 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52f129-1a2a-4902-972f-9e0e9b34974f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:46.944728 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52f129-1a2a-4902-972f-9e0e9b34974f admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:46.945030 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52f129-1a2a-4902-972f-9e0e9b34974f admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:46.945330 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52f129-1a2a-4902-972f-9e0e9b34974f admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:46.946005 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af52f129-1a2a-4902-972f-9e0e9b34974f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:46.949410 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af52f129-1a2a-4902-972f-9e0e9b34974f admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:46.967940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 870/1754] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:17:46.968842 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52f129-1a2a-4902-972f-9e0e9b34974f admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:46.976817 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 885/1755] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:46.977756 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c092c34-c266-4a7d-84e5-8cc12c9676d8 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:46.983828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-af52f129-1a2a-4902-972f-9e0e9b34974f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:47.001037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c092c34-c266-4a7d-84e5-8cc12c9676d8 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:47.035793 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c7aa0-79b3-43f7-b9f8-d3753faf8e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:47.036919 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c7aa0-79b3-43f7-b9f8-d3753faf8e9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:47.045620 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c7aa0-79b3-43f7-b9f8-d3753faf8e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:47.049435 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c7aa0-79b3-43f7-b9f8-d3753faf8e9b admin admin] PATH_INFO: `/v3/projects/7b88c0a76a904dbe9b261b7786869be5/users/63d5756d22d94abba55389b461f813d0/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:47.056528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c7aa0-79b3-43f7-b9f8-d3753faf8e9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b88c0a76a904dbe9b261b7786869be5, user_id=63d5756d22d94abba55389b461f813d0, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:47.059807 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c7aa0-79b3-43f7-b9f8-d3753faf8e9b admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:47.091992 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 886/1756] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:46 2022] PUT /identity/v3/projects/7b88c0a76a904dbe9b261b7786869be5/users/63d5756d22d94abba55389b461f813d0/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:47.093219 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c7aa0-79b3-43f7-b9f8-d3753faf8e9b admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:47.098163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c71c7aa0-79b3-43f7-b9f8-d3753faf8e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:47.235169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52f129-1a2a-4902-972f-9e0e9b34974f admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:47.276809 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c7aa0-79b3-43f7-b9f8-d3753faf8e9b admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:47.291586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef1518-7532-4cdc-b726-0fca4e00532c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:47.292408 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef1518-7532-4cdc-b726-0fca4e00532c service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:47.292801 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef1518-7532-4cdc-b726-0fca4e00532c service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:47.293182 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef1518-7532-4cdc-b726-0fca4e00532c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:47.370481 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe61af-dc06-480f-8a6a-c448f663c7cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:47.371429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe61af-dc06-480f-8a6a-c448f663c7cc service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:47.371906 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe61af-dc06-480f-8a6a-c448f663c7cc service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:47.373071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe61af-dc06-480f-8a6a-c448f663c7cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:47.379714 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-8efe61af-dc06-480f-8a6a-c448f663c7cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:47.426181 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe61af-dc06-480f-8a6a-c448f663c7cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:47.433588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe61af-dc06-480f-8a6a-c448f663c7cc service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:47.461517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 871/1757] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:47.463411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246bac6-baf3-4f60-ac82-ac0ad7eaee0d None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:47.465936 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246bac6-baf3-4f60-ac82-ac0ad7eaee0d None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:47.466570 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246bac6-baf3-4f60-ac82-ac0ad7eaee0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:47.547391 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-9246bac6-baf3-4f60-ac82-ac0ad7eaee0d None None] MFA Rules not processed for user `63d5756d22d94abba55389b461f813d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:47.555588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-9246bac6-baf3-4f60-ac82-ac0ad7eaee0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:47.575591 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef1518-7532-4cdc-b726-0fca4e00532c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:47.580769 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef1518-7532-4cdc-b726-0fca4e00532c service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:47.611821 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 887/1758] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:47.777830 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 872/1759] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:47.834441 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef1518-7532-4cdc-b726-0fca4e00532c service neutron] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:47.840251 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-85ef1518-7532-4cdc-b726-0fca4e00532c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:48.094713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef1518-7532-4cdc-b726-0fca4e00532c service neutron] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:48.100247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0b4d2-a8a4-4098-91ca-9e0dc5a6f299 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:48.100937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0b4d2-a8a4-4098-91ca-9e0dc5a6f299 service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:48.101490 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0b4d2-a8a4-4098-91ca-9e0dc5a6f299 service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:48.101918 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0b4d2-a8a4-4098-91ca-9e0dc5a6f299 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:48.119245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0b4d2-a8a4-4098-91ca-9e0dc5a6f299 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:48.121493 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0b4d2-a8a4-4098-91ca-9e0dc5a6f299 service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:48.161891 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 888/1760] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:48.182991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246bac6-baf3-4f60-ac82-ac0ad7eaee0d None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:48.185294 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-9246bac6-baf3-4f60-ac82-ac0ad7eaee0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:48.211614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246bac6-baf3-4f60-ac82-ac0ad7eaee0d None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:48.232742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb845ab-c2eb-4a91-b2e2-15fb7cc27042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:48.233807 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb845ab-c2eb-4a91-b2e2-15fb7cc27042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:48.233898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb845ab-c2eb-4a91-b2e2-15fb7cc27042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:48.234241 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb845ab-c2eb-4a91-b2e2-15fb7cc27042 admin admin] PATH_INFO: `/v3/users/74c90664f7c2403083a459748d97275d` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:48.235974 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb845ab-c2eb-4a91-b2e2-15fb7cc27042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74c90664f7c2403083a459748d97275d)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:48.239479 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb845ab-c2eb-4a91-b2e2-15fb7cc27042 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:48.489510 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0b4d2-a8a4-4098-91ca-9e0dc5a6f299 service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:48.502349 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0b4d2-a8a4-4098-91ca-9e0dc5a6f299 service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:48.513182 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f09254-382e-4e5a-836a-b6a0e2536135 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:48.516032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f09254-382e-4e5a-836a-b6a0e2536135 service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:48.516525 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f09254-382e-4e5a-836a-b6a0e2536135 service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:48.516951 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f09254-382e-4e5a-836a-b6a0e2536135 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:48.521472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-e8f09254-382e-4e5a-836a-b6a0e2536135 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:48.593684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-eeb845ab-c2eb-4a91-b2e2-15fb7cc27042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74c90664f7c2403083a459748d97275d'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:48.601144 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-eeb845ab-c2eb-4a91-b2e2-15fb7cc27042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74c90664f7c2403083a459748d97275d'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:48.604876 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-eeb845ab-c2eb-4a91-b2e2-15fb7cc27042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74c90664f7c2403083a459748d97275d'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:48.710733 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f09254-382e-4e5a-836a-b6a0e2536135 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:48.712659 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f09254-382e-4e5a-836a-b6a0e2536135 service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:48.725757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 889/1761] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:48.727017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f09254-382e-4e5a-836a-b6a0e2536135 service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:48.728569 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-e8f09254-382e-4e5a-836a-b6a0e2536135 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:48.753859 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f09254-382e-4e5a-836a-b6a0e2536135 service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:48.762113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62301e-5d56-4983-8522-d61679c51868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:48.763147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62301e-5d56-4983-8522-d61679c51868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:48.763615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62301e-5d56-4983-8522-d61679c51868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:48.764144 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62301e-5d56-4983-8522-d61679c51868 admin admin] PATH_INFO: `/v3/projects/7448931658c34d59bfafb94bd7a0fc7a` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:48.766473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62301e-5d56-4983-8522-d61679c51868 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7448931658c34d59bfafb94bd7a0fc7a)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:48.769979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62301e-5d56-4983-8522-d61679c51868 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:48.777924 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-eeb845ab-c2eb-4a91-b2e2-15fb7cc27042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74c90664f7c2403083a459748d97275d'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:48.788759 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-eeb845ab-c2eb-4a91-b2e2-15fb7cc27042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74c90664f7c2403083a459748d97275d'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:48.822862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 873/1762] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:17:48 2022] DELETE /identity/v3/users/74c90664f7c2403083a459748d97275d => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:48.834075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903baeb-ec8a-46f9-bf19-2c6276caf858 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:48.835200 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903baeb-ec8a-46f9-bf19-2c6276caf858 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:48.835978 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903baeb-ec8a-46f9-bf19-2c6276caf858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:48.870280 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-e903baeb-ec8a-46f9-bf19-2c6276caf858 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:48.872488 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-e903baeb-ec8a-46f9-bf19-2c6276caf858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:49.051691 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 874/1763] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:49.065762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903baeb-ec8a-46f9-bf19-2c6276caf858 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:49.070414 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-e903baeb-ec8a-46f9-bf19-2c6276caf858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:49.145493 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-7a62301e-5d56-4983-8522-d61679c51868 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7448931658c34d59bfafb94bd7a0fc7a', 'request_id': 'req-7a62301e-5d56-4983-8522-d61679c51868'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:49.161852 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-7a62301e-5d56-4983-8522-d61679c51868 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7448931658c34d59bfafb94bd7a0fc7a', 'request_id': 'req-7a62301e-5d56-4983-8522-d61679c51868'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:49.170242 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-7a62301e-5d56-4983-8522-d61679c51868 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7448931658c34d59bfafb94bd7a0fc7a', 'request_id': 'req-7a62301e-5d56-4983-8522-d61679c51868'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:49.226098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903baeb-ec8a-46f9-bf19-2c6276caf858 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:49.337079 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464a2aa-276f-4224-95c7-045c5f1286b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:49.337925 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464a2aa-276f-4224-95c7-045c5f1286b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:49.338414 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464a2aa-276f-4224-95c7-045c5f1286b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:49.338812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464a2aa-276f-4224-95c7-045c5f1286b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:49.508724 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464a2aa-276f-4224-95c7-045c5f1286b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:49.510554 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464a2aa-276f-4224-95c7-045c5f1286b8 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:49.518964 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-7a62301e-5d56-4983-8522-d61679c51868 admin admin] The token cache is being invalidate because project 7448931658c34d59bfafb94bd7a0fc7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:17:49.518964 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-7a62301e-5d56-4983-8522-d61679c51868 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:49.518964 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-7a62301e-5d56-4983-8522-d61679c51868 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:49.518964 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 890/1764] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:17:48 2022] DELETE /identity/v3/projects/7448931658c34d59bfafb94bd7a0fc7a => generated 0 bytes in 789 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:49.518964 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62301e-5d56-4983-8522-d61679c51868 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:49.545000 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-7a62301e-5d56-4983-8522-d61679c51868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:49.554449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 875/1765] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:49.559027 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258c3bb-bd3c-47f2-9087-1475f83f9c72 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:49.559826 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258c3bb-bd3c-47f2-9087-1475f83f9c72 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:49.562408 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258c3bb-bd3c-47f2-9087-1475f83f9c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:49.598205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62301e-5d56-4983-8522-d61679c51868 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:49.606501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-1258c3bb-bd3c-47f2-9087-1475f83f9c72 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:49.606501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-1258c3bb-bd3c-47f2-9087-1475f83f9c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:49.612532 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7d179-268e-4da0-9780-386954d8444a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:49.613194 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7d179-268e-4da0-9780-386954d8444a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:49.613483 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7d179-268e-4da0-9780-386954d8444a admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:49.614408 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7d179-268e-4da0-9780-386954d8444a admin admin] PATH_INFO: `/v3/projects/48e4f0bf4c884513bbae7a74064f7c10` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:49.617660 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7d179-268e-4da0-9780-386954d8444a admin admin] RBAC: Authorizing `identity:delete_project(project_id=48e4f0bf4c884513bbae7a74064f7c10)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:49.621468 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7d179-268e-4da0-9780-386954d8444a admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:49.632076 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 876/1766] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:49.646323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa5f0d-6965-4d77-b914-d50e89b93c09 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:49.646323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa5f0d-6965-4d77-b914-d50e89b93c09 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:49.646323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa5f0d-6965-4d77-b914-d50e89b93c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:49.720301 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-f4aa5f0d-6965-4d77-b914-d50e89b93c09 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:49.721553 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-f4aa5f0d-6965-4d77-b914-d50e89b93c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:49.731636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 877/1767] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:17:49.740417 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa5f0d-6965-4d77-b914-d50e89b93c09 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:49.756593 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa5f0d-6965-4d77-b914-d50e89b93c09 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:49.762577 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a1a27-43cc-4cee-b8ed-9bf6fcb0cd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:49.763500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a1a27-43cc-4cee-b8ed-9bf6fcb0cd4e admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:49.763787 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a1a27-43cc-4cee-b8ed-9bf6fcb0cd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:49.764061 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a1a27-43cc-4cee-b8ed-9bf6fcb0cd4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:49.766184 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a1a27-43cc-4cee-b8ed-9bf6fcb0cd4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:17:49.766727 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a1a27-43cc-4cee-b8ed-9bf6fcb0cd4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:49.769147 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a1a27-43cc-4cee-b8ed-9bf6fcb0cd4e admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:49.802036 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 878/1768] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:17:49.806928 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a1a27-43cc-4cee-b8ed-9bf6fcb0cd4e admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:49.836300 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a1a27-43cc-4cee-b8ed-9bf6fcb0cd4e admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:49.842030 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f124e-e484-44bb-94b3-8e4fc2dd620d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:49.851328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f124e-e484-44bb-94b3-8e4fc2dd620d admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:49.851328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f124e-e484-44bb-94b3-8e4fc2dd620d admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:49.851328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f124e-e484-44bb-94b3-8e4fc2dd620d admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:49.851328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f124e-e484-44bb-94b3-8e4fc2dd620d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:49.851328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f124e-e484-44bb-94b3-8e4fc2dd620d admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:49.923587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-e3b7d179-268e-4da0-9780-386954d8444a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48e4f0bf4c884513bbae7a74064f7c10', 'request_id': 'req-e3b7d179-268e-4da0-9780-386954d8444a'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:49.935894 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-e3b7d179-268e-4da0-9780-386954d8444a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48e4f0bf4c884513bbae7a74064f7c10', 'request_id': 'req-e3b7d179-268e-4da0-9780-386954d8444a'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:49.946087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:49.950189 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-e3b7d179-268e-4da0-9780-386954d8444a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48e4f0bf4c884513bbae7a74064f7c10', 'request_id': 'req-e3b7d179-268e-4da0-9780-386954d8444a'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:50.095219 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 879/1769] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:17:49 2022] POST /identity/v3/projects => generated 385 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:50.112020 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-e3b7d179-268e-4da0-9780-386954d8444a admin admin] The token cache is being invalidate because project 48e4f0bf4c884513bbae7a74064f7c10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:17:50.112020 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-e3b7d179-268e-4da0-9780-386954d8444a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:50.112020 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-e3b7d179-268e-4da0-9780-386954d8444a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:50.117117 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 891/1770] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:17:49 2022] DELETE /identity/v3/projects/48e4f0bf4c884513bbae7a74064f7c10 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:50.118328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7d179-268e-4da0-9780-386954d8444a admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:50.120809 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f124e-e484-44bb-94b3-8e4fc2dd620d admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:50.120941 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-e3b7d179-268e-4da0-9780-386954d8444a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:50.131847 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-489f124e-e484-44bb-94b3-8e4fc2dd620d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:50.230317 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f124e-e484-44bb-94b3-8e4fc2dd620d admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:50.235612 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216bb55-9f63-478c-a523-312541cd0ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:50.236753 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216bb55-9f63-478c-a523-312541cd0ebd admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:50.237108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216bb55-9f63-478c-a523-312541cd0ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:50.237458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216bb55-9f63-478c-a523-312541cd0ebd admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:50.239745 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216bb55-9f63-478c-a523-312541cd0ebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:50.240578 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216bb55-9f63-478c-a523-312541cd0ebd admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:50.256944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7d179-268e-4da0-9780-386954d8444a admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:50.272193 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb45ab-3025-4d5d-b754-9ecf8b657c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:50.272795 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb45ab-3025-4d5d-b754-9ecf8b657c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:50.273074 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb45ab-3025-4d5d-b754-9ecf8b657c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:50.273345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb45ab-3025-4d5d-b754-9ecf8b657c56 admin admin] PATH_INFO: `/v3/users/7515c8fd8e5c4c0fbf470afb0723604e` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:50.276026 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb45ab-3025-4d5d-b754-9ecf8b657c56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7515c8fd8e5c4c0fbf470afb0723604e)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:50.278067 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb45ab-3025-4d5d-b754-9ecf8b657c56 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:50.376000 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 880/1771] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:17:50 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:17:50.380363 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216bb55-9f63-478c-a523-312541cd0ebd admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:50.398381 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216bb55-9f63-478c-a523-312541cd0ebd admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:50.403616 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ba9f6-0496-4877-8d62-5b854f8df8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:50.404721 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ba9f6-0496-4877-8d62-5b854f8df8ae admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:50.404721 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ba9f6-0496-4877-8d62-5b854f8df8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:50.404927 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ba9f6-0496-4877-8d62-5b854f8df8ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:50.405477 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ba9f6-0496-4877-8d62-5b854f8df8ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:50.407322 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ba9f6-0496-4877-8d62-5b854f8df8ae admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:50.425168 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 881/1772] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:17:50.430277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ba9f6-0496-4877-8d62-5b854f8df8ae admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:50.441693 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ba9f6-0496-4877-8d62-5b854f8df8ae admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:50.450189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5c34e-9e95-4186-b49e-7a35db792fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:50.451536 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5c34e-9e95-4186-b49e-7a35db792fba admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:50.451947 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5c34e-9e95-4186-b49e-7a35db792fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:50.452305 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5c34e-9e95-4186-b49e-7a35db792fba admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:50.453079 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5c34e-9e95-4186-b49e-7a35db792fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:50.456413 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5c34e-9e95-4186-b49e-7a35db792fba admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:50.478110 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 882/1773] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:17:50.479629 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5c34e-9e95-4186-b49e-7a35db792fba admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:50.499401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5c34e-9e95-4186-b49e-7a35db792fba admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:50.506972 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0bac7-73ae-4181-af44-fc8a896f4ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:50.509165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0bac7-73ae-4181-af44-fc8a896f4ab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:50.509815 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0bac7-73ae-4181-af44-fc8a896f4ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:50.510645 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0bac7-73ae-4181-af44-fc8a896f4ab7 admin admin] PATH_INFO: `/v3/projects/0a1902dd62134bd7b8476e8fa96039fe/users/43ed31590de0401f9bf12a38057793da/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:50.538503 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0bac7-73ae-4181-af44-fc8a896f4ab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a1902dd62134bd7b8476e8fa96039fe, user_id=43ed31590de0401f9bf12a38057793da, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:50.541533 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0bac7-73ae-4181-af44-fc8a896f4ab7 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:50.619165 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-92bb45ab-3025-4d5d-b754-9ecf8b657c56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7515c8fd8e5c4c0fbf470afb0723604e'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:50.621856 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-92bb45ab-3025-4d5d-b754-9ecf8b657c56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7515c8fd8e5c4c0fbf470afb0723604e'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:50.625309 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-92bb45ab-3025-4d5d-b754-9ecf8b657c56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7515c8fd8e5c4c0fbf470afb0723604e'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:50.697885 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 883/1774] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:50 2022] PUT /identity/v3/projects/0a1902dd62134bd7b8476e8fa96039fe/users/43ed31590de0401f9bf12a38057793da/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:50.716423 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-92bb45ab-3025-4d5d-b754-9ecf8b657c56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7515c8fd8e5c4c0fbf470afb0723604e'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:50.730117 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16f3c9-9954-4d0f-a14a-57298b4ef9c2 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:50.730117 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16f3c9-9954-4d0f-a14a-57298b4ef9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:50.730117 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16f3c9-9954-4d0f-a14a-57298b4ef9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:50.749650 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-92bb45ab-3025-4d5d-b754-9ecf8b657c56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7515c8fd8e5c4c0fbf470afb0723604e'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:50.799523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 892/1775] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:17:50 2022] DELETE /identity/v3/users/7515c8fd8e5c4c0fbf470afb0723604e => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:17:50.845054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-4d16f3c9-9954-4d0f-a14a-57298b4ef9c2 None None] MFA Rules not processed for user `43ed31590de0401f9bf12a38057793da`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:50.846309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-4d16f3c9-9954-4d0f-a14a-57298b4ef9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:51.008790 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:51.009083 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 884/1776] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:51.014797 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb45ab-3025-4d5d-b754-9ecf8b657c56 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:51.016324 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-92bb45ab-3025-4d5d-b754-9ecf8b657c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:51.215052 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb45ab-3025-4d5d-b754-9ecf8b657c56 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:51.226592 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7169274-9023-45ee-866b-fa8af690573c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:51.227243 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7169274-9023-45ee-866b-fa8af690573c service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:51.229196 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7169274-9023-45ee-866b-fa8af690573c service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:51.229196 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7169274-9023-45ee-866b-fa8af690573c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:51.266777 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7169274-9023-45ee-866b-fa8af690573c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:51.268436 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7169274-9023-45ee-866b-fa8af690573c service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:51.291455 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 893/1777] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:51.312039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16f3c9-9954-4d0f-a14a-57298b4ef9c2 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:51.314139 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-4d16f3c9-9954-4d0f-a14a-57298b4ef9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:51.365772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7169274-9023-45ee-866b-fa8af690573c service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:51.368485 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c7169274-9023-45ee-866b-fa8af690573c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:51.434740 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16f3c9-9954-4d0f-a14a-57298b4ef9c2 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:51.441210 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee88cd-136e-4071-beb6-04e51546f02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:51.454571 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee88cd-136e-4071-beb6-04e51546f02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:51.454571 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee88cd-136e-4071-beb6-04e51546f02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:51.454571 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee88cd-136e-4071-beb6-04e51546f02e admin admin] PATH_INFO: `/v3/users/43ed31590de0401f9bf12a38057793da` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:51.454571 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee88cd-136e-4071-beb6-04e51546f02e admin admin] RBAC: Authorizing `identity:delete_user(user_id=43ed31590de0401f9bf12a38057793da)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:51.454571 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee88cd-136e-4071-beb6-04e51546f02e admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:51.511513 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7169274-9023-45ee-866b-fa8af690573c service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:51.518436 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c96ba-e557-4fda-99c6-0efd8aaacfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:51.520022 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c96ba-e557-4fda-99c6-0efd8aaacfb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:51.521434 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c96ba-e557-4fda-99c6-0efd8aaacfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:51.521734 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c96ba-e557-4fda-99c6-0efd8aaacfb0 admin admin] PATH_INFO: `/v3/projects/c7532623915f469aaa8f813ce2c92247` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:51.523028 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c96ba-e557-4fda-99c6-0efd8aaacfb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7532623915f469aaa8f813ce2c92247)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:51.525041 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c96ba-e557-4fda-99c6-0efd8aaacfb0 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:51.948325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-24ee88cd-136e-4071-beb6-04e51546f02e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43ed31590de0401f9bf12a38057793da'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:51.950106 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-24ee88cd-136e-4071-beb6-04e51546f02e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43ed31590de0401f9bf12a38057793da'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:51.950975 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-24ee88cd-136e-4071-beb6-04e51546f02e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43ed31590de0401f9bf12a38057793da'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:51.969764 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f15c96ba-e557-4fda-99c6-0efd8aaacfb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7532623915f469aaa8f813ce2c92247', 'request_id': 'req-f15c96ba-e557-4fda-99c6-0efd8aaacfb0'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:51.977846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f15c96ba-e557-4fda-99c6-0efd8aaacfb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7532623915f469aaa8f813ce2c92247', 'request_id': 'req-f15c96ba-e557-4fda-99c6-0efd8aaacfb0'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:51.985492 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f15c96ba-e557-4fda-99c6-0efd8aaacfb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7532623915f469aaa8f813ce2c92247', 'request_id': 'req-f15c96ba-e557-4fda-99c6-0efd8aaacfb0'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:52.046862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-24ee88cd-136e-4071-beb6-04e51546f02e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43ed31590de0401f9bf12a38057793da'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:52.057034 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-24ee88cd-136e-4071-beb6-04e51546f02e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43ed31590de0401f9bf12a38057793da'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:52.084711 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 885/1778] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:17:51 2022] DELETE /identity/v3/users/43ed31590de0401f9bf12a38057793da => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:52.086409 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122fa94-de83-45e5-9b63-a9ffa0f82558 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:52.087048 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122fa94-de83-45e5-9b63-a9ffa0f82558 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:52.087048 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122fa94-de83-45e5-9b63-a9ffa0f82558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:52.109255 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-6122fa94-de83-45e5-9b63-a9ffa0f82558 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:52.111653 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-6122fa94-de83-45e5-9b63-a9ffa0f82558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:52.157801 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f15c96ba-e557-4fda-99c6-0efd8aaacfb0 admin admin] The token cache is being invalidate because project c7532623915f469aaa8f813ce2c92247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:17:52.158258 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f15c96ba-e557-4fda-99c6-0efd8aaacfb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:52.159059 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f15c96ba-e557-4fda-99c6-0efd8aaacfb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:52.160769 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 894/1779] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:17:51 2022] DELETE /identity/v3/projects/c7532623915f469aaa8f813ce2c92247 => generated 0 bytes in 796 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:52.165563 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c96ba-e557-4fda-99c6-0efd8aaacfb0 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:52.167061 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-f15c96ba-e557-4fda-99c6-0efd8aaacfb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:52.242691 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 886/1780] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:52.252183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122fa94-de83-45e5-9b63-a9ffa0f82558 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:52.253843 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-6122fa94-de83-45e5-9b63-a9ffa0f82558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:52.273065 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c96ba-e557-4fda-99c6-0efd8aaacfb0 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:52.278564 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c113704-2eae-49af-a15c-0dbe3853fa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:52.279533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c113704-2eae-49af-a15c-0dbe3853fa06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:52.279533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c113704-2eae-49af-a15c-0dbe3853fa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:52.279913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c113704-2eae-49af-a15c-0dbe3853fa06 admin admin] PATH_INFO: `/v3/users/325bb1e53f4140a6928cb8988ab0bbef` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:52.281429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c113704-2eae-49af-a15c-0dbe3853fa06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=325bb1e53f4140a6928cb8988ab0bbef)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:52.283520 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c113704-2eae-49af-a15c-0dbe3853fa06 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:52.324686 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122fa94-de83-45e5-9b63-a9ffa0f82558 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:52.329048 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e537e-4963-4372-ab9e-ec847bafe34f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:52.329663 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e537e-4963-4372-ab9e-ec847bafe34f service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:52.329940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e537e-4963-4372-ab9e-ec847bafe34f service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:52.330209 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e537e-4963-4372-ab9e-ec847bafe34f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:52.354923 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e537e-4963-4372-ab9e-ec847bafe34f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:52.356447 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e537e-4963-4372-ab9e-ec847bafe34f service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:52.372682 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 887/1781] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:17:52.374488 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e537e-4963-4372-ab9e-ec847bafe34f service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:52.376387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-d27e537e-4963-4372-ab9e-ec847bafe34f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:52.395092 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e537e-4963-4372-ab9e-ec847bafe34f service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:52.400940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fbba96-6406-4777-a4ea-74423544a16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:52.401423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbba96-6406-4777-a4ea-74423544a16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:52.401706 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbba96-6406-4777-a4ea-74423544a16d admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:52.401983 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbba96-6406-4777-a4ea-74423544a16d admin admin] PATH_INFO: `/v3/projects/ebd2389fc7ad461c8e0fa8141e87803a` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:52.408034 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fbba96-6406-4777-a4ea-74423544a16d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebd2389fc7ad461c8e0fa8141e87803a)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:52.423767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fbba96-6406-4777-a4ea-74423544a16d admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:52.563502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2c113704-2eae-49af-a15c-0dbe3853fa06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '325bb1e53f4140a6928cb8988ab0bbef'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:52.563502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2c113704-2eae-49af-a15c-0dbe3853fa06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '325bb1e53f4140a6928cb8988ab0bbef'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:52.564104 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2c113704-2eae-49af-a15c-0dbe3853fa06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '325bb1e53f4140a6928cb8988ab0bbef'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:52.595763 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-c6fbba96-6406-4777-a4ea-74423544a16d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebd2389fc7ad461c8e0fa8141e87803a', 'request_id': 'req-c6fbba96-6406-4777-a4ea-74423544a16d'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:52.602981 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-c6fbba96-6406-4777-a4ea-74423544a16d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebd2389fc7ad461c8e0fa8141e87803a', 'request_id': 'req-c6fbba96-6406-4777-a4ea-74423544a16d'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:52.609676 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-c6fbba96-6406-4777-a4ea-74423544a16d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebd2389fc7ad461c8e0fa8141e87803a', 'request_id': 'req-c6fbba96-6406-4777-a4ea-74423544a16d'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:52.704742 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2c113704-2eae-49af-a15c-0dbe3853fa06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '325bb1e53f4140a6928cb8988ab0bbef'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:52.722499 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2c113704-2eae-49af-a15c-0dbe3853fa06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '325bb1e53f4140a6928cb8988ab0bbef'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:52.740994 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 895/1782] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:17:52 2022] DELETE /identity/v3/users/325bb1e53f4140a6928cb8988ab0bbef => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:17:52.864040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-c6fbba96-6406-4777-a4ea-74423544a16d admin admin] The token cache is being invalidate because project ebd2389fc7ad461c8e0fa8141e87803a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:17:52.864040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-c6fbba96-6406-4777-a4ea-74423544a16d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:52.864040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-c6fbba96-6406-4777-a4ea-74423544a16d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:52.864040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 888/1783] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:17:52 2022] DELETE /identity/v3/projects/ebd2389fc7ad461c8e0fa8141e87803a => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:52.867681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed555e8-b65c-446c-8848-09504db080ac None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:52.867986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed555e8-b65c-446c-8848-09504db080ac None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:52.868711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed555e8-b65c-446c-8848-09504db080ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:52.892693 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-9ed555e8-b65c-446c-8848-09504db080ac None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:52.893926 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-9ed555e8-b65c-446c-8848-09504db080ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:52.988997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 896/1784] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:52.989103 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac08b04-d696-4f4a-9487-573fbdd1e17d None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:52.989103 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac08b04-d696-4f4a-9487-573fbdd1e17d None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:52.989103 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac08b04-d696-4f4a-9487-573fbdd1e17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:53.000672 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-dac08b04-d696-4f4a-9487-573fbdd1e17d None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:53.001883 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-dac08b04-d696-4f4a-9487-573fbdd1e17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:53.010599 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 889/1785] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:53.023239 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed555e8-b65c-446c-8848-09504db080ac None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:53.033134 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed555e8-b65c-446c-8848-09504db080ac None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:53.038862 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d028437-5fd1-46e3-90b0-e1d310f4f901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:53.039464 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d028437-5fd1-46e3-90b0-e1d310f4f901 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:53.039763 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d028437-5fd1-46e3-90b0-e1d310f4f901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:53.040067 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d028437-5fd1-46e3-90b0-e1d310f4f901 admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:53.040706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d028437-5fd1-46e3-90b0-e1d310f4f901 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:17:53.041008 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d028437-5fd1-46e3-90b0-e1d310f4f901 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:53.042675 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d028437-5fd1-46e3-90b0-e1d310f4f901 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:53.059736 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 897/1786] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:17:53.060895 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac08b04-d696-4f4a-9487-573fbdd1e17d None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:53.073585 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac08b04-d696-4f4a-9487-573fbdd1e17d None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:53.082202 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04120083-0d30-46c7-b6ba-9f403fb07883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:53.083092 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04120083-0d30-46c7-b6ba-9f403fb07883 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:53.083614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04120083-0d30-46c7-b6ba-9f403fb07883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:53.084260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04120083-0d30-46c7-b6ba-9f403fb07883 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:53.085888 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04120083-0d30-46c7-b6ba-9f403fb07883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:53.088776 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04120083-0d30-46c7-b6ba-9f403fb07883 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:53.130213 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d028437-5fd1-46e3-90b0-e1d310f4f901 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:53.132125 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-9d028437-5fd1-46e3-90b0-e1d310f4f901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:53.145068 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d028437-5fd1-46e3-90b0-e1d310f4f901 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:53.150182 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580aa6b2-d5ba-463b-890e-da41fdababc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:53.150848 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580aa6b2-d5ba-463b-890e-da41fdababc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:53.151453 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580aa6b2-d5ba-463b-890e-da41fdababc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:53.151453 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580aa6b2-d5ba-463b-890e-da41fdababc4 admin admin] PATH_INFO: `/v3/projects/0a1902dd62134bd7b8476e8fa96039fe` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:53.154832 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580aa6b2-d5ba-463b-890e-da41fdababc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a1902dd62134bd7b8476e8fa96039fe)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:53.158249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580aa6b2-d5ba-463b-890e-da41fdababc4 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:53.218245 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 890/1787] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:17:53 2022] POST /identity/v3/projects => generated 369 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:53.219281 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04120083-0d30-46c7-b6ba-9f403fb07883 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:53.308677 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04120083-0d30-46c7-b6ba-9f403fb07883 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:53.337525 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-580aa6b2-d5ba-463b-890e-da41fdababc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a1902dd62134bd7b8476e8fa96039fe', 'request_id': 'req-580aa6b2-d5ba-463b-890e-da41fdababc4'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:53.343594 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-580aa6b2-d5ba-463b-890e-da41fdababc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a1902dd62134bd7b8476e8fa96039fe', 'request_id': 'req-580aa6b2-d5ba-463b-890e-da41fdababc4'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:53.350855 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-580aa6b2-d5ba-463b-890e-da41fdababc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a1902dd62134bd7b8476e8fa96039fe', 'request_id': 'req-580aa6b2-d5ba-463b-890e-da41fdababc4'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:53.377619 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2829caf-f213-4ef4-b8fe-253235c80d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:53.378236 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2829caf-f213-4ef4-b8fe-253235c80d5e admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:53.378555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2829caf-f213-4ef4-b8fe-253235c80d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:53.378824 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2829caf-f213-4ef4-b8fe-253235c80d5e admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:53.379434 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2829caf-f213-4ef4-b8fe-253235c80d5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:53.382079 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2829caf-f213-4ef4-b8fe-253235c80d5e admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:53.471406 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-580aa6b2-d5ba-463b-890e-da41fdababc4 admin admin] The token cache is being invalidate because project 0a1902dd62134bd7b8476e8fa96039fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:17:53.472963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-580aa6b2-d5ba-463b-890e-da41fdababc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:53.472963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-580aa6b2-d5ba-463b-890e-da41fdababc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:53.479042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 898/1788] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:17:53 2022] DELETE /identity/v3/projects/0a1902dd62134bd7b8476e8fa96039fe => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:17:53.479042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580aa6b2-d5ba-463b-890e-da41fdababc4 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:53.479042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-580aa6b2-d5ba-463b-890e-da41fdababc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:53.506996 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 891/1789] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:17:53 2022] POST /identity/v3/users => generated 285 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:53.510266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580aa6b2-d5ba-463b-890e-da41fdababc4 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:53.513044 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4d9bc-7dad-40e9-8d34-cd5e2ec3620a None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:53.514394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4d9bc-7dad-40e9-8d34-cd5e2ec3620a None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:53.514920 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4d9bc-7dad-40e9-8d34-cd5e2ec3620a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:53.515518 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ab07c-7f64-4fa8-abeb-fe2c636ca111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:53.516359 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ab07c-7f64-4fa8-abeb-fe2c636ca111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:53.516690 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ab07c-7f64-4fa8-abeb-fe2c636ca111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:53.516969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ab07c-7f64-4fa8-abeb-fe2c636ca111 admin admin] PATH_INFO: `/v3/projects/07f29f8e4c0c4c9ca0c668304d110ea2` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:53.518472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ab07c-7f64-4fa8-abeb-fe2c636ca111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07f29f8e4c0c4c9ca0c668304d110ea2)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:53.520929 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ab07c-7f64-4fa8-abeb-fe2c636ca111 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:53.540306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-c7d4d9bc-7dad-40e9-8d34-cd5e2ec3620a None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:53.542062 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-c7d4d9bc-7dad-40e9-8d34-cd5e2ec3620a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:53.581437 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 892/1790] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:53.582640 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4d9bc-7dad-40e9-8d34-cd5e2ec3620a None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:53.588904 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-c7d4d9bc-7dad-40e9-8d34-cd5e2ec3620a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:53.602190 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4d9bc-7dad-40e9-8d34-cd5e2ec3620a None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:53.608176 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40a240-7477-4d1f-89eb-24786d336b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:53.608689 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40a240-7477-4d1f-89eb-24786d336b25 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:53.609236 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40a240-7477-4d1f-89eb-24786d336b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:53.610449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40a240-7477-4d1f-89eb-24786d336b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:53.611117 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40a240-7477-4d1f-89eb-24786d336b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:53.612868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40a240-7477-4d1f-89eb-24786d336b25 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:53.625892 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 893/1791] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:53.627306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e58ff-86ef-4c73-b229-c73f78839bb2 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:53.627593 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e58ff-86ef-4c73-b229-c73f78839bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:53.627868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e58ff-86ef-4c73-b229-c73f78839bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:53.647903 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-538e58ff-86ef-4c73-b229-c73f78839bb2 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:53.649349 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-538e58ff-86ef-4c73-b229-c73f78839bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:53.663286 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 894/1792] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:53.664448 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e58ff-86ef-4c73-b229-c73f78839bb2 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:53.676826 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e58ff-86ef-4c73-b229-c73f78839bb2 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:53.683853 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-1a8ab07c-7f64-4fa8-abeb-fe2c636ca111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07f29f8e4c0c4c9ca0c668304d110ea2', 'request_id': 'req-1a8ab07c-7f64-4fa8-abeb-fe2c636ca111'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:53.690149 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-1a8ab07c-7f64-4fa8-abeb-fe2c636ca111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07f29f8e4c0c4c9ca0c668304d110ea2', 'request_id': 'req-1a8ab07c-7f64-4fa8-abeb-fe2c636ca111'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:53.697118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-1a8ab07c-7f64-4fa8-abeb-fe2c636ca111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07f29f8e4c0c4c9ca0c668304d110ea2', 'request_id': 'req-1a8ab07c-7f64-4fa8-abeb-fe2c636ca111'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:53.737667 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f4eea-c116-49de-870e-4c4b24729053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:53.738954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f4eea-c116-49de-870e-4c4b24729053 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:53.738954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f4eea-c116-49de-870e-4c4b24729053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:53.738954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f4eea-c116-49de-870e-4c4b24729053 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:53.739555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f4eea-c116-49de-870e-4c4b24729053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:53.741341 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f4eea-c116-49de-870e-4c4b24729053 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:53.755963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 895/1793] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:53.755963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f4eea-c116-49de-870e-4c4b24729053 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:53.763638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f4eea-c116-49de-870e-4c4b24729053 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:53.769984 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeed431-d03b-487e-a51e-67092fcab115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:53.771337 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeed431-d03b-487e-a51e-67092fcab115 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:53.771988 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeed431-d03b-487e-a51e-67092fcab115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:53.772243 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeed431-d03b-487e-a51e-67092fcab115 admin admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:53.772901 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeed431-d03b-487e-a51e-67092fcab115 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:17:53.773202 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeed431-d03b-487e-a51e-67092fcab115 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:53.774818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeed431-d03b-487e-a51e-67092fcab115 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:53.788881 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-1a8ab07c-7f64-4fa8-abeb-fe2c636ca111 admin admin] The token cache is being invalidate because project 07f29f8e4c0c4c9ca0c668304d110ea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:17:53.789184 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-1a8ab07c-7f64-4fa8-abeb-fe2c636ca111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:53.790822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-1a8ab07c-7f64-4fa8-abeb-fe2c636ca111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:53.793842 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 899/1794] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:17:53 2022] DELETE /identity/v3/projects/07f29f8e4c0c4c9ca0c668304d110ea2 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:53.797788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ab07c-7f64-4fa8-abeb-fe2c636ca111 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:53.799429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-1a8ab07c-7f64-4fa8-abeb-fe2c636ca111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:53.809680 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 896/1795] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:17:53.809680 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7283280-1813-44cc-9d6a-605d387398ce None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:53.809680 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7283280-1813-44cc-9d6a-605d387398ce None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:53.809680 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7283280-1813-44cc-9d6a-605d387398ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:53.818729 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ab07c-7f64-4fa8-abeb-fe2c636ca111 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:53.827741 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417d807-ab49-41bd-9c84-884ac8e61a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:53.828661 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417d807-ab49-41bd-9c84-884ac8e61a17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:53.828947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417d807-ab49-41bd-9c84-884ac8e61a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:53.829229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417d807-ab49-41bd-9c84-884ac8e61a17 admin admin] PATH_INFO: `/v3/projects/99fcee71c3084bf4b0a2cacab67d4859/users/1ebe7c75dbef42ac8cd31eaebcf40838/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:53.839236 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-c7283280-1813-44cc-9d6a-605d387398ce None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:53.840475 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-c7283280-1813-44cc-9d6a-605d387398ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:53.845385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417d807-ab49-41bd-9c84-884ac8e61a17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99fcee71c3084bf4b0a2cacab67d4859, user_id=1ebe7c75dbef42ac8cd31eaebcf40838, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:53.848191 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417d807-ab49-41bd-9c84-884ac8e61a17 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:53.857487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 897/1796] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:53.860074 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7283280-1813-44cc-9d6a-605d387398ce None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:53.867061 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-c7283280-1813-44cc-9d6a-605d387398ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:53.884707 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7283280-1813-44cc-9d6a-605d387398ce None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:53.890709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509fe53-6269-4d1e-8ab4-71a6cc2625b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:53.891669 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509fe53-6269-4d1e-8ab4-71a6cc2625b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:53.891804 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509fe53-6269-4d1e-8ab4-71a6cc2625b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:53.892127 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509fe53-6269-4d1e-8ab4-71a6cc2625b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:53.892766 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509fe53-6269-4d1e-8ab4-71a6cc2625b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:53.895471 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509fe53-6269-4d1e-8ab4-71a6cc2625b2 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:53.973703 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 900/1797] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:53 2022] PUT /identity/v3/projects/99fcee71c3084bf4b0a2cacab67d4859/users/1ebe7c75dbef42ac8cd31eaebcf40838/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:53.975338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826ed40-7284-46c0-9d70-76ed2599bdfe None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:53.979544 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826ed40-7284-46c0-9d70-76ed2599bdfe None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:53.979544 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826ed40-7284-46c0-9d70-76ed2599bdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:53.999614 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-c826ed40-7284-46c0-9d70-76ed2599bdfe None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:54.000834 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c826ed40-7284-46c0-9d70-76ed2599bdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:54.011213 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 898/1798] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:17:53 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:54.012638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eead3f-3f8f-43b0-8190-9e4c78bdb401 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:54.013048 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eead3f-3f8f-43b0-8190-9e4c78bdb401 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:54.013534 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eead3f-3f8f-43b0-8190-9e4c78bdb401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:54.044822 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-21eead3f-3f8f-43b0-8190-9e4c78bdb401 None None] MFA Rules not processed for user `1ebe7c75dbef42ac8cd31eaebcf40838`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:54.046314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-21eead3f-3f8f-43b0-8190-9e4c78bdb401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:54.065412 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 901/1799] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:54.069554 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826ed40-7284-46c0-9d70-76ed2599bdfe None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:54.079010 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826ed40-7284-46c0-9d70-76ed2599bdfe None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:54.114198 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 899/1800] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:54.117962 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eead3f-3f8f-43b0-8190-9e4c78bdb401 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:54.136560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7aae14-a7ea-4bf1-898c-097a98785f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:54.137177 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7aae14-a7ea-4bf1-898c-097a98785f49 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:54.137458 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7aae14-a7ea-4bf1-898c-097a98785f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:54.137730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7aae14-a7ea-4bf1-898c-097a98785f49 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:54.138376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7aae14-a7ea-4bf1-898c-097a98785f49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:54.140309 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7aae14-a7ea-4bf1-898c-097a98785f49 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:54.178529 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eead3f-3f8f-43b0-8190-9e4c78bdb401 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:54.183327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a95d3-12b0-415f-90f4-5fe27d942783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:54.183954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a95d3-12b0-415f-90f4-5fe27d942783 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:54.184234 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a95d3-12b0-415f-90f4-5fe27d942783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:54.184541 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a95d3-12b0-415f-90f4-5fe27d942783 admin admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:54.185195 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a95d3-12b0-415f-90f4-5fe27d942783 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:17:54.185498 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a95d3-12b0-415f-90f4-5fe27d942783 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:54.187205 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a95d3-12b0-415f-90f4-5fe27d942783 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:54.200327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 900/1801] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:17:54.201279 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a95d3-12b0-415f-90f4-5fe27d942783 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:54.212244 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a95d3-12b0-415f-90f4-5fe27d942783 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:54.217032 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ea187-e23f-4474-ac58-521a3a27d112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:54.217660 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ea187-e23f-4474-ac58-521a3a27d112 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:54.217945 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ea187-e23f-4474-ac58-521a3a27d112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:54.218218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ea187-e23f-4474-ac58-521a3a27d112 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:54.218888 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ea187-e23f-4474-ac58-521a3a27d112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:54.220832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ea187-e23f-4474-ac58-521a3a27d112 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:54.304203 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 902/1802] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:17:54 2022] POST /identity/v3/users => generated 287 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:54.305227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7aae14-a7ea-4bf1-898c-097a98785f49 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:54.315965 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7aae14-a7ea-4bf1-898c-097a98785f49 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:54.321874 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219cbe9-d05c-41bc-b56f-bfdaacdb225b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:54.322708 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219cbe9-d05c-41bc-b56f-bfdaacdb225b admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:54.323092 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219cbe9-d05c-41bc-b56f-bfdaacdb225b admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:54.323468 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219cbe9-d05c-41bc-b56f-bfdaacdb225b admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:54.324372 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219cbe9-d05c-41bc-b56f-bfdaacdb225b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:54.326631 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219cbe9-d05c-41bc-b56f-bfdaacdb225b admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:54.424758 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 901/1803] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:17:54 2022] POST /identity/v3/projects => generated 369 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:54.424758 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ea187-e23f-4474-ac58-521a3a27d112 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:54.461078 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 903/1804] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:17:54 2022] POST /identity/v3/projects => generated 363 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:54.469000 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219cbe9-d05c-41bc-b56f-bfdaacdb225b admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:54.513629 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ea187-e23f-4474-ac58-521a3a27d112 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:54.539741 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219cbe9-d05c-41bc-b56f-bfdaacdb225b admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:54.542894 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9104f-fed6-4d45-bf0e-1fbc5ac94b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:54.543505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9104f-fed6-4d45-bf0e-1fbc5ac94b23 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:54.543787 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9104f-fed6-4d45-bf0e-1fbc5ac94b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:54.544063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9104f-fed6-4d45-bf0e-1fbc5ac94b23 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:54.544686 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9104f-fed6-4d45-bf0e-1fbc5ac94b23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:54.546712 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9104f-fed6-4d45-bf0e-1fbc5ac94b23 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:54.585811 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a7116-ff54-43f1-a981-ed82084005be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:54.586472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a7116-ff54-43f1-a981-ed82084005be admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:54.586763 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a7116-ff54-43f1-a981-ed82084005be admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:54.587046 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a7116-ff54-43f1-a981-ed82084005be admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:54.587698 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a7116-ff54-43f1-a981-ed82084005be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:54.589330 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a7116-ff54-43f1-a981-ed82084005be admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:54.603913 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 902/1805] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:54.603913 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a7116-ff54-43f1-a981-ed82084005be admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:54.617259 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a7116-ff54-43f1-a981-ed82084005be admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:54.625543 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38f9bf-ab8b-4921-a1e2-e6c09f8c2dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:54.626242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38f9bf-ab8b-4921-a1e2-e6c09f8c2dae admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:54.626626 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38f9bf-ab8b-4921-a1e2-e6c09f8c2dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:54.627408 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38f9bf-ab8b-4921-a1e2-e6c09f8c2dae admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:54.637412 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38f9bf-ab8b-4921-a1e2-e6c09f8c2dae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:54.638564 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38f9bf-ab8b-4921-a1e2-e6c09f8c2dae admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:54.670386 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 904/1806] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:17:54 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:54.670386 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9104f-fed6-4d45-bf0e-1fbc5ac94b23 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:54.683132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9104f-fed6-4d45-bf0e-1fbc5ac94b23 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:54.690868 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856abf4-b708-404f-b4f6-69e889dd82df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:54.691562 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856abf4-b708-404f-b4f6-69e889dd82df admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:54.694106 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856abf4-b708-404f-b4f6-69e889dd82df admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:54.696415 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856abf4-b708-404f-b4f6-69e889dd82df admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:54.697231 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856abf4-b708-404f-b4f6-69e889dd82df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:54.700377 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856abf4-b708-404f-b4f6-69e889dd82df admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:54.716648 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 905/1807] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:54.717606 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856abf4-b708-404f-b4f6-69e889dd82df admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:54.741481 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856abf4-b708-404f-b4f6-69e889dd82df admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:54.747874 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb0729-224b-4a73-9fa4-f0c1190ea12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:54.748663 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb0729-224b-4a73-9fa4-f0c1190ea12f admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:54.749012 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb0729-224b-4a73-9fa4-f0c1190ea12f admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:54.749347 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb0729-224b-4a73-9fa4-f0c1190ea12f admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:54.751343 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 903/1808] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:17:54 2022] POST /identity/v3/users => generated 282 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:54.759339 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb0729-224b-4a73-9fa4-f0c1190ea12f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:54.759666 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38f9bf-ab8b-4921-a1e2-e6c09f8c2dae admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:54.759771 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb0729-224b-4a73-9fa4-f0c1190ea12f admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:54.765142 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38f9bf-ab8b-4921-a1e2-e6c09f8c2dae admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:54.766940 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 906/1809] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:54.767703 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb0729-224b-4a73-9fa4-f0c1190ea12f admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:54.778579 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb0729-224b-4a73-9fa4-f0c1190ea12f admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:54.779118 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d9c65-4108-4d0b-975d-69322119ccad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:54.779965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d9c65-4108-4d0b-975d-69322119ccad admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:54.780650 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d9c65-4108-4d0b-975d-69322119ccad admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:54.781644 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d9c65-4108-4d0b-975d-69322119ccad admin admin] PATH_INFO: `/v3/projects/574201c03083423eb49830941617b39b/users/02bfb6110f80413e8cc1cd856d3d39d0/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:54.783327 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507c6bb-b08e-4879-9610-71cd8d12ebf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:54.783924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507c6bb-b08e-4879-9610-71cd8d12ebf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:54.784201 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507c6bb-b08e-4879-9610-71cd8d12ebf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:54.784626 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507c6bb-b08e-4879-9610-71cd8d12ebf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:54.785412 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507c6bb-b08e-4879-9610-71cd8d12ebf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:54.787700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507c6bb-b08e-4879-9610-71cd8d12ebf2 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:54.801016 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 907/1810] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:54.801937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507c6bb-b08e-4879-9610-71cd8d12ebf2 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:54.809299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d9c65-4108-4d0b-975d-69322119ccad admin admin] RBAC: Authorizing `identity:create_grant(project_id=574201c03083423eb49830941617b39b, user_id=02bfb6110f80413e8cc1cd856d3d39d0, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:54.812446 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d9c65-4108-4d0b-975d-69322119ccad admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:54.814816 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507c6bb-b08e-4879-9610-71cd8d12ebf2 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:54.826333 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e765055-e6c6-465b-9fff-c6721e258456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:54.826333 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e765055-e6c6-465b-9fff-c6721e258456 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:54.826333 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e765055-e6c6-465b-9fff-c6721e258456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:54.826333 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e765055-e6c6-465b-9fff-c6721e258456 admin admin] PATH_INFO: `/v3/projects/e640a5648f6c475ea226fc470ce84a63/users/992c717e649c46e2a339095a93019d39/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:54.840336 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e765055-e6c6-465b-9fff-c6721e258456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e640a5648f6c475ea226fc470ce84a63, user_id=992c717e649c46e2a339095a93019d39, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:54.843794 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e765055-e6c6-465b-9fff-c6721e258456 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:54.916878 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 904/1811] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:54 2022] PUT /identity/v3/projects/574201c03083423eb49830941617b39b/users/02bfb6110f80413e8cc1cd856d3d39d0/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:54.926384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d9c65-4108-4d0b-975d-69322119ccad admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:54.934555 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:54.943867 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 908/1812] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:54 2022] PUT /identity/v3/projects/e640a5648f6c475ea226fc470ce84a63/users/992c717e649c46e2a339095a93019d39/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:54.943867 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d413a-e472-437a-9a2a-3589c3d4f5cf None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:54.943867 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d413a-e472-437a-9a2a-3589c3d4f5cf None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:54.943867 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d413a-e472-437a-9a2a-3589c3d4f5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:54.982828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d9c65-4108-4d0b-975d-69322119ccad admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:54.989615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-5c3d413a-e472-437a-9a2a-3589c3d4f5cf None None] MFA Rules not processed for user `02bfb6110f80413e8cc1cd856d3d39d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:54.991227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-5c3d413a-e472-437a-9a2a-3589c3d4f5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:55.044254 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc064bc-49bf-450c-9ebf-0ad3b7b0a07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:55.044527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc064bc-49bf-450c-9ebf-0ad3b7b0a07b admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:55.044830 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc064bc-49bf-450c-9ebf-0ad3b7b0a07b admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:55.044998 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc064bc-49bf-450c-9ebf-0ad3b7b0a07b admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:55.045635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc064bc-49bf-450c-9ebf-0ad3b7b0a07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:55.047253 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc064bc-49bf-450c-9ebf-0ad3b7b0a07b admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:55.066327 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 909/1814] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:55.066508 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 905/1814] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:55.066598 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d413a-e472-437a-9a2a-3589c3d4f5cf None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:55.071396 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc064bc-49bf-450c-9ebf-0ad3b7b0a07b admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:55.088592 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc064bc-49bf-450c-9ebf-0ad3b7b0a07b admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:55.088804 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d413a-e472-437a-9a2a-3589c3d4f5cf None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:55.094635 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4307e-e7aa-48b2-9dd4-884b6559ef77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:55.095303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4307e-e7aa-48b2-9dd4-884b6559ef77 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:55.095583 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4307e-e7aa-48b2-9dd4-884b6559ef77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:55.095926 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4307e-e7aa-48b2-9dd4-884b6559ef77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:55.096542 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4307e-e7aa-48b2-9dd4-884b6559ef77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:55.096777 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a08865-1c7a-4e80-ad84-7e66f6454218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:55.097724 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a08865-1c7a-4e80-ad84-7e66f6454218 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:55.098197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4307e-e7aa-48b2-9dd4-884b6559ef77 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:55.098445 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a08865-1c7a-4e80-ad84-7e66f6454218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:55.099026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a08865-1c7a-4e80-ad84-7e66f6454218 admin admin] PATH_INFO: `/v3/projects/55230043feec4bca9472de1f948c5d34/users/854541432a704d5aa8a0129f0ee3e73d/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:55.113002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 910/1815] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:55.113002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4307e-e7aa-48b2-9dd4-884b6559ef77 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:55.114428 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-bdc4307e-e7aa-48b2-9dd4-884b6559ef77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:55.123688 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a08865-1c7a-4e80-ad84-7e66f6454218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55230043feec4bca9472de1f948c5d34, user_id=854541432a704d5aa8a0129f0ee3e73d, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:55.126567 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a08865-1c7a-4e80-ad84-7e66f6454218 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:55.175601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4307e-e7aa-48b2-9dd4-884b6559ef77 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:55.179711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f90512-2fd6-4de3-a718-3706a144f29d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:55.180352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f90512-2fd6-4de3-a718-3706a144f29d service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:55.180636 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f90512-2fd6-4de3-a718-3706a144f29d service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:55.180915 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f90512-2fd6-4de3-a718-3706a144f29d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:55.189208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f90512-2fd6-4de3-a718-3706a144f29d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:55.190745 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f90512-2fd6-4de3-a718-3706a144f29d service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:55.200058 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 911/1816] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:55.200818 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f90512-2fd6-4de3-a718-3706a144f29d service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:55.216107 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f90512-2fd6-4de3-a718-3706a144f29d service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:55.221147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b5a39-eb95-4adb-abeb-c974158f0d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:55.221860 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b5a39-eb95-4adb-abeb-c974158f0d0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:55.222250 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b5a39-eb95-4adb-abeb-c974158f0d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:55.222556 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b5a39-eb95-4adb-abeb-c974158f0d0f admin admin] PATH_INFO: `/v3/projects/e640a5648f6c475ea226fc470ce84a63/users/992c717e649c46e2a339095a93019d39/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:55.224538 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b5a39-eb95-4adb-abeb-c974158f0d0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e640a5648f6c475ea226fc470ce84a63, user_id=992c717e649c46e2a339095a93019d39, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:55.227249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b5a39-eb95-4adb-abeb-c974158f0d0f admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:55.238573 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 912/1817] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:55 2022] PUT /identity/v3/projects/e640a5648f6c475ea226fc470ce84a63/users/992c717e649c46e2a339095a93019d39/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:55.239506 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b5a39-eb95-4adb-abeb-c974158f0d0f admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:55.317486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b5a39-eb95-4adb-abeb-c974158f0d0f admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:55.317486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d217df2-b5b3-4d10-888b-7f510a1169f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:55.317486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d217df2-b5b3-4d10-888b-7f510a1169f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:55.317486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d217df2-b5b3-4d10-888b-7f510a1169f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:55.318488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d217df2-b5b3-4d10-888b-7f510a1169f4 admin admin] PATH_INFO: `/v3/users/02bfb6110f80413e8cc1cd856d3d39d0` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:55.318488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d217df2-b5b3-4d10-888b-7f510a1169f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02bfb6110f80413e8cc1cd856d3d39d0)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:55.318488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d217df2-b5b3-4d10-888b-7f510a1169f4 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:55.321262 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 906/1818] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:55 2022] PUT /identity/v3/projects/55230043feec4bca9472de1f948c5d34/users/854541432a704d5aa8a0129f0ee3e73d/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:55.322672 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc616d5d-70ae-43d8-ab93-75de342b4297 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:55.322963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc616d5d-70ae-43d8-ab93-75de342b4297 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:55.323240 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc616d5d-70ae-43d8-ab93-75de342b4297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:55.353865 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-bc616d5d-70ae-43d8-ab93-75de342b4297 None None] MFA Rules not processed for user `992c717e649c46e2a339095a93019d39`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:55.355200 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-bc616d5d-70ae-43d8-ab93-75de342b4297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:55.429675 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 907/1819] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:55.431299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b226b5c-f80c-473c-b879-d3fab4978dac None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:55.431667 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b226b5c-f80c-473c-b879-d3fab4978dac None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:55.436773 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b226b5c-f80c-473c-b879-d3fab4978dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:55.460558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-1b226b5c-f80c-473c-b879-d3fab4978dac None None] MFA Rules not processed for user `854541432a704d5aa8a0129f0ee3e73d`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:55.461768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-1b226b5c-f80c-473c-b879-d3fab4978dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:55.530372 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 908/1820] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:55.531332 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b226b5c-f80c-473c-b879-d3fab4978dac None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:55.593884 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b226b5c-f80c-473c-b879-d3fab4978dac None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:55.594103 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-4d217df2-b5b3-4d10-888b-7f510a1169f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02bfb6110f80413e8cc1cd856d3d39d0'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:55.594812 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-4d217df2-b5b3-4d10-888b-7f510a1169f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02bfb6110f80413e8cc1cd856d3d39d0'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:55.595458 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-4d217df2-b5b3-4d10-888b-7f510a1169f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02bfb6110f80413e8cc1cd856d3d39d0'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:55.598790 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80687a-00c2-49f3-aac6-c3c599bff68a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:55.600036 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80687a-00c2-49f3-aac6-c3c599bff68a service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:55.600322 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80687a-00c2-49f3-aac6-c3c599bff68a service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:55.600593 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80687a-00c2-49f3-aac6-c3c599bff68a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:55.602520 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-aa80687a-00c2-49f3-aac6-c3c599bff68a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:55.615506 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80687a-00c2-49f3-aac6-c3c599bff68a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:55.616955 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80687a-00c2-49f3-aac6-c3c599bff68a service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:55.626748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 909/1821] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:55.627622 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80687a-00c2-49f3-aac6-c3c599bff68a service cinder] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:55.628971 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-aa80687a-00c2-49f3-aac6-c3c599bff68a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:55.691838 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-4d217df2-b5b3-4d10-888b-7f510a1169f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02bfb6110f80413e8cc1cd856d3d39d0'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:55.698579 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80687a-00c2-49f3-aac6-c3c599bff68a service cinder] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:55.703432 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b29d1-30af-4ff6-977e-91c9b5868adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:55.704046 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b29d1-30af-4ff6-977e-91c9b5868adf admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:55.704342 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b29d1-30af-4ff6-977e-91c9b5868adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:55.704603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b29d1-30af-4ff6-977e-91c9b5868adf admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:55.705223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b29d1-30af-4ff6-977e-91c9b5868adf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:55.706928 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-4d217df2-b5b3-4d10-888b-7f510a1169f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02bfb6110f80413e8cc1cd856d3d39d0'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:55.707223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b29d1-30af-4ff6-977e-91c9b5868adf admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:55.721671 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 913/1822] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:17:55 2022] DELETE /identity/v3/users/02bfb6110f80413e8cc1cd856d3d39d0 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:55.725889 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472d202-89d5-40a2-83af-7bbe55b8fc45 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:55.726174 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472d202-89d5-40a2-83af-7bbe55b8fc45 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:55.727192 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472d202-89d5-40a2-83af-7bbe55b8fc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:55.746054 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-f472d202-89d5-40a2-83af-7bbe55b8fc45 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:55.747376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-f472d202-89d5-40a2-83af-7bbe55b8fc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:55.822506 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 914/1823] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:17:55.822506 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472d202-89d5-40a2-83af-7bbe55b8fc45 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:55.822506 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-f472d202-89d5-40a2-83af-7bbe55b8fc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:55.856407 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 910/1824] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:17:55 2022] POST /identity/v3/projects => generated 363 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:55.856407 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b29d1-30af-4ff6-977e-91c9b5868adf admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:55.859901 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-ba3b29d1-30af-4ff6-977e-91c9b5868adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:55.883243 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472d202-89d5-40a2-83af-7bbe55b8fc45 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:55.917109 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b29d1-30af-4ff6-977e-91c9b5868adf admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:55.921107 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae848d-f76e-456a-b0b3-7e8707885d64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:55.921718 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae848d-f76e-456a-b0b3-7e8707885d64 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:55.922017 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae848d-f76e-456a-b0b3-7e8707885d64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:55.922312 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae848d-f76e-456a-b0b3-7e8707885d64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:55.935126 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b675d6-d0b7-4e15-b290-5dd53987c5f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:55.935772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b675d6-d0b7-4e15-b290-5dd53987c5f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:55.936197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b675d6-d0b7-4e15-b290-5dd53987c5f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:55.936537 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b675d6-d0b7-4e15-b290-5dd53987c5f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:55.938399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c0b675d6-d0b7-4e15-b290-5dd53987c5f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:55.955385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:56.020774 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae848d-f76e-456a-b0b3-7e8707885d64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:56.024310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae848d-f76e-456a-b0b3-7e8707885d64 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:56.028151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b675d6-d0b7-4e15-b290-5dd53987c5f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:56.031114 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b675d6-d0b7-4e15-b290-5dd53987c5f7 service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:56.038681 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 911/1825] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:56.039631 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae848d-f76e-456a-b0b3-7e8707885d64 service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:56.050912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae848d-f76e-456a-b0b3-7e8707885d64 service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:56.057518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b55f05-85c7-4ea7-a439-7ce61f1111dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:56.058342 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b55f05-85c7-4ea7-a439-7ce61f1111dc admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:56.058675 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b55f05-85c7-4ea7-a439-7ce61f1111dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:56.059074 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b55f05-85c7-4ea7-a439-7ce61f1111dc admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:56.061978 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b55f05-85c7-4ea7-a439-7ce61f1111dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:56.062130 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 915/1826] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:56.062441 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b55f05-85c7-4ea7-a439-7ce61f1111dc admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:56.206887 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 912/1827] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:17:56 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:56.208153 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b675d6-d0b7-4e15-b290-5dd53987c5f7 service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:56.219084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b675d6-d0b7-4e15-b290-5dd53987c5f7 service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:56.225327 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34b7ee-5d9a-42a0-93ac-a3cf1fb81490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:56.225939 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34b7ee-5d9a-42a0-93ac-a3cf1fb81490 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:56.226206 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34b7ee-5d9a-42a0-93ac-a3cf1fb81490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:56.226508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34b7ee-5d9a-42a0-93ac-a3cf1fb81490 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:56.227136 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34b7ee-5d9a-42a0-93ac-a3cf1fb81490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:56.228787 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34b7ee-5d9a-42a0-93ac-a3cf1fb81490 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:56.244498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 916/1828] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:56.246223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b55f05-85c7-4ea7-a439-7ce61f1111dc admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:56.256901 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b55f05-85c7-4ea7-a439-7ce61f1111dc admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:56.261616 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e966ee-c9cb-4c37-ac1b-8666af0e4a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:56.262279 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e966ee-c9cb-4c37-ac1b-8666af0e4a8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:56.262615 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e966ee-c9cb-4c37-ac1b-8666af0e4a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:56.262864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e966ee-c9cb-4c37-ac1b-8666af0e4a8b admin admin] PATH_INFO: `/v3/projects/c9c24e82390c4581aeb87ae1cc7a520a/users/1a097d9551c9439ab91396aa32b3f323/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:56.278751 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e966ee-c9cb-4c37-ac1b-8666af0e4a8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c24e82390c4581aeb87ae1cc7a520a, user_id=1a097d9551c9439ab91396aa32b3f323, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:56.282596 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e966ee-c9cb-4c37-ac1b-8666af0e4a8b admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:56.408743 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 913/1829] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:56 2022] PUT /identity/v3/projects/c9c24e82390c4581aeb87ae1cc7a520a/users/1a097d9551c9439ab91396aa32b3f323/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:56.413366 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34b7ee-5d9a-42a0-93ac-a3cf1fb81490 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:56.423557 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34b7ee-5d9a-42a0-93ac-a3cf1fb81490 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:56.491632 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769a5d9-da9a-43a9-b65d-53aee0073c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:56.492245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769a5d9-da9a-43a9-b65d-53aee0073c6f admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:56.492524 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769a5d9-da9a-43a9-b65d-53aee0073c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:56.492848 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769a5d9-da9a-43a9-b65d-53aee0073c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:56.493471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769a5d9-da9a-43a9-b65d-53aee0073c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:56.495099 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769a5d9-da9a-43a9-b65d-53aee0073c6f admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:56.504793 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 917/1830] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:56.509026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e966ee-c9cb-4c37-ac1b-8666af0e4a8b admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:56.519108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e966ee-c9cb-4c37-ac1b-8666af0e4a8b admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:56.524219 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b6004-8430-44e2-a383-c3cc5c850274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:56.524863 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b6004-8430-44e2-a383-c3cc5c850274 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:56.525141 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b6004-8430-44e2-a383-c3cc5c850274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:56.525412 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b6004-8430-44e2-a383-c3cc5c850274 admin admin] PATH_INFO: `/v3/projects/c9c24e82390c4581aeb87ae1cc7a520a/users/1a097d9551c9439ab91396aa32b3f323/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:56.527307 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b6004-8430-44e2-a383-c3cc5c850274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c24e82390c4581aeb87ae1cc7a520a, user_id=1a097d9551c9439ab91396aa32b3f323, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:56.530190 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b6004-8430-44e2-a383-c3cc5c850274 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:56.540914 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 914/1831] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:56 2022] PUT /identity/v3/projects/c9c24e82390c4581aeb87ae1cc7a520a/users/1a097d9551c9439ab91396aa32b3f323/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:56.570831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a97d3e-d0e5-4261-a6d1-cf423d266044 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:56.571122 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a97d3e-d0e5-4261-a6d1-cf423d266044 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:56.571397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a97d3e-d0e5-4261-a6d1-cf423d266044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:56.602894 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b6004-8430-44e2-a383-c3cc5c850274 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:56.604211 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-40a97d3e-d0e5-4261-a6d1-cf423d266044 None None] MFA Rules not processed for user `1a097d9551c9439ab91396aa32b3f323`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:56.605573 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-40a97d3e-d0e5-4261-a6d1-cf423d266044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:56.608686 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-728b6004-8430-44e2-a383-c3cc5c850274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:56.685892 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b6004-8430-44e2-a383-c3cc5c850274 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:56.692710 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 918/1832] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:56.696396 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374226f-a9d7-41e8-a1e9-8100a4a409d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:56.697051 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374226f-a9d7-41e8-a1e9-8100a4a409d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:56.697335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374226f-a9d7-41e8-a1e9-8100a4a409d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:56.697609 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374226f-a9d7-41e8-a1e9-8100a4a409d4 admin admin] PATH_INFO: `/v3/projects/574201c03083423eb49830941617b39b` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:56.698868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374226f-a9d7-41e8-a1e9-8100a4a409d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=574201c03083423eb49830941617b39b)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:56.700884 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374226f-a9d7-41e8-a1e9-8100a4a409d4 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:56.703221 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a97d3e-d0e5-4261-a6d1-cf423d266044 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:56.704804 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-40a97d3e-d0e5-4261-a6d1-cf423d266044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:56.782658 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a97d3e-d0e5-4261-a6d1-cf423d266044 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:56.786730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d20fd-d1c0-4129-82f1-a211cf8e1714 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:56.787570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d20fd-d1c0-4129-82f1-a211cf8e1714 service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:56.787879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d20fd-d1c0-4129-82f1-a211cf8e1714 service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:56.788318 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d20fd-d1c0-4129-82f1-a211cf8e1714 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:56.798376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d20fd-d1c0-4129-82f1-a211cf8e1714 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:56.799873 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d20fd-d1c0-4129-82f1-a211cf8e1714 service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:56.877859 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 919/1833] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:17:57.202405 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-b374226f-a9d7-41e8-a1e9-8100a4a409d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '574201c03083423eb49830941617b39b', 'request_id': 'req-b374226f-a9d7-41e8-a1e9-8100a4a409d4'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:57.242144 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-b374226f-a9d7-41e8-a1e9-8100a4a409d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '574201c03083423eb49830941617b39b', 'request_id': 'req-b374226f-a9d7-41e8-a1e9-8100a4a409d4'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:57.242144 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-b374226f-a9d7-41e8-a1e9-8100a4a409d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '574201c03083423eb49830941617b39b', 'request_id': 'req-b374226f-a9d7-41e8-a1e9-8100a4a409d4'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:57.797897 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-b374226f-a9d7-41e8-a1e9-8100a4a409d4 admin admin] The token cache is being invalidate because project 574201c03083423eb49830941617b39b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:17:57.798545 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-b374226f-a9d7-41e8-a1e9-8100a4a409d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:57.801285 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-b374226f-a9d7-41e8-a1e9-8100a4a409d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:17:57.804091 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 915/1834] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:17:56 2022] DELETE /identity/v3/projects/574201c03083423eb49830941617b39b => generated 0 bytes in 1202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:17:57.809351 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639c68b-a380-48a2-9919-c1fa44122ab1 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:57.809805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639c68b-a380-48a2-9919-c1fa44122ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:57.809893 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639c68b-a380-48a2-9919-c1fa44122ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:57.829762 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-2639c68b-a380-48a2-9919-c1fa44122ab1 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:57.831015 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-2639c68b-a380-48a2-9919-c1fa44122ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:57.890376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 920/1835] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:57.898615 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f88ad-0c8c-44e6-968c-53d355919351 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:57.898911 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f88ad-0c8c-44e6-968c-53d355919351 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:57.899192 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f88ad-0c8c-44e6-968c-53d355919351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:57.919771 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-865f88ad-0c8c-44e6-968c-53d355919351 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:57.920990 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-865f88ad-0c8c-44e6-968c-53d355919351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:57.929540 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 916/1836] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:57.934063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639c68b-a380-48a2-9919-c1fa44122ab1 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:57.944069 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639c68b-a380-48a2-9919-c1fa44122ab1 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:57.948714 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6434d-0d74-422f-b035-f73d80e00ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:57.949382 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6434d-0d74-422f-b035-f73d80e00ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:57.949929 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6434d-0d74-422f-b035-f73d80e00ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:57.950127 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6434d-0d74-422f-b035-f73d80e00ed2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:57.950942 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6434d-0d74-422f-b035-f73d80e00ed2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:17:57.951249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6434d-0d74-422f-b035-f73d80e00ed2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:57.952851 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6434d-0d74-422f-b035-f73d80e00ed2 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:57.972627 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 921/1837] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:17:57.977774 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f88ad-0c8c-44e6-968c-53d355919351 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:57.979199 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6434d-0d74-422f-b035-f73d80e00ed2 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:57.981677 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-a9f6434d-0d74-422f-b035-f73d80e00ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:57.988197 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f88ad-0c8c-44e6-968c-53d355919351 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:57.994067 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f9ab5-17d7-47f9-a84d-ebab80d7c6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:57.994819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f9ab5-17d7-47f9-a84d-ebab80d7c6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:57.995103 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f9ab5-17d7-47f9-a84d-ebab80d7c6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:57.995376 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f9ab5-17d7-47f9-a84d-ebab80d7c6b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:57.996358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f9ab5-17d7-47f9-a84d-ebab80d7c6b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:57.998213 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f9ab5-17d7-47f9-a84d-ebab80d7c6b4 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:58.043169 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6434d-0d74-422f-b035-f73d80e00ed2 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:58.048014 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ec0e1-c217-484d-b913-08378c9b2716 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:58.048622 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ec0e1-c217-484d-b913-08378c9b2716 service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:58.048905 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ec0e1-c217-484d-b913-08378c9b2716 service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:58.049198 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ec0e1-c217-484d-b913-08378c9b2716 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:58.051109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-db2ec0e1-c217-484d-b913-08378c9b2716 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:58.138323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 917/1838] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:17:57 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:58.139893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f9ab5-17d7-47f9-a84d-ebab80d7c6b4 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:58.155134 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ec0e1-c217-484d-b913-08378c9b2716 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:58.156877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ec0e1-c217-484d-b913-08378c9b2716 service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:58.174480 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 922/1839] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:17:58.211219 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f9ab5-17d7-47f9-a84d-ebab80d7c6b4 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:58.216246 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abc302-fbb7-4748-95b2-e0a0ebef5bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:58.216857 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abc302-fbb7-4748-95b2-e0a0ebef5bef admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:58.217137 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abc302-fbb7-4748-95b2-e0a0ebef5bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:58.217405 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abc302-fbb7-4748-95b2-e0a0ebef5bef admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:58.218052 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72abc302-fbb7-4748-95b2-e0a0ebef5bef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:58.220109 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72abc302-fbb7-4748-95b2-e0a0ebef5bef admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:58.316278 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 918/1840] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:17:58 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:58.317868 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ec0e1-c217-484d-b913-08378c9b2716 service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:58.329238 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ec0e1-c217-484d-b913-08378c9b2716 service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:58.333855 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30796bce-d423-4d4a-8b74-3f420d4f1ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:58.335132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30796bce-d423-4d4a-8b74-3f420d4f1ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:58.335483 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30796bce-d423-4d4a-8b74-3f420d4f1ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:58.335672 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30796bce-d423-4d4a-8b74-3f420d4f1ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:58.336296 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30796bce-d423-4d4a-8b74-3f420d4f1ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:58.337904 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30796bce-d423-4d4a-8b74-3f420d4f1ae2 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:58.348926 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 923/1841] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:58.353214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abc302-fbb7-4748-95b2-e0a0ebef5bef admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:58.364106 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abc302-fbb7-4748-95b2-e0a0ebef5bef admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:58.369197 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90a404-8fe6-4843-b3c2-187460b9e683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:58.369807 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90a404-8fe6-4843-b3c2-187460b9e683 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:58.370090 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90a404-8fe6-4843-b3c2-187460b9e683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:58.370415 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90a404-8fe6-4843-b3c2-187460b9e683 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:58.371107 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90a404-8fe6-4843-b3c2-187460b9e683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:58.373133 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90a404-8fe6-4843-b3c2-187460b9e683 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:58.388927 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 919/1842] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:58.390159 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30796bce-d423-4d4a-8b74-3f420d4f1ae2 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:58.405827 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30796bce-d423-4d4a-8b74-3f420d4f1ae2 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:58.411787 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a4f62-68e2-488e-9997-a43c4cb2f2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:58.412548 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a4f62-68e2-488e-9997-a43c4cb2f2ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:58.413019 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a4f62-68e2-488e-9997-a43c4cb2f2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:58.413476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a4f62-68e2-488e-9997-a43c4cb2f2ed admin admin] PATH_INFO: `/v3/projects/d4e947c89a8342fb9fa2df59b7fa68bf/users/e6f902a943f845c3a6d1d0066fb12d78/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:58.430498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a4f62-68e2-488e-9997-a43c4cb2f2ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4e947c89a8342fb9fa2df59b7fa68bf, user_id=e6f902a943f845c3a6d1d0066fb12d78, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:58.433618 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a4f62-68e2-488e-9997-a43c4cb2f2ed admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:58.603687 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 924/1843] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:58 2022] PUT /identity/v3/projects/d4e947c89a8342fb9fa2df59b7fa68bf/users/e6f902a943f845c3a6d1d0066fb12d78/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:58.614431 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268d105-986a-4da7-b3d4-797a2e621006 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:58.615007 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268d105-986a-4da7-b3d4-797a2e621006 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:58.616096 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268d105-986a-4da7-b3d4-797a2e621006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:58.672172 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-0268d105-986a-4da7-b3d4-797a2e621006 None None] MFA Rules not processed for user `e6f902a943f845c3a6d1d0066fb12d78`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:58.673658 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-0268d105-986a-4da7-b3d4-797a2e621006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:58.767901 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 920/1844] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:58.768967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a4f62-68e2-488e-9997-a43c4cb2f2ed admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:58.837234 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a4f62-68e2-488e-9997-a43c4cb2f2ed admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:58.842387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c6e4b-2add-4fcb-aac6-5730764faf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:58.842998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c6e4b-2add-4fcb-aac6-5730764faf1e admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:58.843275 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c6e4b-2add-4fcb-aac6-5730764faf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:58.843544 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c6e4b-2add-4fcb-aac6-5730764faf1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:58.844189 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c6e4b-2add-4fcb-aac6-5730764faf1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:58.846088 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c6e4b-2add-4fcb-aac6-5730764faf1e admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:58.969391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 925/1845] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:17:58 2022] POST /identity/v3/projects => generated 375 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:58.970718 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268d105-986a-4da7-b3d4-797a2e621006 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:58.982356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268d105-986a-4da7-b3d4-797a2e621006 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:59.042740 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cef068-7382-4e5b-a9c2-3dd6ddfca30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:59.043355 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cef068-7382-4e5b-a9c2-3dd6ddfca30c admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:59.043646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cef068-7382-4e5b-a9c2-3dd6ddfca30c admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:59.043923 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cef068-7382-4e5b-a9c2-3dd6ddfca30c admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:59.044541 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cef068-7382-4e5b-a9c2-3dd6ddfca30c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:59.046534 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cef068-7382-4e5b-a9c2-3dd6ddfca30c admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:59.164306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 921/1846] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:17:58 2022] POST /identity/v3/users => generated 294 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:17:59.168343 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c6e4b-2add-4fcb-aac6-5730764faf1e admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:59.179689 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c6e4b-2add-4fcb-aac6-5730764faf1e admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:59.184489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6eaa7-6ac0-434d-88f1-5e29b5c91d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:59.185265 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6eaa7-6ac0-434d-88f1-5e29b5c91d43 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:59.185477 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6eaa7-6ac0-434d-88f1-5e29b5c91d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:59.185716 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6eaa7-6ac0-434d-88f1-5e29b5c91d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:59.186379 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6eaa7-6ac0-434d-88f1-5e29b5c91d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:59.187991 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6eaa7-6ac0-434d-88f1-5e29b5c91d43 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:59.203643 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 926/1847] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:59.207893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cef068-7382-4e5b-a9c2-3dd6ddfca30c admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:59.221006 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cef068-7382-4e5b-a9c2-3dd6ddfca30c admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:59.226892 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315f3b2-ae67-4463-b40d-e67514d95397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:59.228126 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315f3b2-ae67-4463-b40d-e67514d95397 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:59.228126 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315f3b2-ae67-4463-b40d-e67514d95397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:59.228714 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315f3b2-ae67-4463-b40d-e67514d95397 admin admin] PATH_INFO: `/v3/projects/b86063cb451242eaa0603c1361809e77/users/c65daf5be39e4e6fac7e4bc73022dd2e/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:59.251181 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315f3b2-ae67-4463-b40d-e67514d95397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b86063cb451242eaa0603c1361809e77, user_id=c65daf5be39e4e6fac7e4bc73022dd2e, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:59.253402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315f3b2-ae67-4463-b40d-e67514d95397 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:59.276223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:59.358148 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 922/1848] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:59 2022] PUT /identity/v3/projects/b86063cb451242eaa0603c1361809e77/users/c65daf5be39e4e6fac7e4bc73022dd2e/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:59.358252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6eaa7-6ac0-434d-88f1-5e29b5c91d43 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:59.372905 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6eaa7-6ac0-434d-88f1-5e29b5c91d43 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:59.410271 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:59.445117 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cfbf0-4e00-48cc-90fb-e3d172ea20b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:59.445756 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cfbf0-4e00-48cc-90fb-e3d172ea20b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:59.446035 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cfbf0-4e00-48cc-90fb-e3d172ea20b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:59.446340 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cfbf0-4e00-48cc-90fb-e3d172ea20b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:59.447063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09cfbf0-4e00-48cc-90fb-e3d172ea20b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:59.448600 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09cfbf0-4e00-48cc-90fb-e3d172ea20b6 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:59.464028 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 927/1849] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:17:59.468355 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315f3b2-ae67-4463-b40d-e67514d95397 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:59.480695 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315f3b2-ae67-4463-b40d-e67514d95397 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:59.487155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3deb0-9727-47fc-be15-9c800cf3238c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:59.487847 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3deb0-9727-47fc-be15-9c800cf3238c admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:59.488152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3deb0-9727-47fc-be15-9c800cf3238c admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:59.488430 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3deb0-9727-47fc-be15-9c800cf3238c admin admin] PATH_INFO: `/v3/projects/b86063cb451242eaa0603c1361809e77/users/c65daf5be39e4e6fac7e4bc73022dd2e/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:59.491157 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3deb0-9727-47fc-be15-9c800cf3238c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b86063cb451242eaa0603c1361809e77, user_id=c65daf5be39e4e6fac7e4bc73022dd2e, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:59.494325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3deb0-9727-47fc-be15-9c800cf3238c admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:59.506750 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 923/1850] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:17:59 2022] PUT /identity/v3/projects/b86063cb451242eaa0603c1361809e77/users/c65daf5be39e4e6fac7e4bc73022dd2e/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:17:59.518148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f75188-a1d9-4a7c-ae4c-0e19f22d8dbe None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:59.518470 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f75188-a1d9-4a7c-ae4c-0e19f22d8dbe None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:59.518747 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f75188-a1d9-4a7c-ae4c-0e19f22d8dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:59.551809 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-c6f75188-a1d9-4a7c-ae4c-0e19f22d8dbe None None] MFA Rules not processed for user `c65daf5be39e4e6fac7e4bc73022dd2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:17:59.552969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c6f75188-a1d9-4a7c-ae4c-0e19f22d8dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:17:59.662021 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 928/1851] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:17:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:17:59.694338 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3deb0-9727-47fc-be15-9c800cf3238c admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:17:59.771030 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3deb0-9727-47fc-be15-9c800cf3238c admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:17:59.775783 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f94928-4991-45c5-9311-f21d99948dde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:17:59.776410 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f94928-4991-45c5-9311-f21d99948dde service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:17:59.776695 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f94928-4991-45c5-9311-f21d99948dde service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:17:59.776972 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f94928-4991-45c5-9311-f21d99948dde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:17:59.858254 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f94928-4991-45c5-9311-f21d99948dde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:17:59.859821 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f94928-4991-45c5-9311-f21d99948dde service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:17:59.869338 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 924/1852] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:17:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:01.075349 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a627137-ea1b-4d16-9362-c010b79d236d None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:01.075922 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a627137-ea1b-4d16-9362-c010b79d236d None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:01.075922 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a627137-ea1b-4d16-9362-c010b79d236d None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:01.077420 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 929/1853] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 23 08:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:18:01.098331 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa36666-3a35-4f35-a1ed-a18e2854dc3d None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:01.098331 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa36666-3a35-4f35-a1ed-a18e2854dc3d None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:01.100132 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa36666-3a35-4f35-a1ed-a18e2854dc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:01.137186 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-1fa36666-3a35-4f35-a1ed-a18e2854dc3d None None] MFA Rules not processed for user `b5c55e5c1cea47f29d378ea457384a31`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:01.139882 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-1fa36666-3a35-4f35-a1ed-a18e2854dc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:01.267295 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 925/1854] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 23 08:18:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:18:01.284002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a627137-ea1b-4d16-9362-c010b79d236d None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:01.286031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-6a627137-ea1b-4d16-9362-c010b79d236d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:01.312488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a627137-ea1b-4d16-9362-c010b79d236d None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:01.328658 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d36b8-bb46-485e-84f8-d7d5d3c075be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:01.328658 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d36b8-bb46-485e-84f8-d7d5d3c075be service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:01.328658 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d36b8-bb46-485e-84f8-d7d5d3c075be service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:01.328658 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d36b8-bb46-485e-84f8-d7d5d3c075be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:01.331587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d36b8-bb46-485e-84f8-d7d5d3c075be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:01.333393 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d36b8-bb46-485e-84f8-d7d5d3c075be service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:01.344659 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 930/1855] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:01.964302 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:02.177415 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa36666-3a35-4f35-a1ed-a18e2854dc3d None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:02.179931 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-1fa36666-3a35-4f35-a1ed-a18e2854dc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:02.185523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=79,keystone:INSERT=3,keystone:DELETE=18 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:02.272289 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa36666-3a35-4f35-a1ed-a18e2854dc3d None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:02.277456 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdfe0d-21da-4c94-8543-ffee1aabac82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:02.280961 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdfe0d-21da-4c94-8543-ffee1aabac82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:02.280961 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdfe0d-21da-4c94-8543-ffee1aabac82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:02.280961 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdfe0d-21da-4c94-8543-ffee1aabac82 admin admin] PATH_INFO: `/v3/users/854541432a704d5aa8a0129f0ee3e73d` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:02.280961 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfdfe0d-21da-4c94-8543-ffee1aabac82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=854541432a704d5aa8a0129f0ee3e73d)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:02.281832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfdfe0d-21da-4c94-8543-ffee1aabac82 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:02.351565 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d36b8-bb46-485e-84f8-d7d5d3c075be service nova] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:02.353092 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-0c6d36b8-bb46-485e-84f8-d7d5d3c075be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:02.368264 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d36b8-bb46-485e-84f8-d7d5d3c075be service nova] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:02.373472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6005b1-2db0-4b45-922c-f95f87bb0188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:02.374150 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6005b1-2db0-4b45-922c-f95f87bb0188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:02.374460 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6005b1-2db0-4b45-922c-f95f87bb0188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:02.374728 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6005b1-2db0-4b45-922c-f95f87bb0188 admin admin] PATH_INFO: `/v3/users/a09c0f1acfee4ced91c2df5db14ee5fb` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:02.375862 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6005b1-2db0-4b45-922c-f95f87bb0188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a09c0f1acfee4ced91c2df5db14ee5fb)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:02.377758 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6005b1-2db0-4b45-922c-f95f87bb0188 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:02.586568 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-8dfdfe0d-21da-4c94-8543-ffee1aabac82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '854541432a704d5aa8a0129f0ee3e73d'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:02.587354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-8dfdfe0d-21da-4c94-8543-ffee1aabac82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '854541432a704d5aa8a0129f0ee3e73d'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:02.588054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-8dfdfe0d-21da-4c94-8543-ffee1aabac82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '854541432a704d5aa8a0129f0ee3e73d'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:02.627138 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-1c6005b1-2db0-4b45-922c-f95f87bb0188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a09c0f1acfee4ced91c2df5db14ee5fb'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:02.627902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-1c6005b1-2db0-4b45-922c-f95f87bb0188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a09c0f1acfee4ced91c2df5db14ee5fb'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:02.628808 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-1c6005b1-2db0-4b45-922c-f95f87bb0188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a09c0f1acfee4ced91c2df5db14ee5fb'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:02.671291 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-8dfdfe0d-21da-4c94-8543-ffee1aabac82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '854541432a704d5aa8a0129f0ee3e73d'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:02.681250 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-8dfdfe0d-21da-4c94-8543-ffee1aabac82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '854541432a704d5aa8a0129f0ee3e73d'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:02.700651 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 926/1856] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:02 2022] DELETE /identity/v3/users/854541432a704d5aa8a0129f0ee3e73d => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:02.704980 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72dfa2-9727-414b-8154-2cb40138efeb None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:02.705269 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72dfa2-9727-414b-8154-2cb40138efeb None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:02.705546 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72dfa2-9727-414b-8154-2cb40138efeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:02.725434 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-9c72dfa2-9727-414b-8154-2cb40138efeb None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:02.727463 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-9c72dfa2-9727-414b-8154-2cb40138efeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:02.791052 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 927/1857] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:18:02.795066 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72dfa2-9727-414b-8154-2cb40138efeb None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:02.796723 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-9c72dfa2-9727-414b-8154-2cb40138efeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:02.805205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-1c6005b1-2db0-4b45-922c-f95f87bb0188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a09c0f1acfee4ced91c2df5db14ee5fb'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:02.809267 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72dfa2-9727-414b-8154-2cb40138efeb None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:02.814471 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332d351-0b87-4d59-8dcf-80192b1ec8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:02.815117 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332d351-0b87-4d59-8dcf-80192b1ec8bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:02.815400 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332d351-0b87-4d59-8dcf-80192b1ec8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:02.815729 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332d351-0b87-4d59-8dcf-80192b1ec8bf admin admin] PATH_INFO: `/v3/users/1ebe7c75dbef42ac8cd31eaebcf40838` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:02.817043 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332d351-0b87-4d59-8dcf-80192b1ec8bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ebe7c75dbef42ac8cd31eaebcf40838)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:02.819071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332d351-0b87-4d59-8dcf-80192b1ec8bf admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:02.823046 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-1c6005b1-2db0-4b45-922c-f95f87bb0188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a09c0f1acfee4ced91c2df5db14ee5fb'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:02.836269 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 931/1858] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:02 2022] DELETE /identity/v3/users/a09c0f1acfee4ced91c2df5db14ee5fb => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:18:02.837326 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6005b1-2db0-4b45-922c-f95f87bb0188 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:02.838866 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-1c6005b1-2db0-4b45-922c-f95f87bb0188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:02.908775 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6005b1-2db0-4b45-922c-f95f87bb0188 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:02.912604 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0df2c3-ed93-4163-a8ed-e39de2a001a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:02.913783 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0df2c3-ed93-4163-a8ed-e39de2a001a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:02.914094 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0df2c3-ed93-4163-a8ed-e39de2a001a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:02.914617 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0df2c3-ed93-4163-a8ed-e39de2a001a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:02.978852 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0df2c3-ed93-4163-a8ed-e39de2a001a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:02.980338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0df2c3-ed93-4163-a8ed-e39de2a001a0 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:02.984825 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-a332d351-0b87-4d59-8dcf-80192b1ec8bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ebe7c75dbef42ac8cd31eaebcf40838'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:02.985638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-a332d351-0b87-4d59-8dcf-80192b1ec8bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ebe7c75dbef42ac8cd31eaebcf40838'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:02.986659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-a332d351-0b87-4d59-8dcf-80192b1ec8bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ebe7c75dbef42ac8cd31eaebcf40838'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:02.994926 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 932/1859] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:02.996230 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672dd7a-a2ad-4d57-b700-c3247cd93592 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:02.996487 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672dd7a-a2ad-4d57-b700-c3247cd93592 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:02.997433 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672dd7a-a2ad-4d57-b700-c3247cd93592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:03.016580 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-7672dd7a-a2ad-4d57-b700-c3247cd93592 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:03.017812 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-7672dd7a-a2ad-4d57-b700-c3247cd93592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:03.029505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 933/1860] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:03.039562 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672dd7a-a2ad-4d57-b700-c3247cd93592 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:03.041548 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-7672dd7a-a2ad-4d57-b700-c3247cd93592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:03.056459 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672dd7a-a2ad-4d57-b700-c3247cd93592 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:03.060380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3a844-240a-4738-8822-00f0b4e40e8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:03.061428 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3a844-240a-4738-8822-00f0b4e40e8c service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:03.061859 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3a844-240a-4738-8822-00f0b4e40e8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:03.062305 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3a844-240a-4738-8822-00f0b4e40e8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:03.079859 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3a844-240a-4738-8822-00f0b4e40e8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:03.081581 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3a844-240a-4738-8822-00f0b4e40e8c service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:03.095238 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 934/1861] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:18:03.128020 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-a332d351-0b87-4d59-8dcf-80192b1ec8bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ebe7c75dbef42ac8cd31eaebcf40838'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:03.137033 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-a332d351-0b87-4d59-8dcf-80192b1ec8bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ebe7c75dbef42ac8cd31eaebcf40838'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:03.156837 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 928/1862] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:02 2022] DELETE /identity/v3/users/1ebe7c75dbef42ac8cd31eaebcf40838 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:03.161910 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151048ac-0be4-4a09-96a8-0d6b3243266c None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:03.162208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151048ac-0be4-4a09-96a8-0d6b3243266c None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:03.162521 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151048ac-0be4-4a09-96a8-0d6b3243266c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:03.162957 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:03.187783 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-151048ac-0be4-4a09-96a8-0d6b3243266c None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:03.189022 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-151048ac-0be4-4a09-96a8-0d6b3243266c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:03.261919 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 935/1863] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:03.269313 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332d351-0b87-4d59-8dcf-80192b1ec8bf admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:03.271917 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a332d351-0b87-4d59-8dcf-80192b1ec8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:03.350123 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332d351-0b87-4d59-8dcf-80192b1ec8bf admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:03.355605 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70b1cf-1afc-4012-8074-c5527ffc8190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:03.356384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70b1cf-1afc-4012-8074-c5527ffc8190 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:03.356682 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70b1cf-1afc-4012-8074-c5527ffc8190 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:03.356961 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70b1cf-1afc-4012-8074-c5527ffc8190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:03.369009 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70b1cf-1afc-4012-8074-c5527ffc8190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:03.370812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70b1cf-1afc-4012-8074-c5527ffc8190 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:03.383791 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 929/1864] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:03.707834 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151048ac-0be4-4a09-96a8-0d6b3243266c None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:03.709867 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-151048ac-0be4-4a09-96a8-0d6b3243266c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:03.729038 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151048ac-0be4-4a09-96a8-0d6b3243266c None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:03.741351 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd5e3e-c219-414e-bd4d-4f3440138b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:03.742874 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd5e3e-c219-414e-bd4d-4f3440138b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:03.743321 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd5e3e-c219-414e-bd4d-4f3440138b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:03.745177 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd5e3e-c219-414e-bd4d-4f3440138b84 admin admin] PATH_INFO: `/v3/projects/55230043feec4bca9472de1f948c5d34` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:03.745659 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd5e3e-c219-414e-bd4d-4f3440138b84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55230043feec4bca9472de1f948c5d34)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:03.748125 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd5e3e-c219-414e-bd4d-4f3440138b84 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:03.931340 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70b1cf-1afc-4012-8074-c5527ffc8190 service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:03.933301 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-3c70b1cf-1afc-4012-8074-c5527ffc8190 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:03.945998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-dfbd5e3e-c219-414e-bd4d-4f3440138b84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55230043feec4bca9472de1f948c5d34', 'request_id': 'req-dfbd5e3e-c219-414e-bd4d-4f3440138b84'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:03.951876 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70b1cf-1afc-4012-8074-c5527ffc8190 service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:03.954773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-dfbd5e3e-c219-414e-bd4d-4f3440138b84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55230043feec4bca9472de1f948c5d34', 'request_id': 'req-dfbd5e3e-c219-414e-bd4d-4f3440138b84'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:03.967023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-dfbd5e3e-c219-414e-bd4d-4f3440138b84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55230043feec4bca9472de1f948c5d34', 'request_id': 'req-dfbd5e3e-c219-414e-bd4d-4f3440138b84'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:04.024823 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e2d10-c897-46c4-8e5b-203051ca97ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:04.025510 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e2d10-c897-46c4-8e5b-203051ca97ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:04.025990 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e2d10-c897-46c4-8e5b-203051ca97ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:04.026269 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e2d10-c897-46c4-8e5b-203051ca97ed admin admin] PATH_INFO: `/v3/projects/6b01639cd55a4cb9b907a50ee947c6df` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:04.027865 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e2d10-c897-46c4-8e5b-203051ca97ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b01639cd55a4cb9b907a50ee947c6df)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:04.029890 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e2d10-c897-46c4-8e5b-203051ca97ed admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:04.068389 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-dfbd5e3e-c219-414e-bd4d-4f3440138b84 admin admin] The token cache is being invalidate because project 55230043feec4bca9472de1f948c5d34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:04.068802 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-dfbd5e3e-c219-414e-bd4d-4f3440138b84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:04.069512 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-dfbd5e3e-c219-414e-bd4d-4f3440138b84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:04.071834 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 936/1865] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:03 2022] DELETE /identity/v3/projects/55230043feec4bca9472de1f948c5d34 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:04.075816 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd5e3e-c219-414e-bd4d-4f3440138b84 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:04.077252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-dfbd5e3e-c219-414e-bd4d-4f3440138b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:04.091353 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd5e3e-c219-414e-bd4d-4f3440138b84 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:04.096785 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6ce18-da7a-4291-b580-7f837284284c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:04.097625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6ce18-da7a-4291-b580-7f837284284c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:04.098046 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6ce18-da7a-4291-b580-7f837284284c admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:04.098457 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6ce18-da7a-4291-b580-7f837284284c admin admin] PATH_INFO: `/v3/users/1a097d9551c9439ab91396aa32b3f323` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:04.099881 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6ce18-da7a-4291-b580-7f837284284c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a097d9551c9439ab91396aa32b3f323)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:04.102155 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6ce18-da7a-4291-b580-7f837284284c admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:04.165512 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-3c3e2d10-c897-46c4-8e5b-203051ca97ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b01639cd55a4cb9b907a50ee947c6df', 'request_id': 'req-3c3e2d10-c897-46c4-8e5b-203051ca97ed'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:04.171450 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-3c3e2d10-c897-46c4-8e5b-203051ca97ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b01639cd55a4cb9b907a50ee947c6df', 'request_id': 'req-3c3e2d10-c897-46c4-8e5b-203051ca97ed'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:04.181656 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-3c3e2d10-c897-46c4-8e5b-203051ca97ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b01639cd55a4cb9b907a50ee947c6df', 'request_id': 'req-3c3e2d10-c897-46c4-8e5b-203051ca97ed'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:04.381212 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-3c3e2d10-c897-46c4-8e5b-203051ca97ed admin admin] The token cache is being invalidate because project 6b01639cd55a4cb9b907a50ee947c6df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:04.381861 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-3c3e2d10-c897-46c4-8e5b-203051ca97ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:04.382126 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-3c3e2d10-c897-46c4-8e5b-203051ca97ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:04.383746 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 930/1866] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:03 2022] DELETE /identity/v3/projects/6b01639cd55a4cb9b907a50ee947c6df => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:18:04.387632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e2d10-c897-46c4-8e5b-203051ca97ed admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:04.388949 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-3c3e2d10-c897-46c4-8e5b-203051ca97ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:04.437430 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-40d6ce18-da7a-4291-b580-7f837284284c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a097d9551c9439ab91396aa32b3f323'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:04.438725 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-40d6ce18-da7a-4291-b580-7f837284284c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a097d9551c9439ab91396aa32b3f323'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:04.439570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-40d6ce18-da7a-4291-b580-7f837284284c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a097d9551c9439ab91396aa32b3f323'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:04.460569 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e2d10-c897-46c4-8e5b-203051ca97ed admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:04.460569 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f4b75-4fa7-4943-8430-4d994126f61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:04.461144 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f4b75-4fa7-4943-8430-4d994126f61c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:04.461144 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f4b75-4fa7-4943-8430-4d994126f61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:04.461389 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f4b75-4fa7-4943-8430-4d994126f61c admin admin] PATH_INFO: `/v3/users/63d5756d22d94abba55389b461f813d0` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:04.462560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f4b75-4fa7-4943-8430-4d994126f61c admin admin] RBAC: Authorizing `identity:delete_user(user_id=63d5756d22d94abba55389b461f813d0)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:04.464556 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f4b75-4fa7-4943-8430-4d994126f61c admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:04.525900 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-40d6ce18-da7a-4291-b580-7f837284284c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a097d9551c9439ab91396aa32b3f323'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:04.540600 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-40d6ce18-da7a-4291-b580-7f837284284c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a097d9551c9439ab91396aa32b3f323'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:04.552798 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 937/1867] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:04 2022] DELETE /identity/v3/users/1a097d9551c9439ab91396aa32b3f323 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:18:04.553594 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6ce18-da7a-4291-b580-7f837284284c admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:04.555218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-40d6ce18-da7a-4291-b580-7f837284284c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:04.626375 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6ce18-da7a-4291-b580-7f837284284c admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:04.631540 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff891374-e329-4662-aac1-f60ec5abb7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:04.632180 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff891374-e329-4662-aac1-f60ec5abb7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:04.632611 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff891374-e329-4662-aac1-f60ec5abb7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:04.632883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff891374-e329-4662-aac1-f60ec5abb7d3 admin admin] PATH_INFO: `/v3/projects/99fcee71c3084bf4b0a2cacab67d4859` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:04.639073 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff891374-e329-4662-aac1-f60ec5abb7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99fcee71c3084bf4b0a2cacab67d4859)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:04.641704 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff891374-e329-4662-aac1-f60ec5abb7d3 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:04.748765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ef8f4b75-4fa7-4943-8430-4d994126f61c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63d5756d22d94abba55389b461f813d0'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:04.750148 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ef8f4b75-4fa7-4943-8430-4d994126f61c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63d5756d22d94abba55389b461f813d0'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:04.751377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ef8f4b75-4fa7-4943-8430-4d994126f61c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63d5756d22d94abba55389b461f813d0'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:04.798841 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-ff891374-e329-4662-aac1-f60ec5abb7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99fcee71c3084bf4b0a2cacab67d4859', 'request_id': 'req-ff891374-e329-4662-aac1-f60ec5abb7d3'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:04.807759 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-ff891374-e329-4662-aac1-f60ec5abb7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99fcee71c3084bf4b0a2cacab67d4859', 'request_id': 'req-ff891374-e329-4662-aac1-f60ec5abb7d3'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:04.816047 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-ff891374-e329-4662-aac1-f60ec5abb7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99fcee71c3084bf4b0a2cacab67d4859', 'request_id': 'req-ff891374-e329-4662-aac1-f60ec5abb7d3'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:04.838667 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ef8f4b75-4fa7-4943-8430-4d994126f61c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63d5756d22d94abba55389b461f813d0'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:04.846106 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ef8f4b75-4fa7-4943-8430-4d994126f61c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63d5756d22d94abba55389b461f813d0'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:04.864401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 931/1868] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:04 2022] DELETE /identity/v3/users/63d5756d22d94abba55389b461f813d0 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:18:04.865301 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f4b75-4fa7-4943-8430-4d994126f61c admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:04.867977 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-ef8f4b75-4fa7-4943-8430-4d994126f61c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:04.946023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-ff891374-e329-4662-aac1-f60ec5abb7d3 admin admin] The token cache is being invalidate because project 99fcee71c3084bf4b0a2cacab67d4859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:04.947026 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-ff891374-e329-4662-aac1-f60ec5abb7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:04.948301 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-ff891374-e329-4662-aac1-f60ec5abb7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:04.950902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 938/1869] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:04 2022] DELETE /identity/v3/projects/99fcee71c3084bf4b0a2cacab67d4859 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:04.958634 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff891374-e329-4662-aac1-f60ec5abb7d3 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:04.960464 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-ff891374-e329-4662-aac1-f60ec5abb7d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:04.973615 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f4b75-4fa7-4943-8430-4d994126f61c admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:04.979963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f701c-590a-4955-bd32-3527c6303532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:04.980866 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f701c-590a-4955-bd32-3527c6303532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:04.981300 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f701c-590a-4955-bd32-3527c6303532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:04.981722 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f701c-590a-4955-bd32-3527c6303532 admin admin] PATH_INFO: `/v3/users/e6f902a943f845c3a6d1d0066fb12d78` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:04.983078 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f701c-590a-4955-bd32-3527c6303532 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6f902a943f845c3a6d1d0066fb12d78)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:04.985925 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f701c-590a-4955-bd32-3527c6303532 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:05.038385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff891374-e329-4662-aac1-f60ec5abb7d3 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:05.044130 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bb5b9-fe5d-4237-b94a-b17b6f7563b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:05.044758 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bb5b9-fe5d-4237-b94a-b17b6f7563b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:05.045041 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bb5b9-fe5d-4237-b94a-b17b6f7563b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:05.045317 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bb5b9-fe5d-4237-b94a-b17b6f7563b9 admin admin] PATH_INFO: `/v3/users/992c717e649c46e2a339095a93019d39` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:05.046485 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0bb5b9-fe5d-4237-b94a-b17b6f7563b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=992c717e649c46e2a339095a93019d39)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:05.048407 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0bb5b9-fe5d-4237-b94a-b17b6f7563b9 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:05.183931 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-2e6f701c-590a-4955-bd32-3527c6303532 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6f902a943f845c3a6d1d0066fb12d78'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:05.184619 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-2e6f701c-590a-4955-bd32-3527c6303532 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6f902a943f845c3a6d1d0066fb12d78'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:05.185249 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-2e6f701c-590a-4955-bd32-3527c6303532 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6f902a943f845c3a6d1d0066fb12d78'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:05.280589 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2f0bb5b9-fe5d-4237-b94a-b17b6f7563b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '992c717e649c46e2a339095a93019d39'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:05.281263 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2f0bb5b9-fe5d-4237-b94a-b17b6f7563b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '992c717e649c46e2a339095a93019d39'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:05.281868 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2f0bb5b9-fe5d-4237-b94a-b17b6f7563b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '992c717e649c46e2a339095a93019d39'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:05.296444 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-2e6f701c-590a-4955-bd32-3527c6303532 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6f902a943f845c3a6d1d0066fb12d78'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:05.304869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-2e6f701c-590a-4955-bd32-3527c6303532 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6f902a943f845c3a6d1d0066fb12d78'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:05.327179 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 932/1870] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:04 2022] DELETE /identity/v3/users/e6f902a943f845c3a6d1d0066fb12d78 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:05.327179 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f701c-590a-4955-bd32-3527c6303532 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:05.330930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-2e6f701c-590a-4955-bd32-3527c6303532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:05.383036 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2f0bb5b9-fe5d-4237-b94a-b17b6f7563b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '992c717e649c46e2a339095a93019d39'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:05.402523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2f0bb5b9-fe5d-4237-b94a-b17b6f7563b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '992c717e649c46e2a339095a93019d39'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:05.410101 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f701c-590a-4955-bd32-3527c6303532 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:05.416542 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b38ded-a492-4e65-9a14-47d986e79196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:05.417309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b38ded-a492-4e65-9a14-47d986e79196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:05.417661 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b38ded-a492-4e65-9a14-47d986e79196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:05.420652 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b38ded-a492-4e65-9a14-47d986e79196 admin admin] PATH_INFO: `/v3/projects/c9c24e82390c4581aeb87ae1cc7a520a` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:05.420652 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b38ded-a492-4e65-9a14-47d986e79196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9c24e82390c4581aeb87ae1cc7a520a)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:05.421311 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b38ded-a492-4e65-9a14-47d986e79196 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:05.426487 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 939/1871] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:04 2022] DELETE /identity/v3/users/992c717e649c46e2a339095a93019d39 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:05.431893 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f21bb7-fbd8-4c2b-b05e-d8c042ebd810 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:05.432867 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f21bb7-fbd8-4c2b-b05e-d8c042ebd810 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:05.433238 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f21bb7-fbd8-4c2b-b05e-d8c042ebd810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:05.456794 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-c2f21bb7-fbd8-4c2b-b05e-d8c042ebd810 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:05.458023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c2f21bb7-fbd8-4c2b-b05e-d8c042ebd810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:05.532105 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 940/1872] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:05.533096 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f21bb7-fbd8-4c2b-b05e-d8c042ebd810 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:05.534519 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c2f21bb7-fbd8-4c2b-b05e-d8c042ebd810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:05.553290 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f21bb7-fbd8-4c2b-b05e-d8c042ebd810 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:05.565135 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-17b38ded-a492-4e65-9a14-47d986e79196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9c24e82390c4581aeb87ae1cc7a520a', 'request_id': 'req-17b38ded-a492-4e65-9a14-47d986e79196'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:05.570482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-17b38ded-a492-4e65-9a14-47d986e79196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9c24e82390c4581aeb87ae1cc7a520a', 'request_id': 'req-17b38ded-a492-4e65-9a14-47d986e79196'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:05.576577 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-17b38ded-a492-4e65-9a14-47d986e79196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9c24e82390c4581aeb87ae1cc7a520a', 'request_id': 'req-17b38ded-a492-4e65-9a14-47d986e79196'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:05.612432 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b6616-9959-47a7-bc83-767cdf7f26bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:05.612432 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b6616-9959-47a7-bc83-767cdf7f26bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:05.612833 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b6616-9959-47a7-bc83-767cdf7f26bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:05.612950 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b6616-9959-47a7-bc83-767cdf7f26bc admin admin] PATH_INFO: `/v3/projects/7b88c0a76a904dbe9b261b7786869be5` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:05.614038 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b6616-9959-47a7-bc83-767cdf7f26bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b88c0a76a904dbe9b261b7786869be5)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:05.616428 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b6616-9959-47a7-bc83-767cdf7f26bc admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:05.660364 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-17b38ded-a492-4e65-9a14-47d986e79196 admin admin] The token cache is being invalidate because project c9c24e82390c4581aeb87ae1cc7a520a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:05.660658 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-17b38ded-a492-4e65-9a14-47d986e79196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:05.661404 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-17b38ded-a492-4e65-9a14-47d986e79196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:05.663283 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 933/1873] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:05 2022] DELETE /identity/v3/projects/c9c24e82390c4581aeb87ae1cc7a520a => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:05.664250 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b38ded-a492-4e65-9a14-47d986e79196 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:05.665921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-17b38ded-a492-4e65-9a14-47d986e79196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:05.727796 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b38ded-a492-4e65-9a14-47d986e79196 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:05.731763 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ee267-bb99-44df-abe0-a220a9b42990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:05.732443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ee267-bb99-44df-abe0-a220a9b42990 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:05.732905 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ee267-bb99-44df-abe0-a220a9b42990 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:05.733253 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ee267-bb99-44df-abe0-a220a9b42990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:05.735104 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a01ee267-bb99-44df-abe0-a220a9b42990 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:05.747681 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ee267-bb99-44df-abe0-a220a9b42990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:05.749206 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ee267-bb99-44df-abe0-a220a9b42990 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:05.761456 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 934/1874] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:05.764297 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40813c3d-8be1-4fd8-bc58-9b513b1cc1a3 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:05.764297 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40813c3d-8be1-4fd8-bc58-9b513b1cc1a3 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:05.764297 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40813c3d-8be1-4fd8-bc58-9b513b1cc1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:05.779120 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-cd1b6616-9959-47a7-bc83-767cdf7f26bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b88c0a76a904dbe9b261b7786869be5', 'request_id': 'req-cd1b6616-9959-47a7-bc83-767cdf7f26bc'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:05.783254 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-40813c3d-8be1-4fd8-bc58-9b513b1cc1a3 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:05.784514 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-40813c3d-8be1-4fd8-bc58-9b513b1cc1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:05.787452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-cd1b6616-9959-47a7-bc83-767cdf7f26bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b88c0a76a904dbe9b261b7786869be5', 'request_id': 'req-cd1b6616-9959-47a7-bc83-767cdf7f26bc'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:05.796878 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-cd1b6616-9959-47a7-bc83-767cdf7f26bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b88c0a76a904dbe9b261b7786869be5', 'request_id': 'req-cd1b6616-9959-47a7-bc83-767cdf7f26bc'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:05.849602 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 935/1875] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:05.857464 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc5425-eb13-47a4-bc5a-3d35ebd34d4b None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:05.857747 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc5425-eb13-47a4-bc5a-3d35ebd34d4b None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:05.858027 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc5425-eb13-47a4-bc5a-3d35ebd34d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:05.877533 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-c9fc5425-eb13-47a4-bc5a-3d35ebd34d4b None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:05.878896 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-c9fc5425-eb13-47a4-bc5a-3d35ebd34d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:05.884537 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-cd1b6616-9959-47a7-bc83-767cdf7f26bc admin admin] The token cache is being invalidate because project 7b88c0a76a904dbe9b261b7786869be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:05.884834 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-cd1b6616-9959-47a7-bc83-767cdf7f26bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:05.885652 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-cd1b6616-9959-47a7-bc83-767cdf7f26bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:05.887925 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 941/1876] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:05 2022] DELETE /identity/v3/projects/7b88c0a76a904dbe9b261b7786869be5 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:05.891431 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 936/1877] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:18:05.892516 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe2471-861d-4f6e-86c8-e8419df2e9e9 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:05.892800 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe2471-861d-4f6e-86c8-e8419df2e9e9 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:05.893100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe2471-861d-4f6e-86c8-e8419df2e9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:05.895923 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc5425-eb13-47a4-bc5a-3d35ebd34d4b None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:05.898990 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:05.906254 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc5425-eb13-47a4-bc5a-3d35ebd34d4b None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:05.911615 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be690d74-7d41-431f-8d81-2de28b04c5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:05.912362 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be690d74-7d41-431f-8d81-2de28b04c5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:05.912741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be690d74-7d41-431f-8d81-2de28b04c5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:05.913122 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be690d74-7d41-431f-8d81-2de28b04c5f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:05.913912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be690d74-7d41-431f-8d81-2de28b04c5f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:18:05.914324 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be690d74-7d41-431f-8d81-2de28b04c5f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:05.916102 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be690d74-7d41-431f-8d81-2de28b04c5f8 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:05.918765 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-79fe2471-861d-4f6e-86c8-e8419df2e9e9 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:05.920052 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-79fe2471-861d-4f6e-86c8-e8419df2e9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:05.929222 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 937/1878] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 08:18:05.931116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 942/1879] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:05.933601 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be690d74-7d41-431f-8d81-2de28b04c5f8 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:05.938047 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-be690d74-7d41-431f-8d81-2de28b04c5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:05.939127 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65775429-d9dd-4e9f-bc4a-5bf25f5bd00e None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:05.940007 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65775429-d9dd-4e9f-bc4a-5bf25f5bd00e None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:05.941042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65775429-d9dd-4e9f-bc4a-5bf25f5bd00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:05.953455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be690d74-7d41-431f-8d81-2de28b04c5f8 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:05.958524 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa63cfb-6f2b-44d4-b281-c10013d0eff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:05.959241 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa63cfb-6f2b-44d4-b281-c10013d0eff6 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:05.959719 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa63cfb-6f2b-44d4-b281-c10013d0eff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:05.960156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa63cfb-6f2b-44d4-b281-c10013d0eff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:05.961488 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa63cfb-6f2b-44d4-b281-c10013d0eff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:05.962361 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-65775429-d9dd-4e9f-bc4a-5bf25f5bd00e None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:05.963648 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa63cfb-6f2b-44d4-b281-c10013d0eff6 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:05.963766 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-65775429-d9dd-4e9f-bc4a-5bf25f5bd00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:05.973250 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 943/1880] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:05.977288 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65775429-d9dd-4e9f-bc4a-5bf25f5bd00e None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:05.987681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65775429-d9dd-4e9f-bc4a-5bf25f5bd00e None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:05.993499 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3919d80-cf03-4686-b5a6-80d63a5a532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:05.995255 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3919d80-cf03-4686-b5a6-80d63a5a532d admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:05.995917 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3919d80-cf03-4686-b5a6-80d63a5a532d admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:05.996259 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3919d80-cf03-4686-b5a6-80d63a5a532d admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:05.997102 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3919d80-cf03-4686-b5a6-80d63a5a532d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:18:05.997663 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3919d80-cf03-4686-b5a6-80d63a5a532d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:05.999909 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3919d80-cf03-4686-b5a6-80d63a5a532d admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:06.022422 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 944/1881] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:18:06.024108 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3919d80-cf03-4686-b5a6-80d63a5a532d admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:06.026822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-a3919d80-cf03-4686-b5a6-80d63a5a532d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:06.040587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3919d80-cf03-4686-b5a6-80d63a5a532d admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:06.045183 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e020b5-ac6f-45e1-b4ee-cbfe9586feb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:06.045813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e020b5-ac6f-45e1-b4ee-cbfe9586feb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:06.046091 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e020b5-ac6f-45e1-b4ee-cbfe9586feb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:06.046398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e020b5-ac6f-45e1-b4ee-cbfe9586feb9 admin admin] PATH_INFO: `/v3/projects/e640a5648f6c475ea226fc470ce84a63` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:06.047497 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e020b5-ac6f-45e1-b4ee-cbfe9586feb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e640a5648f6c475ea226fc470ce84a63)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:06.049474 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e020b5-ac6f-45e1-b4ee-cbfe9586feb9 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:06.101322 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 938/1882] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:18:05 2022] POST /identity/v3/projects => generated 367 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:18:06.101322 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa63cfb-6f2b-44d4-b281-c10013d0eff6 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:06.190001 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa63cfb-6f2b-44d4-b281-c10013d0eff6 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:06.202398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-57e020b5-ac6f-45e1-b4ee-cbfe9586feb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e640a5648f6c475ea226fc470ce84a63', 'request_id': 'req-57e020b5-ac6f-45e1-b4ee-cbfe9586feb9'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:06.208790 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-57e020b5-ac6f-45e1-b4ee-cbfe9586feb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e640a5648f6c475ea226fc470ce84a63', 'request_id': 'req-57e020b5-ac6f-45e1-b4ee-cbfe9586feb9'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:06.217350 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-57e020b5-ac6f-45e1-b4ee-cbfe9586feb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e640a5648f6c475ea226fc470ce84a63', 'request_id': 'req-57e020b5-ac6f-45e1-b4ee-cbfe9586feb9'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:06.261929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45423958-bd05-4fb5-8999-0904afcabce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:06.262587 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45423958-bd05-4fb5-8999-0904afcabce3 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:06.262867 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45423958-bd05-4fb5-8999-0904afcabce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:06.263135 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45423958-bd05-4fb5-8999-0904afcabce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:06.263754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45423958-bd05-4fb5-8999-0904afcabce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:06.265684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45423958-bd05-4fb5-8999-0904afcabce3 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:06.301527 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-57e020b5-ac6f-45e1-b4ee-cbfe9586feb9 admin admin] The token cache is being invalidate because project e640a5648f6c475ea226fc470ce84a63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:06.301840 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-57e020b5-ac6f-45e1-b4ee-cbfe9586feb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:06.302499 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-57e020b5-ac6f-45e1-b4ee-cbfe9586feb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:06.304025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 945/1883] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:06 2022] DELETE /identity/v3/projects/e640a5648f6c475ea226fc470ce84a63 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:06.305495 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e020b5-ac6f-45e1-b4ee-cbfe9586feb9 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:06.306860 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-57e020b5-ac6f-45e1-b4ee-cbfe9586feb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:06.319400 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e020b5-ac6f-45e1-b4ee-cbfe9586feb9 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:06.324869 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694f414-c1c8-44c9-87c5-eadbe3f7065c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:06.330752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694f414-c1c8-44c9-87c5-eadbe3f7065c admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:06.330752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694f414-c1c8-44c9-87c5-eadbe3f7065c admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:06.330752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694f414-c1c8-44c9-87c5-eadbe3f7065c admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:06.330752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4694f414-c1c8-44c9-87c5-eadbe3f7065c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:06.330752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4694f414-c1c8-44c9-87c5-eadbe3f7065c admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:06.381123 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 939/1884] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:18:06 2022] POST /identity/v3/projects => generated 387 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:06.382491 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f2f9b-6e91-408e-9bd7-21e5ab58d0e2 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:06.383477 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f2f9b-6e91-408e-9bd7-21e5ab58d0e2 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:06.383883 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f2f9b-6e91-408e-9bd7-21e5ab58d0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:06.402944 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-629f2f9b-6e91-408e-9bd7-21e5ab58d0e2 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:06.404157 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-629f2f9b-6e91-408e-9bd7-21e5ab58d0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:06.407260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:06.416902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 946/1885] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:18:06 2022] POST /identity/v3/users => generated 284 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:06.419691 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694f414-c1c8-44c9-87c5-eadbe3f7065c admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:06.421563 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-4694f414-c1c8-44c9-87c5-eadbe3f7065c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:06.435084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694f414-c1c8-44c9-87c5-eadbe3f7065c admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:06.497132 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 940/1886] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:06.498006 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f2f9b-6e91-408e-9bd7-21e5ab58d0e2 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:06.504743 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-629f2f9b-6e91-408e-9bd7-21e5ab58d0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:06.514891 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcfffb-527d-4fdb-9be5-450e83e2b7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:06.515644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcfffb-527d-4fdb-9be5-450e83e2b7a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:06.516068 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcfffb-527d-4fdb-9be5-450e83e2b7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:06.516447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcfffb-527d-4fdb-9be5-450e83e2b7a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:06.517183 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcfffb-527d-4fdb-9be5-450e83e2b7a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:06.517506 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f2f9b-6e91-408e-9bd7-21e5ab58d0e2 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:06.519534 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcfffb-527d-4fdb-9be5-450e83e2b7a7 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:06.522205 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9c87d-ba90-4e32-a576-3b818cfad3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:06.522869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9c87d-ba90-4e32-a576-3b818cfad3c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:06.523207 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9c87d-ba90-4e32-a576-3b818cfad3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:06.523517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9c87d-ba90-4e32-a576-3b818cfad3c4 admin admin] PATH_INFO: `/v3/projects/d4e947c89a8342fb9fa2df59b7fa68bf` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:06.524788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9c87d-ba90-4e32-a576-3b818cfad3c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4e947c89a8342fb9fa2df59b7fa68bf)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:06.526740 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9c87d-ba90-4e32-a576-3b818cfad3c4 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:06.664242 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 947/1887] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:18:06 2022] POST /identity/v3/users => generated 294 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:06.665899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcfffb-527d-4fdb-9be5-450e83e2b7a7 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:06.677792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcfffb-527d-4fdb-9be5-450e83e2b7a7 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:06.685008 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369e0e9-948e-4db0-a159-4e86e80ea270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:06.685919 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369e0e9-948e-4db0-a159-4e86e80ea270 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:06.686322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369e0e9-948e-4db0-a159-4e86e80ea270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:06.686798 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369e0e9-948e-4db0-a159-4e86e80ea270 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:06.687632 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369e0e9-948e-4db0-a159-4e86e80ea270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:06.695100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369e0e9-948e-4db0-a159-4e86e80ea270 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:06.715188 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 948/1888] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:06.716715 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206b02a-f9c2-4d0a-911f-a76c78f4371d None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:06.717135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206b02a-f9c2-4d0a-911f-a76c78f4371d None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:06.717252 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-69f9c87d-ba90-4e32-a576-3b818cfad3c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4e947c89a8342fb9fa2df59b7fa68bf', 'request_id': 'req-69f9c87d-ba90-4e32-a576-3b818cfad3c4'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:06.717615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206b02a-f9c2-4d0a-911f-a76c78f4371d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:06.724947 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-69f9c87d-ba90-4e32-a576-3b818cfad3c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4e947c89a8342fb9fa2df59b7fa68bf', 'request_id': 'req-69f9c87d-ba90-4e32-a576-3b818cfad3c4'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:06.733029 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-69f9c87d-ba90-4e32-a576-3b818cfad3c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4e947c89a8342fb9fa2df59b7fa68bf', 'request_id': 'req-69f9c87d-ba90-4e32-a576-3b818cfad3c4'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:06.752504 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-5206b02a-f9c2-4d0a-911f-a76c78f4371d None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:06.753876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-5206b02a-f9c2-4d0a-911f-a76c78f4371d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:06.816036 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-69f9c87d-ba90-4e32-a576-3b818cfad3c4 admin admin] The token cache is being invalidate because project d4e947c89a8342fb9fa2df59b7fa68bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:06.821241 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-69f9c87d-ba90-4e32-a576-3b818cfad3c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:06.821241 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-69f9c87d-ba90-4e32-a576-3b818cfad3c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:06.821241 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 941/1889] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:06 2022] DELETE /identity/v3/projects/d4e947c89a8342fb9fa2df59b7fa68bf => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:06.821241 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9c87d-ba90-4e32-a576-3b818cfad3c4 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:06.823280 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 949/1890] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:06.823376 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-69f9c87d-ba90-4e32-a576-3b818cfad3c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:06.823900 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206b02a-f9c2-4d0a-911f-a76c78f4371d None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:06.833480 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206b02a-f9c2-4d0a-911f-a76c78f4371d None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:06.834952 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9c87d-ba90-4e32-a576-3b818cfad3c4 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:06.838623 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4327f5e-a662-487d-945d-4a5595e2db20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:06.839280 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4327f5e-a662-487d-945d-4a5595e2db20 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:06.839565 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4327f5e-a662-487d-945d-4a5595e2db20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:06.839839 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4327f5e-a662-487d-945d-4a5595e2db20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:06.840502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4327f5e-a662-487d-945d-4a5595e2db20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:06.840823 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d250a4-dd2e-4c43-ab89-7a2a901fe14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:06.841609 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d250a4-dd2e-4c43-ab89-7a2a901fe14b admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:06.841960 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d250a4-dd2e-4c43-ab89-7a2a901fe14b admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:06.842322 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d250a4-dd2e-4c43-ab89-7a2a901fe14b admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:06.842759 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4327f5e-a662-487d-945d-4a5595e2db20 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:06.843249 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d250a4-dd2e-4c43-ab89-7a2a901fe14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:06.846007 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d250a4-dd2e-4c43-ab89-7a2a901fe14b admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:06.856834 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 950/1891] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:06.856834 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4327f5e-a662-487d-945d-4a5595e2db20 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:06.857092 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 942/1892] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:06.857092 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d250a4-dd2e-4c43-ab89-7a2a901fe14b admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:06.858405 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-c9d250a4-dd2e-4c43-ab89-7a2a901fe14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:06.860049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-a4327f5e-a662-487d-945d-4a5595e2db20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:06.872973 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d250a4-dd2e-4c43-ab89-7a2a901fe14b admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:06.875514 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4327f5e-a662-487d-945d-4a5595e2db20 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:06.877996 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215df64-b6d4-4642-a186-2f6bdad78cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:06.878642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215df64-b6d4-4642-a186-2f6bdad78cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:06.878919 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215df64-b6d4-4642-a186-2f6bdad78cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:06.879276 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215df64-b6d4-4642-a186-2f6bdad78cb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:06.879929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215df64-b6d4-4642-a186-2f6bdad78cb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:18:06.880232 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215df64-b6d4-4642-a186-2f6bdad78cb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:06.880402 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee85212-13ce-4eb1-82b5-d470dd1d5bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:06.881195 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee85212-13ce-4eb1-82b5-d470dd1d5bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:06.881478 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee85212-13ce-4eb1-82b5-d470dd1d5bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:06.881749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee85212-13ce-4eb1-82b5-d470dd1d5bb8 admin admin] PATH_INFO: `/v3/users/c65daf5be39e4e6fac7e4bc73022dd2e` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:06.882381 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215df64-b6d4-4642-a186-2f6bdad78cb9 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:06.883579 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee85212-13ce-4eb1-82b5-d470dd1d5bb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c65daf5be39e4e6fac7e4bc73022dd2e)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:06.885903 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee85212-13ce-4eb1-82b5-d470dd1d5bb8 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:06.898434 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 943/1893] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:18:06.898434 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215df64-b6d4-4642-a186-2f6bdad78cb9 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:06.900850 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-3215df64-b6d4-4642-a186-2f6bdad78cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:06.920031 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215df64-b6d4-4642-a186-2f6bdad78cb9 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:06.920031 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c028c-fe6e-48e2-b8ab-a30c181f6fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:06.920632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c028c-fe6e-48e2-b8ab-a30c181f6fec admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:06.920939 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c028c-fe6e-48e2-b8ab-a30c181f6fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:06.921215 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c028c-fe6e-48e2-b8ab-a30c181f6fec admin admin] PATH_INFO: `/v3/projects/cad7b646879f4bee8563b746a7587c83/users/b53df0798c7947b89f1f5dc093199c23/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:06.936712 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c028c-fe6e-48e2-b8ab-a30c181f6fec admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad7b646879f4bee8563b746a7587c83, user_id=b53df0798c7947b89f1f5dc093199c23, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:06.939611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c028c-fe6e-48e2-b8ab-a30c181f6fec admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:07.025991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 944/1894] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:06 2022] PUT /identity/v3/projects/cad7b646879f4bee8563b746a7587c83/users/b53df0798c7947b89f1f5dc093199c23/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:07.029544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c028c-fe6e-48e2-b8ab-a30c181f6fec admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:07.090916 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c028c-fe6e-48e2-b8ab-a30c181f6fec admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:07.095624 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e166f3c-bb06-4ede-9283-a76234d248c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:07.096233 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e166f3c-bb06-4ede-9283-a76234d248c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:07.096517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e166f3c-bb06-4ede-9283-a76234d248c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:07.096790 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e166f3c-bb06-4ede-9283-a76234d248c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:07.097423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e166f3c-bb06-4ede-9283-a76234d248c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:07.099101 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e166f3c-bb06-4ede-9283-a76234d248c0 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:07.109177 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 945/1895] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:07.110003 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e166f3c-bb06-4ede-9283-a76234d248c0 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:07.121115 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e166f3c-bb06-4ede-9283-a76234d248c0 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:07.127410 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087d106-bb53-454b-aba4-25db36602236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:07.128104 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087d106-bb53-454b-aba4-25db36602236 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:07.128447 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087d106-bb53-454b-aba4-25db36602236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:07.128821 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087d106-bb53-454b-aba4-25db36602236 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:07.129509 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087d106-bb53-454b-aba4-25db36602236 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:07.131601 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087d106-bb53-454b-aba4-25db36602236 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:07.134166 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2ee85212-13ce-4eb1-82b5-d470dd1d5bb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c65daf5be39e4e6fac7e4bc73022dd2e'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:07.134865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2ee85212-13ce-4eb1-82b5-d470dd1d5bb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c65daf5be39e4e6fac7e4bc73022dd2e'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:07.135477 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2ee85212-13ce-4eb1-82b5-d470dd1d5bb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c65daf5be39e4e6fac7e4bc73022dd2e'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:07.284866 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2ee85212-13ce-4eb1-82b5-d470dd1d5bb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c65daf5be39e4e6fac7e4bc73022dd2e'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:07.303875 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2ee85212-13ce-4eb1-82b5-d470dd1d5bb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c65daf5be39e4e6fac7e4bc73022dd2e'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:07.327183 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 951/1896] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:06 2022] DELETE /identity/v3/users/c65daf5be39e4e6fac7e4bc73022dd2e => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:07.329686 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b2037-b087-41a2-a93e-4f5af8fc1bae None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:07.330729 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b2037-b087-41a2-a93e-4f5af8fc1bae None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:07.338926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 946/1897] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:18:07 2022] POST /identity/v3/projects => generated 379 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:07.340042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087d106-bb53-454b-aba4-25db36602236 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:07.342442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-0087d106-bb53-454b-aba4-25db36602236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:07.343049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b2037-b087-41a2-a93e-4f5af8fc1bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:07.407235 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-bf7b2037-b087-41a2-a93e-4f5af8fc1bae None None] MFA Rules not processed for user `b53df0798c7947b89f1f5dc093199c23`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:07.409594 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-bf7b2037-b087-41a2-a93e-4f5af8fc1bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:07.477314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087d106-bb53-454b-aba4-25db36602236 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:07.483338 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f5106-fa64-4d9b-895b-decacbd0c7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:07.484162 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f5106-fa64-4d9b-895b-decacbd0c7a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:07.484545 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f5106-fa64-4d9b-895b-decacbd0c7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:07.484923 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f5106-fa64-4d9b-895b-decacbd0c7a9 admin admin] PATH_INFO: `/v3/projects/d06cac7a0ab746b7bb2abcb511067817/users/ca1ad9e6eac34dd89aafce007e691d01/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:07.501668 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 952/1898] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:07.502609 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b2037-b087-41a2-a93e-4f5af8fc1bae None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:07.506756 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-bf7b2037-b087-41a2-a93e-4f5af8fc1bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:07.508734 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f5106-fa64-4d9b-895b-decacbd0c7a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d06cac7a0ab746b7bb2abcb511067817, user_id=ca1ad9e6eac34dd89aafce007e691d01, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:07.511856 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f5106-fa64-4d9b-895b-decacbd0c7a9 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:07.520574 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b2037-b087-41a2-a93e-4f5af8fc1bae None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:07.525891 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b1136-1d52-4b13-83b1-fa64cc99127e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:07.526528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b1136-1d52-4b13-83b1-fa64cc99127e admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:07.526813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b1136-1d52-4b13-83b1-fa64cc99127e admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:07.527091 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b1136-1d52-4b13-83b1-fa64cc99127e admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:07.527713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b1136-1d52-4b13-83b1-fa64cc99127e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:07.529744 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b1136-1d52-4b13-83b1-fa64cc99127e admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:07.624304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 947/1899] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:07 2022] PUT /identity/v3/projects/d06cac7a0ab746b7bb2abcb511067817/users/ca1ad9e6eac34dd89aafce007e691d01/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:07.624763 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 953/1900] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:18:07 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:07.625440 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f5106-fa64-4d9b-895b-decacbd0c7a9 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:07.627827 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-e66f5106-fa64-4d9b-895b-decacbd0c7a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:07.629003 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b1136-1d52-4b13-83b1-fa64cc99127e admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:07.640302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b1136-1d52-4b13-83b1-fa64cc99127e admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:07.703500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f5106-fa64-4d9b-895b-decacbd0c7a9 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:07.708661 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3e097-7699-4462-ba2f-cc55686b69a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:07.709356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3e097-7699-4462-ba2f-cc55686b69a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:07.709706 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3e097-7699-4462-ba2f-cc55686b69a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:07.710068 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3e097-7699-4462-ba2f-cc55686b69a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:07.710810 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3e097-7699-4462-ba2f-cc55686b69a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:07.713912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3e097-7699-4462-ba2f-cc55686b69a4 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:07.723386 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0114b-2188-4341-9d96-906bb24e9198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:07.724010 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0114b-2188-4341-9d96-906bb24e9198 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:07.724293 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0114b-2188-4341-9d96-906bb24e9198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:07.729032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0114b-2188-4341-9d96-906bb24e9198 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:07.729032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0114b-2188-4341-9d96-906bb24e9198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:07.729032 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0114b-2188-4341-9d96-906bb24e9198 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:07.739415 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 954/1901] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:18:07.740696 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f435edc-5b36-4155-a6cc-60f20d51c638 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:07.740987 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f435edc-5b36-4155-a6cc-60f20d51c638 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:07.741294 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f435edc-5b36-4155-a6cc-60f20d51c638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:07.772141 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-3f435edc-5b36-4155-a6cc-60f20d51c638 None None] MFA Rules not processed for user `ca1ad9e6eac34dd89aafce007e691d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:07.773425 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-3f435edc-5b36-4155-a6cc-60f20d51c638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:07.847512 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 948/1902] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:18:07 2022] POST /identity/v3/projects => generated 367 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:07.848590 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 955/1903] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:07.852940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3e097-7699-4462-ba2f-cc55686b69a4 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:07.854996 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f435edc-5b36-4155-a6cc-60f20d51c638 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:07.868825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f435edc-5b36-4155-a6cc-60f20d51c638 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:07.929735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3e097-7699-4462-ba2f-cc55686b69a4 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:07.935425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689188a5-ca3b-4312-a20e-07d39ea74c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:07.936307 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689188a5-ca3b-4312-a20e-07d39ea74c17 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:07.936624 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689188a5-ca3b-4312-a20e-07d39ea74c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:07.936902 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689188a5-ca3b-4312-a20e-07d39ea74c17 admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:07.937528 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689188a5-ca3b-4312-a20e-07d39ea74c17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:07.939647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689188a5-ca3b-4312-a20e-07d39ea74c17 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:07.942689 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06baab3-fa24-4b84-a05b-5522bd2f0dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:07.944325 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06baab3-fa24-4b84-a05b-5522bd2f0dcf admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:07.944726 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06baab3-fa24-4b84-a05b-5522bd2f0dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:07.946204 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06baab3-fa24-4b84-a05b-5522bd2f0dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:07.946977 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06baab3-fa24-4b84-a05b-5522bd2f0dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:07.949859 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06baab3-fa24-4b84-a05b-5522bd2f0dcf admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:07.967555 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 956/1904] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:07.967555 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06baab3-fa24-4b84-a05b-5522bd2f0dcf admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:07.976535 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06baab3-fa24-4b84-a05b-5522bd2f0dcf admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:07.981114 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d77dee-e52a-4be4-98f2-3ce637c8974c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:07.981719 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d77dee-e52a-4be4-98f2-3ce637c8974c admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:07.982000 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d77dee-e52a-4be4-98f2-3ce637c8974c admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:07.982274 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d77dee-e52a-4be4-98f2-3ce637c8974c admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:07.982915 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d77dee-e52a-4be4-98f2-3ce637c8974c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:07.984859 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d77dee-e52a-4be4-98f2-3ce637c8974c admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:08.036332 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 949/1905] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:18:07 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:08.037752 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689188a5-ca3b-4312-a20e-07d39ea74c17 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:08.039208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-689188a5-ca3b-4312-a20e-07d39ea74c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:08.054067 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689188a5-ca3b-4312-a20e-07d39ea74c17 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:08.058917 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15fa19-fe31-4924-a942-7b201505cf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:08.059546 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15fa19-fe31-4924-a942-7b201505cf75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:08.059825 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15fa19-fe31-4924-a942-7b201505cf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:08.060096 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15fa19-fe31-4924-a942-7b201505cf75 admin admin] PATH_INFO: `/v3/projects/b86063cb451242eaa0603c1361809e77` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:08.061183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15fa19-fe31-4924-a942-7b201505cf75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b86063cb451242eaa0603c1361809e77)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:08.063109 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15fa19-fe31-4924-a942-7b201505cf75 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:08.098100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 957/1906] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:18:07 2022] POST /identity/v3/projects => generated 389 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:08.099010 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d77dee-e52a-4be4-98f2-3ce637c8974c admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:08.120038 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:INSERT=4,keystone:SELECT=91,keystone:DELETE=5 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:08.159976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d77dee-e52a-4be4-98f2-3ce637c8974c admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:08.165473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c7c3b-d933-44f5-b8f5-48f6d02b8c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:08.166262 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c7c3b-d933-44f5-b8f5-48f6d02b8c3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:08.166586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c7c3b-d933-44f5-b8f5-48f6d02b8c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:08.166939 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c7c3b-d933-44f5-b8f5-48f6d02b8c3c admin admin] PATH_INFO: `/v3/projects/095d969cfbcc4c428a3d1855d00d6508/users/0851b12afabe41d1b41006976b844a58/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:08.181353 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c7c3b-d933-44f5-b8f5-48f6d02b8c3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=095d969cfbcc4c428a3d1855d00d6508, user_id=0851b12afabe41d1b41006976b844a58, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:08.184041 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c7c3b-d933-44f5-b8f5-48f6d02b8c3c admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:08.288154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 958/1907] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:08 2022] PUT /identity/v3/projects/095d969cfbcc4c428a3d1855d00d6508/users/0851b12afabe41d1b41006976b844a58/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:08.289452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c7c3b-d933-44f5-b8f5-48f6d02b8c3c admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:08.304254 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ab15fa19-fe31-4924-a942-7b201505cf75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b86063cb451242eaa0603c1361809e77', 'request_id': 'req-ab15fa19-fe31-4924-a942-7b201505cf75'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:08.311089 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ab15fa19-fe31-4924-a942-7b201505cf75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b86063cb451242eaa0603c1361809e77', 'request_id': 'req-ab15fa19-fe31-4924-a942-7b201505cf75'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:08.320218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ab15fa19-fe31-4924-a942-7b201505cf75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b86063cb451242eaa0603c1361809e77', 'request_id': 'req-ab15fa19-fe31-4924-a942-7b201505cf75'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:08.355868 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c7c3b-d933-44f5-b8f5-48f6d02b8c3c admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:08.412004 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59cc00-9382-4833-83d9-91d2ee0e2cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:08.412691 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59cc00-9382-4833-83d9-91d2ee0e2cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:08.412997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59cc00-9382-4833-83d9-91d2ee0e2cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:08.413306 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59cc00-9382-4833-83d9-91d2ee0e2cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:08.413949 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59cc00-9382-4833-83d9-91d2ee0e2cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:08.416485 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59cc00-9382-4833-83d9-91d2ee0e2cc7 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:08.417242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ab15fa19-fe31-4924-a942-7b201505cf75 admin admin] The token cache is being invalidate because project b86063cb451242eaa0603c1361809e77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:08.417715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ab15fa19-fe31-4924-a942-7b201505cf75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:08.424084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ab15fa19-fe31-4924-a942-7b201505cf75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:08.424084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 950/1908] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:08 2022] DELETE /identity/v3/projects/b86063cb451242eaa0603c1361809e77 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:08.424084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15fa19-fe31-4924-a942-7b201505cf75 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:08.424377 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:08.425363 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-ab15fa19-fe31-4924-a942-7b201505cf75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:08.432673 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 959/1909] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:08.432673 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fa4be-69d3-4249-b2fe-f62ed7af6ca0 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:08.432673 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fa4be-69d3-4249-b2fe-f62ed7af6ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:08.432673 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fa4be-69d3-4249-b2fe-f62ed7af6ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:08.445004 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15fa19-fe31-4924-a942-7b201505cf75 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:08.451167 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f157e68-6b1f-4cc0-8544-e684a2669a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:08.451786 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f157e68-6b1f-4cc0-8544-e684a2669a15 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:08.452069 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f157e68-6b1f-4cc0-8544-e684a2669a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:08.452350 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f157e68-6b1f-4cc0-8544-e684a2669a15 admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:08.452967 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f157e68-6b1f-4cc0-8544-e684a2669a15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:08.455065 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f157e68-6b1f-4cc0-8544-e684a2669a15 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:08.460751 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-ed3fa4be-69d3-4249-b2fe-f62ed7af6ca0 None None] MFA Rules not processed for user `0851b12afabe41d1b41006976b844a58`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:08.462772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-ed3fa4be-69d3-4249-b2fe-f62ed7af6ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:08.526791 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 960/1910] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:08.527990 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a978f2-8d80-4a3c-8f43-1d2a2ff5e94f None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:08.528280 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a978f2-8d80-4a3c-8f43-1d2a2ff5e94f None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:08.528565 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a978f2-8d80-4a3c-8f43-1d2a2ff5e94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:08.550602 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 951/1911] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:18:08 2022] POST /identity/v3/users => generated 301 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:08.550602 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f157e68-6b1f-4cc0-8544-e684a2669a15 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:08.551143 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-d8a978f2-8d80-4a3c-8f43-1d2a2ff5e94f None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:08.551938 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-d8a978f2-8d80-4a3c-8f43-1d2a2ff5e94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:08.555320 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-6f157e68-6b1f-4cc0-8544-e684a2669a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:08.562753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 961/1912] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:08.563925 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a978f2-8d80-4a3c-8f43-1d2a2ff5e94f None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:08.565328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-d8a978f2-8d80-4a3c-8f43-1d2a2ff5e94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:08.580689 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f157e68-6b1f-4cc0-8544-e684a2669a15 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:08.583563 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a978f2-8d80-4a3c-8f43-1d2a2ff5e94f None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:08.588234 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4075a-0d69-401e-90b3-f3b0738571ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:08.589296 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4075a-0d69-401e-90b3-f3b0738571ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:08.590083 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd19a6-9648-4bff-acc6-c9818fff4fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:08.590347 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4075a-0d69-401e-90b3-f3b0738571ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:08.590781 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4075a-0d69-401e-90b3-f3b0738571ec admin admin] PATH_INFO: `/v3/projects/33f8529022824fc5ad56584b70278ebc/users/dc1e75a725e64eea8723e470c5a65b2d/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:08.591017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd19a6-9648-4bff-acc6-c9818fff4fef admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:08.591489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd19a6-9648-4bff-acc6-c9818fff4fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:08.591857 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd19a6-9648-4bff-acc6-c9818fff4fef admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:08.593254 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd19a6-9648-4bff-acc6-c9818fff4fef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:08.594969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd19a6-9648-4bff-acc6-c9818fff4fef admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:08.609321 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4075a-0d69-401e-90b3-f3b0738571ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=33f8529022824fc5ad56584b70278ebc, user_id=dc1e75a725e64eea8723e470c5a65b2d, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:08.612553 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4075a-0d69-401e-90b3-f3b0738571ec admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:08.782626 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 952/1913] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:08 2022] PUT /identity/v3/projects/33f8529022824fc5ad56584b70278ebc/users/dc1e75a725e64eea8723e470c5a65b2d/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:08.783648 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4075a-0d69-401e-90b3-f3b0738571ec admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:08.789852 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 962/1914] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:18:08 2022] POST /identity/v3/projects => generated 379 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:08.789852 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f381f8f-b671-4b74-b0f8-130d9aff2cbb None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:08.789852 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f381f8f-b671-4b74-b0f8-130d9aff2cbb None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:08.790495 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f381f8f-b671-4b74-b0f8-130d9aff2cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:08.820398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-5f381f8f-b671-4b74-b0f8-130d9aff2cbb None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:08.822524 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-5f381f8f-b671-4b74-b0f8-130d9aff2cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:08.868796 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4075a-0d69-401e-90b3-f3b0738571ec admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:08.896987 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 963/1915] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:08.896987 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f381f8f-b671-4b74-b0f8-130d9aff2cbb None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:08.923396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f381f8f-b671-4b74-b0f8-130d9aff2cbb None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:08.939114 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab853e-e4de-46c2-8b42-94c0e85f3dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:08.939931 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab853e-e4de-46c2-8b42-94c0e85f3dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:08.940315 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab853e-e4de-46c2-8b42-94c0e85f3dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:08.940733 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab853e-e4de-46c2-8b42-94c0e85f3dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:08.942379 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab853e-e4de-46c2-8b42-94c0e85f3dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:08.948183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f87f27-d2b5-4d58-a60b-6e0b681c8097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:08.949634 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f87f27-d2b5-4d58-a60b-6e0b681c8097 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:08.949984 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f87f27-d2b5-4d58-a60b-6e0b681c8097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:08.950404 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f87f27-d2b5-4d58-a60b-6e0b681c8097 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:08.951056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f87f27-d2b5-4d58-a60b-6e0b681c8097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:08.952966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f87f27-d2b5-4d58-a60b-6e0b681c8097 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:08.958050 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab853e-e4de-46c2-8b42-94c0e85f3dd2 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:08.965160 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 953/1916] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:08.966152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f87f27-d2b5-4d58-a60b-6e0b681c8097 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:08.970086 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 964/1917] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:08.971009 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab853e-e4de-46c2-8b42-94c0e85f3dd2 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:08.976435 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f87f27-d2b5-4d58-a60b-6e0b681c8097 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:08.982333 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b672b6a-e7d8-4e95-81fb-1a70551cd570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:08.983282 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b672b6a-e7d8-4e95-81fb-1a70551cd570 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:08.983407 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b672b6a-e7d8-4e95-81fb-1a70551cd570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:08.983485 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab853e-e4de-46c2-8b42-94c0e85f3dd2 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:08.983584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b672b6a-e7d8-4e95-81fb-1a70551cd570 admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:08.984305 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b672b6a-e7d8-4e95-81fb-1a70551cd570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:08.986645 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b672b6a-e7d8-4e95-81fb-1a70551cd570 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:08.994959 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ea1f4-5c0c-4686-ab3f-5526a77bb1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:08.996206 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ea1f4-5c0c-4686-ab3f-5526a77bb1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:08.996558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ea1f4-5c0c-4686-ab3f-5526a77bb1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:08.997365 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ea1f4-5c0c-4686-ab3f-5526a77bb1b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:08.998617 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ea1f4-5c0c-4686-ab3f-5526a77bb1b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:18:08.999345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ea1f4-5c0c-4686-ab3f-5526a77bb1b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:09.001348 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ea1f4-5c0c-4686-ab3f-5526a77bb1b7 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:09.016414 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 965/1918] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:18:09.017443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ea1f4-5c0c-4686-ab3f-5526a77bb1b7 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:09.028113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ea1f4-5c0c-4686-ab3f-5526a77bb1b7 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:09.032878 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051af79-9f5e-45eb-816f-479b6aff4884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:09.033674 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051af79-9f5e-45eb-816f-479b6aff4884 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:09.034073 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051af79-9f5e-45eb-816f-479b6aff4884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:09.035724 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051af79-9f5e-45eb-816f-479b6aff4884 admin admin] PATH_INFO: `/v3/projects/1c3cc8f44aa34e13a951be710c2a2b10/users/2683a913e5d14a1ead7fa8053452cea9/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:09.052846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051af79-9f5e-45eb-816f-479b6aff4884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c3cc8f44aa34e13a951be710c2a2b10, user_id=2683a913e5d14a1ead7fa8053452cea9, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:09.056494 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051af79-9f5e-45eb-816f-479b6aff4884 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:09.076985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 954/1919] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:18:08 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:09.078561 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b672b6a-e7d8-4e95-81fb-1a70551cd570 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:09.091110 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b672b6a-e7d8-4e95-81fb-1a70551cd570 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:09.096141 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360db04-215c-48b1-acc8-05ad76c5b00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:09.096911 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360db04-215c-48b1-acc8-05ad76c5b00b admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:09.097196 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360db04-215c-48b1-acc8-05ad76c5b00b admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:09.097628 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360db04-215c-48b1-acc8-05ad76c5b00b admin admin] PATH_INFO: `/v3/projects/33f8529022824fc5ad56584b70278ebc/users/dc1e75a725e64eea8723e470c5a65b2d/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:09.099505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360db04-215c-48b1-acc8-05ad76c5b00b admin admin] RBAC: Authorizing `identity:create_grant(project_id=33f8529022824fc5ad56584b70278ebc, user_id=dc1e75a725e64eea8723e470c5a65b2d, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:09.102323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360db04-215c-48b1-acc8-05ad76c5b00b admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:09.114890 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 955/1920] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:09 2022] PUT /identity/v3/projects/33f8529022824fc5ad56584b70278ebc/users/dc1e75a725e64eea8723e470c5a65b2d/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:09.115690 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360db04-215c-48b1-acc8-05ad76c5b00b admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:09.181829 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360db04-215c-48b1-acc8-05ad76c5b00b admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:09.200120 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 966/1921] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:09 2022] PUT /identity/v3/projects/1c3cc8f44aa34e13a951be710c2a2b10/users/2683a913e5d14a1ead7fa8053452cea9/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:09.200120 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051af79-9f5e-45eb-816f-479b6aff4884 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:09.259179 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e260a5-44ea-4f5f-bb8d-5cfeaa7363ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:09.259972 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e260a5-44ea-4f5f-bb8d-5cfeaa7363ab admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:09.260355 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e260a5-44ea-4f5f-bb8d-5cfeaa7363ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:09.260739 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e260a5-44ea-4f5f-bb8d-5cfeaa7363ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:09.261535 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e260a5-44ea-4f5f-bb8d-5cfeaa7363ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:09.263701 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e260a5-44ea-4f5f-bb8d-5cfeaa7363ab admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:09.280577 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051af79-9f5e-45eb-816f-479b6aff4884 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:09.285995 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116c50b-f772-408b-9357-999d9ca97e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:09.286781 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116c50b-f772-408b-9357-999d9ca97e2f admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:09.287186 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116c50b-f772-408b-9357-999d9ca97e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:09.287499 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116c50b-f772-408b-9357-999d9ca97e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:09.288275 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116c50b-f772-408b-9357-999d9ca97e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:09.290574 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116c50b-f772-408b-9357-999d9ca97e2f admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:09.305141 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 967/1922] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:09.305141 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2e1fe-90d0-47bd-b996-a03d0f890a5f None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:09.309488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2e1fe-90d0-47bd-b996-a03d0f890a5f None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:09.309488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2e1fe-90d0-47bd-b996-a03d0f890a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:09.332437 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-27e2e1fe-90d0-47bd-b996-a03d0f890a5f None None] MFA Rules not processed for user `dc1e75a725e64eea8723e470c5a65b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:09.333568 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-27e2e1fe-90d0-47bd-b996-a03d0f890a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:09.407214 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 968/1923] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:09.408130 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2e1fe-90d0-47bd-b996-a03d0f890a5f None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:09.415103 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 956/1924] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:18:09 2022] POST /identity/v3/projects => generated 373 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:09.416168 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e260a5-44ea-4f5f-bb8d-5cfeaa7363ab admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:09.425164 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2e1fe-90d0-47bd-b996-a03d0f890a5f None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:09.492901 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a9b06-db30-4839-91fb-e40dbe90804a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:09.493654 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a9b06-db30-4839-91fb-e40dbe90804a admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:09.493937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a9b06-db30-4839-91fb-e40dbe90804a admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:09.494754 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a9b06-db30-4839-91fb-e40dbe90804a admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:09.495478 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a9b06-db30-4839-91fb-e40dbe90804a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:09.497102 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a9b06-db30-4839-91fb-e40dbe90804a admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:09.510766 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 969/1925] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:09.511646 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a9b06-db30-4839-91fb-e40dbe90804a admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:09.538393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e260a5-44ea-4f5f-bb8d-5cfeaa7363ab admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:09.544893 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a9b06-db30-4839-91fb-e40dbe90804a admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:09.545710 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb2f16-f294-4026-82a4-a2d65209dd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:09.546892 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb2f16-f294-4026-82a4-a2d65209dd03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:09.547177 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb2f16-f294-4026-82a4-a2d65209dd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:09.547486 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb2f16-f294-4026-82a4-a2d65209dd03 admin admin] PATH_INFO: `/v3/projects/31020d14354b42a89f6af617f486e35e/users/1ef263df6fcb49268f79cf604277e74b/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:09.552143 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836dc41d-54b6-4b63-9bd3-387c4a466186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:09.553211 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836dc41d-54b6-4b63-9bd3-387c4a466186 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:09.554320 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836dc41d-54b6-4b63-9bd3-387c4a466186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:09.554750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836dc41d-54b6-4b63-9bd3-387c4a466186 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:09.556286 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836dc41d-54b6-4b63-9bd3-387c4a466186 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:09.558486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836dc41d-54b6-4b63-9bd3-387c4a466186 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:09.570762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb2f16-f294-4026-82a4-a2d65209dd03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31020d14354b42a89f6af617f486e35e, user_id=1ef263df6fcb49268f79cf604277e74b, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:09.574852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb2f16-f294-4026-82a4-a2d65209dd03 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:09.708678 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 970/1926] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:18:09 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:09.710013 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836dc41d-54b6-4b63-9bd3-387c4a466186 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:09.716315 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-836dc41d-54b6-4b63-9bd3-387c4a466186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:09.719373 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 957/1927] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:09 2022] PUT /identity/v3/projects/31020d14354b42a89f6af617f486e35e/users/1ef263df6fcb49268f79cf604277e74b/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:09.723132 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb2f16-f294-4026-82a4-a2d65209dd03 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:09.783467 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836dc41d-54b6-4b63-9bd3-387c4a466186 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:09.799054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb2f16-f294-4026-82a4-a2d65209dd03 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:09.809648 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e620885-942d-44bf-a896-40644e2693ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:09.810359 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e620885-942d-44bf-a896-40644e2693ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:09.810739 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e620885-942d-44bf-a896-40644e2693ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:09.810925 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e620885-942d-44bf-a896-40644e2693ec admin admin] PATH_INFO: `/v3/projects/1c3cc8f44aa34e13a951be710c2a2b10/users/2683a913e5d14a1ead7fa8053452cea9/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:09.813355 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e620885-942d-44bf-a896-40644e2693ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c3cc8f44aa34e13a951be710c2a2b10, user_id=2683a913e5d14a1ead7fa8053452cea9, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:09.816071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e620885-942d-44bf-a896-40644e2693ec admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:09.827998 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 958/1928] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:09 2022] PUT /identity/v3/projects/1c3cc8f44aa34e13a951be710c2a2b10/users/2683a913e5d14a1ead7fa8053452cea9/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:09.838469 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e620885-942d-44bf-a896-40644e2693ec admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:09.847802 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6a435-4a45-4de5-a4bc-135fdbed3a78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:09.848357 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6a435-4a45-4de5-a4bc-135fdbed3a78 service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:09.848638 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6a435-4a45-4de5-a4bc-135fdbed3a78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:09.848917 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6a435-4a45-4de5-a4bc-135fdbed3a78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:09.909420 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e620885-942d-44bf-a896-40644e2693ec admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:09.914568 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8a70a-3a62-4d0b-9a8b-e7c5b301e658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:09.915382 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8a70a-3a62-4d0b-9a8b-e7c5b301e658 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:09.915897 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8a70a-3a62-4d0b-9a8b-e7c5b301e658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:09.915997 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8a70a-3a62-4d0b-9a8b-e7c5b301e658 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:09.916632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8a70a-3a62-4d0b-9a8b-e7c5b301e658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:09.918365 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8a70a-3a62-4d0b-9a8b-e7c5b301e658 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:09.922264 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6a435-4a45-4de5-a4bc-135fdbed3a78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:09.923903 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6a435-4a45-4de5-a4bc-135fdbed3a78 service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:09.928598 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 959/1929] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:09.933247 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8a70a-3a62-4d0b-9a8b-e7c5b301e658 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:09.936300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 971/1930] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:09.937630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7e8d5-aca6-44b1-8bfd-5d00d0d44f82 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:09.937988 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7e8d5-aca6-44b1-8bfd-5d00d0d44f82 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:09.938423 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7e8d5-aca6-44b1-8bfd-5d00d0d44f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:09.959663 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8a70a-3a62-4d0b-9a8b-e7c5b301e658 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:09.966720 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5d982-bca5-49e1-a7d1-9a6aed7c53bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:09.969103 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5d982-bca5-49e1-a7d1-9a6aed7c53bb admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:09.969399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5d982-bca5-49e1-a7d1-9a6aed7c53bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:09.969668 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5d982-bca5-49e1-a7d1-9a6aed7c53bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:09.970344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5d982-bca5-49e1-a7d1-9a6aed7c53bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:09.972022 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5d982-bca5-49e1-a7d1-9a6aed7c53bb admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:09.973047 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-70c7e8d5-aca6-44b1-8bfd-5d00d0d44f82 None None] MFA Rules not processed for user `2683a913e5d14a1ead7fa8053452cea9`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:09.974328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-70c7e8d5-aca6-44b1-8bfd-5d00d0d44f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:09.984662 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 960/1931] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:09.984662 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5d982-bca5-49e1-a7d1-9a6aed7c53bb admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:09.994351 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5d982-bca5-49e1-a7d1-9a6aed7c53bb admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:09.999083 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02d192-c6af-4462-b7d6-3c5d2847d06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:09.999669 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02d192-c6af-4462-b7d6-3c5d2847d06f admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:09.999951 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02d192-c6af-4462-b7d6-3c5d2847d06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:10.000225 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02d192-c6af-4462-b7d6-3c5d2847d06f admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:10.000969 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02d192-c6af-4462-b7d6-3c5d2847d06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:10.002765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02d192-c6af-4462-b7d6-3c5d2847d06f admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:10.013318 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 961/1932] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:10.014106 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02d192-c6af-4462-b7d6-3c5d2847d06f admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:10.023575 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02d192-c6af-4462-b7d6-3c5d2847d06f admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:10.028579 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac637182-4bc8-4c8e-b481-4d4986ddbb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:10.029218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac637182-4bc8-4c8e-b481-4d4986ddbb77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:10.029499 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac637182-4bc8-4c8e-b481-4d4986ddbb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:10.029775 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac637182-4bc8-4c8e-b481-4d4986ddbb77 admin admin] PATH_INFO: `/v3/projects/31020d14354b42a89f6af617f486e35e/users/1ef263df6fcb49268f79cf604277e74b/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:10.031797 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac637182-4bc8-4c8e-b481-4d4986ddbb77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31020d14354b42a89f6af617f486e35e, user_id=1ef263df6fcb49268f79cf604277e74b, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:10.034486 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac637182-4bc8-4c8e-b481-4d4986ddbb77 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:10.057575 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 962/1933] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:10 2022] PUT /identity/v3/projects/31020d14354b42a89f6af617f486e35e/users/1ef263df6fcb49268f79cf604277e74b/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:10.057575 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac637182-4bc8-4c8e-b481-4d4986ddbb77 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:10.059693 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 972/1934] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:09 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:10.061014 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddf373-60fe-4669-a484-9a7996eaf340 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:10.061299 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddf373-60fe-4669-a484-9a7996eaf340 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:10.061578 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddf373-60fe-4669-a484-9a7996eaf340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:10.096072 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-22ddf373-60fe-4669-a484-9a7996eaf340 None None] MFA Rules not processed for user `1ef263df6fcb49268f79cf604277e74b`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:10.097459 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-22ddf373-60fe-4669-a484-9a7996eaf340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:10.127020 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac637182-4bc8-4c8e-b481-4d4986ddbb77 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:10.131964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb484b5-f3a9-435b-b371-6793be2e104c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:10.139533 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb484b5-f3a9-435b-b371-6793be2e104c admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:10.139533 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb484b5-f3a9-435b-b371-6793be2e104c admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:10.139533 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb484b5-f3a9-435b-b371-6793be2e104c admin admin] PATH_INFO: `/v3/projects/38afe8293657437ea0360a69ca70d56a/users/9807b575746a410a87ce81fa819a88b5/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:10.150054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb484b5-f3a9-435b-b371-6793be2e104c admin admin] RBAC: Authorizing `identity:create_grant(project_id=38afe8293657437ea0360a69ca70d56a, user_id=9807b575746a410a87ce81fa819a88b5, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:10.152944 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb484b5-f3a9-435b-b371-6793be2e104c admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:10.171427 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 973/1935] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:10 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:10.172270 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ddf373-60fe-4669-a484-9a7996eaf340 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:10.225283 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ddf373-60fe-4669-a484-9a7996eaf340 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:10.229490 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abed20-4bc5-4971-9d78-cfc1e2b7e486 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:10.230097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abed20-4bc5-4971-9d78-cfc1e2b7e486 service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:10.230411 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abed20-4bc5-4971-9d78-cfc1e2b7e486 service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:10.230691 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abed20-4bc5-4971-9d78-cfc1e2b7e486 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:10.292432 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70abed20-4bc5-4971-9d78-cfc1e2b7e486 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:10.293881 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70abed20-4bc5-4971-9d78-cfc1e2b7e486 service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:10.303878 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 974/1937] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:10 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:10.304723 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abed20-4bc5-4971-9d78-cfc1e2b7e486 service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:10.305308 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 963/1937] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:10 2022] PUT /identity/v3/projects/38afe8293657437ea0360a69ca70d56a/users/9807b575746a410a87ce81fa819a88b5/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:10.307060 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-70abed20-4bc5-4971-9d78-cfc1e2b7e486 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:10.311773 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52d004-f74d-48af-99a6-4bb7ab1c9d08 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:10.312059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52d004-f74d-48af-99a6-4bb7ab1c9d08 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:10.312334 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52d004-f74d-48af-99a6-4bb7ab1c9d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:10.319971 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abed20-4bc5-4971-9d78-cfc1e2b7e486 service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:10.365235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-7e52d004-f74d-48af-99a6-4bb7ab1c9d08 None None] MFA Rules not processed for user `9807b575746a410a87ce81fa819a88b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:10.366476 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-7e52d004-f74d-48af-99a6-4bb7ab1c9d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:10.384517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b61bb-8b5a-4baa-adfe-d5e71cd88cae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:10.385322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b61bb-8b5a-4baa-adfe-d5e71cd88cae service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:10.385676 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b61bb-8b5a-4baa-adfe-d5e71cd88cae service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:10.386093 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b61bb-8b5a-4baa-adfe-d5e71cd88cae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:10.473352 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 964/1938] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:18:10.473539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b61bb-8b5a-4baa-adfe-d5e71cd88cae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:10.474901 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b61bb-8b5a-4baa-adfe-d5e71cd88cae service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:10.486354 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 975/1939] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:10 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:10.561205 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52d004-f74d-48af-99a6-4bb7ab1c9d08 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:10.578800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52d004-f74d-48af-99a6-4bb7ab1c9d08 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:10.583021 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73dda57-8a77-4a7e-912e-48913384b107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:10.584434 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73dda57-8a77-4a7e-912e-48913384b107 service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:10.584434 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73dda57-8a77-4a7e-912e-48913384b107 service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:10.584670 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73dda57-8a77-4a7e-912e-48913384b107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:10.594783 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73dda57-8a77-4a7e-912e-48913384b107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:10.596416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73dda57-8a77-4a7e-912e-48913384b107 service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:10.617874 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 965/1940] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:10.732755 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:11.098177 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:11.542824 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b61bb-8b5a-4baa-adfe-d5e71cd88cae service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:11.620943 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b61bb-8b5a-4baa-adfe-d5e71cd88cae service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:11.626776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b14d2-292d-4724-86f2-b6784e2071ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:11.627854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b14d2-292d-4724-86f2-b6784e2071ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:11.628833 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b14d2-292d-4724-86f2-b6784e2071ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:11.628833 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b14d2-292d-4724-86f2-b6784e2071ec admin admin] PATH_INFO: `/v3/users/ca1ad9e6eac34dd89aafce007e691d01` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:11.630932 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b14d2-292d-4724-86f2-b6784e2071ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca1ad9e6eac34dd89aafce007e691d01)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:11.633245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b14d2-292d-4724-86f2-b6784e2071ec admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:11.928422 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-af6b14d2-292d-4724-86f2-b6784e2071ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca1ad9e6eac34dd89aafce007e691d01'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:11.929193 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-af6b14d2-292d-4724-86f2-b6784e2071ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca1ad9e6eac34dd89aafce007e691d01'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:11.929871 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-af6b14d2-292d-4724-86f2-b6784e2071ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca1ad9e6eac34dd89aafce007e691d01'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:11.999852 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-af6b14d2-292d-4724-86f2-b6784e2071ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca1ad9e6eac34dd89aafce007e691d01'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:12.028448 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-af6b14d2-292d-4724-86f2-b6784e2071ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca1ad9e6eac34dd89aafce007e691d01'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:12.047259 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 976/1941] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:11 2022] DELETE /identity/v3/users/ca1ad9e6eac34dd89aafce007e691d01 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:12.050165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95145ab4-f991-440c-8b2f-b4df94ae33ca None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:12.050993 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95145ab4-f991-440c-8b2f-b4df94ae33ca None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:12.050993 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95145ab4-f991-440c-8b2f-b4df94ae33ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:12.095952 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-95145ab4-f991-440c-8b2f-b4df94ae33ca None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:12.097537 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-95145ab4-f991-440c-8b2f-b4df94ae33ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:12.148900 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b14d2-292d-4724-86f2-b6784e2071ec admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:12.151195 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-af6b14d2-292d-4724-86f2-b6784e2071ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:12.218825 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 966/1942] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:12.229690 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95145ab4-f991-440c-8b2f-b4df94ae33ca None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:12.231220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-95145ab4-f991-440c-8b2f-b4df94ae33ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:12.255905 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b14d2-292d-4724-86f2-b6784e2071ec admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:12.261981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ca4d7-d4da-4df5-a4b7-b64aea8144cb tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef263df6fcb49268f79cf604277e74b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31020d14354b42a89f6af617f486e35e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:12.263249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ca4d7-d4da-4df5-a4b7-b64aea8144cb tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:12.263887 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ca4d7-d4da-4df5-a4b7-b64aea8144cb tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:12.264245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ca4d7-d4da-4df5-a4b7-b64aea8144cb tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:12.264975 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ca4d7-d4da-4df5-a4b7-b64aea8144cb tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:18:12.265415 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ca4d7-d4da-4df5-a4b7-b64aea8144cb tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:12.267166 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ca4d7-d4da-4df5-a4b7-b64aea8144cb tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:12.282342 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 977/1943] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 08:18:12.286139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ca4d7-d4da-4df5-a4b7-b64aea8144cb tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:12.297863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ca4d7-d4da-4df5-a4b7-b64aea8144cb tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:12.304292 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95145ab4-f991-440c-8b2f-b4df94ae33ca None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:12.312925 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d1ee2-00cf-45d8-8740-42dedacc5173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:12.312925 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d1ee2-00cf-45d8-8740-42dedacc5173 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:12.312925 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d1ee2-00cf-45d8-8740-42dedacc5173 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:12.312925 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d1ee2-00cf-45d8-8740-42dedacc5173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:12.320526 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997528f-997b-40a3-ba0f-25ad2cae6e10 tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef263df6fcb49268f79cf604277e74b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31020d14354b42a89f6af617f486e35e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:12.321306 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997528f-997b-40a3-ba0f-25ad2cae6e10 tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:12.321683 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997528f-997b-40a3-ba0f-25ad2cae6e10 tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:12.322040 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997528f-997b-40a3-ba0f-25ad2cae6e10 tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:12.323235 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997528f-997b-40a3-ba0f-25ad2cae6e10 tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:12.323357 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d1ee2-00cf-45d8-8740-42dedacc5173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:12.324596 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d1ee2-00cf-45d8-8740-42dedacc5173 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:12.325348 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997528f-997b-40a3-ba0f-25ad2cae6e10 tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:12.336226 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 967/1944] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:18:12.414172 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 978/1945] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:18:12 2022] POST /identity/v3/projects => generated 355 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:18:12.418946 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d1ee2-00cf-45d8-8740-42dedacc5173 service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:12.429331 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d1ee2-00cf-45d8-8740-42dedacc5173 service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:12.486593 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13421b3b-617e-4066-8509-3fb8c9413e7f tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef263df6fcb49268f79cf604277e74b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31020d14354b42a89f6af617f486e35e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:12.487253 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13421b3b-617e-4066-8509-3fb8c9413e7f tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:12.487540 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13421b3b-617e-4066-8509-3fb8c9413e7f tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:12.487818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13421b3b-617e-4066-8509-3fb8c9413e7f tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:12.488466 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13421b3b-617e-4066-8509-3fb8c9413e7f tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:18:12.489026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13421b3b-617e-4066-8509-3fb8c9413e7f tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:12.491038 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13421b3b-617e-4066-8509-3fb8c9413e7f tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:12.505942 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 968/1946] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:18:12.597949 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997528f-997b-40a3-ba0f-25ad2cae6e10 tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:12.620655 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997528f-997b-40a3-ba0f-25ad2cae6e10 tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:12.628108 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2032d-cf4e-4831-8969-2660fdbfd380 tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef263df6fcb49268f79cf604277e74b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31020d14354b42a89f6af617f486e35e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:12.629167 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2032d-cf4e-4831-8969-2660fdbfd380 tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:12.629921 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2032d-cf4e-4831-8969-2660fdbfd380 tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:12.630859 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2032d-cf4e-4831-8969-2660fdbfd380 tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] PATH_INFO: `/v3/projects/266cdf862d77485898709f67767febd6` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:12.633586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2032d-cf4e-4831-8969-2660fdbfd380 tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] RBAC: Authorizing `identity:delete_project(project_id=266cdf862d77485898709f67767febd6)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:12.635925 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2032d-cf4e-4831-8969-2660fdbfd380 tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:12.775260 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2ef2032d-cf4e-4831-8969-2660fdbfd380 tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '266cdf862d77485898709f67767febd6', 'request_id': 'req-2ef2032d-cf4e-4831-8969-2660fdbfd380'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:12.781017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2ef2032d-cf4e-4831-8969-2660fdbfd380 tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '266cdf862d77485898709f67767febd6', 'request_id': 'req-2ef2032d-cf4e-4831-8969-2660fdbfd380'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:12.787771 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2ef2032d-cf4e-4831-8969-2660fdbfd380 tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '266cdf862d77485898709f67767febd6', 'request_id': 'req-2ef2032d-cf4e-4831-8969-2660fdbfd380'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:12.842970 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13421b3b-617e-4066-8509-3fb8c9413e7f tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:12.844836 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-13421b3b-617e-4066-8509-3fb8c9413e7f tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:12.898933 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2ef2032d-cf4e-4831-8969-2660fdbfd380 tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] The token cache is being invalidate because project 266cdf862d77485898709f67767febd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:12.900306 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2ef2032d-cf4e-4831-8969-2660fdbfd380 tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:12.902831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2ef2032d-cf4e-4831-8969-2660fdbfd380 tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:12.904427 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 979/1947] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:12 2022] DELETE /identity/v3/projects/266cdf862d77485898709f67767febd6 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:12.926927 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13421b3b-617e-4066-8509-3fb8c9413e7f tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:13.008689 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea18b31-8273-4ec1-b070-4d052e3e7859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:13.009430 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea18b31-8273-4ec1-b070-4d052e3e7859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:13.009713 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea18b31-8273-4ec1-b070-4d052e3e7859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:13.010149 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea18b31-8273-4ec1-b070-4d052e3e7859 admin admin] PATH_INFO: `/v3/projects/d06cac7a0ab746b7bb2abcb511067817` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:13.018903 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea18b31-8273-4ec1-b070-4d052e3e7859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d06cac7a0ab746b7bb2abcb511067817)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:13.018903 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea18b31-8273-4ec1-b070-4d052e3e7859 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:13.191326 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-bea18b31-8273-4ec1-b070-4d052e3e7859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd06cac7a0ab746b7bb2abcb511067817', 'request_id': 'req-bea18b31-8273-4ec1-b070-4d052e3e7859'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:13.197669 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-bea18b31-8273-4ec1-b070-4d052e3e7859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd06cac7a0ab746b7bb2abcb511067817', 'request_id': 'req-bea18b31-8273-4ec1-b070-4d052e3e7859'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:13.204302 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-bea18b31-8273-4ec1-b070-4d052e3e7859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd06cac7a0ab746b7bb2abcb511067817', 'request_id': 'req-bea18b31-8273-4ec1-b070-4d052e3e7859'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:13.347603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-bea18b31-8273-4ec1-b070-4d052e3e7859 admin admin] The token cache is being invalidate because project d06cac7a0ab746b7bb2abcb511067817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:13.347961 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-bea18b31-8273-4ec1-b070-4d052e3e7859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:13.348706 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-bea18b31-8273-4ec1-b070-4d052e3e7859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:13.353049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 969/1948] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:12 2022] DELETE /identity/v3/projects/d06cac7a0ab746b7bb2abcb511067817 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:18:13.354260 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2032d-cf4e-4831-8969-2660fdbfd380 tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:13.355770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-2ef2032d-cf4e-4831-8969-2660fdbfd380 tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:13.372976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2032d-cf4e-4831-8969-2660fdbfd380 tempest-VolumeQuotaClassesTest-439632741 tempest-VolumeQuotaClassesTest-439632741-project-admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:13.440268 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607e83b-7068-4357-9a10-335224746dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:13.441618 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607e83b-7068-4357-9a10-335224746dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:13.442275 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607e83b-7068-4357-9a10-335224746dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:13.442275 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607e83b-7068-4357-9a10-335224746dfc admin admin] PATH_INFO: `/v3/users/2683a913e5d14a1ead7fa8053452cea9` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:13.443866 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607e83b-7068-4357-9a10-335224746dfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2683a913e5d14a1ead7fa8053452cea9)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:13.447475 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607e83b-7068-4357-9a10-335224746dfc admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:13.601420 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:13.706588 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f607e83b-7068-4357-9a10-335224746dfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2683a913e5d14a1ead7fa8053452cea9'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:13.707362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f607e83b-7068-4357-9a10-335224746dfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2683a913e5d14a1ead7fa8053452cea9'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:13.708016 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f607e83b-7068-4357-9a10-335224746dfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2683a913e5d14a1ead7fa8053452cea9'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:13.812039 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f607e83b-7068-4357-9a10-335224746dfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2683a913e5d14a1ead7fa8053452cea9'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:13.825511 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f607e83b-7068-4357-9a10-335224746dfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2683a913e5d14a1ead7fa8053452cea9'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:13.832518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea18b31-8273-4ec1-b070-4d052e3e7859 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:13.834029 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-bea18b31-8273-4ec1-b070-4d052e3e7859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:13.842145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 980/1949] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:13 2022] DELETE /identity/v3/users/2683a913e5d14a1ead7fa8053452cea9 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:18:13.848813 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea18b31-8273-4ec1-b070-4d052e3e7859 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:13.939421 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e88eb5-0832-4576-a2fd-ab9639427ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:13.941370 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e88eb5-0832-4576-a2fd-ab9639427ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:13.941837 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e88eb5-0832-4576-a2fd-ab9639427ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:13.942119 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e88eb5-0832-4576-a2fd-ab9639427ccd admin admin] PATH_INFO: `/v3/users/0851b12afabe41d1b41006976b844a58` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:13.944389 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e88eb5-0832-4576-a2fd-ab9639427ccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0851b12afabe41d1b41006976b844a58)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:13.950102 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e88eb5-0832-4576-a2fd-ab9639427ccd admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:13.976184 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:14.211090 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-73e88eb5-0832-4576-a2fd-ab9639427ccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0851b12afabe41d1b41006976b844a58'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:14.212671 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-73e88eb5-0832-4576-a2fd-ab9639427ccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0851b12afabe41d1b41006976b844a58'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:14.213731 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-73e88eb5-0832-4576-a2fd-ab9639427ccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0851b12afabe41d1b41006976b844a58'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:14.315662 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-73e88eb5-0832-4576-a2fd-ab9639427ccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0851b12afabe41d1b41006976b844a58'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:14.323775 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-73e88eb5-0832-4576-a2fd-ab9639427ccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0851b12afabe41d1b41006976b844a58'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:14.347094 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 970/1950] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:13 2022] DELETE /identity/v3/users/0851b12afabe41d1b41006976b844a58 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:18:14.352083 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805819d-055f-49de-810e-2ad479d8ef4e None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:14.352485 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805819d-055f-49de-810e-2ad479d8ef4e None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:14.352877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805819d-055f-49de-810e-2ad479d8ef4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:14.374983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-e805819d-055f-49de-810e-2ad479d8ef4e None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:14.376244 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-e805819d-055f-49de-810e-2ad479d8ef4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:14.457011 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 981/1951] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:14.466034 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e88eb5-0832-4576-a2fd-ab9639427ccd admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:14.467648 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-73e88eb5-0832-4576-a2fd-ab9639427ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:14.531254 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e88eb5-0832-4576-a2fd-ab9639427ccd admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:14.535333 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fec754-face-4e72-b326-33708397869b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:14.535953 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fec754-face-4e72-b326-33708397869b service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:14.536236 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fec754-face-4e72-b326-33708397869b service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:14.536511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fec754-face-4e72-b326-33708397869b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:14.558376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805819d-055f-49de-810e-2ad479d8ef4e None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:14.558507 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fec754-face-4e72-b326-33708397869b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:14.559924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-e805819d-055f-49de-810e-2ad479d8ef4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:14.560157 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fec754-face-4e72-b326-33708397869b service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:14.579658 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805819d-055f-49de-810e-2ad479d8ef4e None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:14.583325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 971/1952] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:14.591805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36885602-b47a-454c-a069-b2e1ce09af1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:14.592462 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36885602-b47a-454c-a069-b2e1ce09af1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:14.600578 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36885602-b47a-454c-a069-b2e1ce09af1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:14.600578 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36885602-b47a-454c-a069-b2e1ce09af1a admin admin] PATH_INFO: `/v3/projects/1c3cc8f44aa34e13a951be710c2a2b10` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:14.600578 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36885602-b47a-454c-a069-b2e1ce09af1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c3cc8f44aa34e13a951be710c2a2b10)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:14.601091 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36885602-b47a-454c-a069-b2e1ce09af1a admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:14.777943 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fec754-face-4e72-b326-33708397869b service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:14.777943 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-50fec754-face-4e72-b326-33708397869b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:14.797182 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-36885602-b47a-454c-a069-b2e1ce09af1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c3cc8f44aa34e13a951be710c2a2b10', 'request_id': 'req-36885602-b47a-454c-a069-b2e1ce09af1a'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:14.800817 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fec754-face-4e72-b326-33708397869b service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:14.811967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-36885602-b47a-454c-a069-b2e1ce09af1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c3cc8f44aa34e13a951be710c2a2b10', 'request_id': 'req-36885602-b47a-454c-a069-b2e1ce09af1a'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:14.823282 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-36885602-b47a-454c-a069-b2e1ce09af1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c3cc8f44aa34e13a951be710c2a2b10', 'request_id': 'req-36885602-b47a-454c-a069-b2e1ce09af1a'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:14.877393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea036ca-da8f-4a0b-bf4a-b9f75f230a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:14.887518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea036ca-da8f-4a0b-bf4a-b9f75f230a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:14.887518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea036ca-da8f-4a0b-bf4a-b9f75f230a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:14.887518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea036ca-da8f-4a0b-bf4a-b9f75f230a60 admin admin] PATH_INFO: `/v3/users/b53df0798c7947b89f1f5dc093199c23` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:14.887518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea036ca-da8f-4a0b-bf4a-b9f75f230a60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b53df0798c7947b89f1f5dc093199c23)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:14.887518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea036ca-da8f-4a0b-bf4a-b9f75f230a60 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:14.945332 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-36885602-b47a-454c-a069-b2e1ce09af1a admin admin] The token cache is being invalidate because project 1c3cc8f44aa34e13a951be710c2a2b10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:14.945706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-36885602-b47a-454c-a069-b2e1ce09af1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:14.947064 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-36885602-b47a-454c-a069-b2e1ce09af1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:14.950549 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 982/1953] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:14 2022] DELETE /identity/v3/projects/1c3cc8f44aa34e13a951be710c2a2b10 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:14.964116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297732c-8a22-499f-876c-09b23e5f818f None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:14.964584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297732c-8a22-499f-876c-09b23e5f818f None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:14.965160 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297732c-8a22-499f-876c-09b23e5f818f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:14.999577 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-4297732c-8a22-499f-876c-09b23e5f818f None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:14.999577 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-4297732c-8a22-499f-876c-09b23e5f818f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:15.008177 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 983/1954] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:15.020191 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92b26c-b2fd-4d50-94f6-5ba0bca94067 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:15.020764 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92b26c-b2fd-4d50-94f6-5ba0bca94067 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:15.021043 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92b26c-b2fd-4d50-94f6-5ba0bca94067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:15.046680 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-bd92b26c-b2fd-4d50-94f6-5ba0bca94067 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:15.047904 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-bd92b26c-b2fd-4d50-94f6-5ba0bca94067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:15.070990 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 984/1955] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:15.079864 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92b26c-b2fd-4d50-94f6-5ba0bca94067 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:15.090459 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92b26c-b2fd-4d50-94f6-5ba0bca94067 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:15.097094 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214312b-d988-420a-9745-fbe885b544b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:15.097708 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214312b-d988-420a-9745-fbe885b544b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:15.097989 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214312b-d988-420a-9745-fbe885b544b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:15.098266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214312b-d988-420a-9745-fbe885b544b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:15.098962 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214312b-d988-420a-9745-fbe885b544b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:18:15.099262 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214312b-d988-420a-9745-fbe885b544b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:15.100870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214312b-d988-420a-9745-fbe885b544b2 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:15.112916 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 985/1956] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 08:18:15.117620 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214312b-d988-420a-9745-fbe885b544b2 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:15.129457 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214312b-d988-420a-9745-fbe885b544b2 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:15.134197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d3c2f-6175-4b28-9f41-3ecec129e7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:15.135707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d3c2f-6175-4b28-9f41-3ecec129e7a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:15.135994 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d3c2f-6175-4b28-9f41-3ecec129e7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:15.136271 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d3c2f-6175-4b28-9f41-3ecec129e7a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:15.136901 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d3c2f-6175-4b28-9f41-3ecec129e7a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:15.138899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d3c2f-6175-4b28-9f41-3ecec129e7a2 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:15.159114 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-8ea036ca-da8f-4a0b-bf4a-b9f75f230a60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b53df0798c7947b89f1f5dc093199c23'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:15.159814 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-8ea036ca-da8f-4a0b-bf4a-b9f75f230a60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b53df0798c7947b89f1f5dc093199c23'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:15.160540 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-8ea036ca-da8f-4a0b-bf4a-b9f75f230a60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b53df0798c7947b89f1f5dc093199c23'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:15.307645 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 986/1957] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:18:15 2022] POST /identity/v3/projects => generated 361 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:18:15.307645 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d3c2f-6175-4b28-9f41-3ecec129e7a2 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:15.307645 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-9d3d3c2f-6175-4b28-9f41-3ecec129e7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:15.327951 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-8ea036ca-da8f-4a0b-bf4a-b9f75f230a60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b53df0798c7947b89f1f5dc093199c23'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:15.337537 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-8ea036ca-da8f-4a0b-bf4a-b9f75f230a60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b53df0798c7947b89f1f5dc093199c23'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:15.363687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 972/1958] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:14 2022] DELETE /identity/v3/users/b53df0798c7947b89f1f5dc093199c23 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:15.365248 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea036ca-da8f-4a0b-bf4a-b9f75f230a60 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:15.366764 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-8ea036ca-da8f-4a0b-bf4a-b9f75f230a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:15.381267 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d3c2f-6175-4b28-9f41-3ecec129e7a2 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:15.447905 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea036ca-da8f-4a0b-bf4a-b9f75f230a60 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:15.453226 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d34e9-a0d1-44f1-bf9a-83be9ea37a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:15.454087 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d34e9-a0d1-44f1-bf9a-83be9ea37a5a admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:15.454568 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d34e9-a0d1-44f1-bf9a-83be9ea37a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:15.455016 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d34e9-a0d1-44f1-bf9a-83be9ea37a5a admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:15.455948 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d34e9-a0d1-44f1-bf9a-83be9ea37a5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:15.456312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca0a36-df5d-4c1e-87f7-9b5d452eb78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:15.456994 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca0a36-df5d-4c1e-87f7-9b5d452eb78e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:15.457280 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca0a36-df5d-4c1e-87f7-9b5d452eb78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:15.457556 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca0a36-df5d-4c1e-87f7-9b5d452eb78e admin admin] PATH_INFO: `/v3/projects/095d969cfbcc4c428a3d1855d00d6508` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:15.458749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca0a36-df5d-4c1e-87f7-9b5d452eb78e admin admin] RBAC: Authorizing `identity:delete_project(project_id=095d969cfbcc4c428a3d1855d00d6508)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:15.458992 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d34e9-a0d1-44f1-bf9a-83be9ea37a5a admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:15.460707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca0a36-df5d-4c1e-87f7-9b5d452eb78e admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:15.538482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 973/1959] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:18:15 2022] POST /identity/v3/users => generated 281 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:15.538482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8867c-497f-4c7d-aa81-2fe08490457f None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:15.538482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8867c-497f-4c7d-aa81-2fe08490457f None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:15.538482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8867c-497f-4c7d-aa81-2fe08490457f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:15.582960 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-56b8867c-497f-4c7d-aa81-2fe08490457f None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:15.584240 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-56b8867c-497f-4c7d-aa81-2fe08490457f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:15.610615 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 974/1960] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:15.611807 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8867c-497f-4c7d-aa81-2fe08490457f None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:15.618726 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-71ca0a36-df5d-4c1e-87f7-9b5d452eb78e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '095d969cfbcc4c428a3d1855d00d6508', 'request_id': 'req-71ca0a36-df5d-4c1e-87f7-9b5d452eb78e'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:15.625018 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8867c-497f-4c7d-aa81-2fe08490457f None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:15.650127 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-71ca0a36-df5d-4c1e-87f7-9b5d452eb78e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '095d969cfbcc4c428a3d1855d00d6508', 'request_id': 'req-71ca0a36-df5d-4c1e-87f7-9b5d452eb78e'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:15.660743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-71ca0a36-df5d-4c1e-87f7-9b5d452eb78e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '095d969cfbcc4c428a3d1855d00d6508', 'request_id': 'req-71ca0a36-df5d-4c1e-87f7-9b5d452eb78e'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:15.719346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c9c7c-dff0-4d0d-b01e-d3548a913aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:15.720344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c9c7c-dff0-4d0d-b01e-d3548a913aba admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:15.720645 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c9c7c-dff0-4d0d-b01e-d3548a913aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:15.720931 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c9c7c-dff0-4d0d-b01e-d3548a913aba admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:15.721652 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c9c7c-dff0-4d0d-b01e-d3548a913aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:15.723498 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c9c7c-dff0-4d0d-b01e-d3548a913aba admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:15.725638 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-71ca0a36-df5d-4c1e-87f7-9b5d452eb78e admin admin] The token cache is being invalidate because project 095d969cfbcc4c428a3d1855d00d6508 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:15.726001 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-71ca0a36-df5d-4c1e-87f7-9b5d452eb78e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:15.726840 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-71ca0a36-df5d-4c1e-87f7-9b5d452eb78e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:15.729077 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 987/1961] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:15 2022] DELETE /identity/v3/projects/095d969cfbcc4c428a3d1855d00d6508 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:15.730303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca0a36-df5d-4c1e-87f7-9b5d452eb78e admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:15.732129 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-71ca0a36-df5d-4c1e-87f7-9b5d452eb78e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:15.741098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 975/1962] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:15.742054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c9c7c-dff0-4d0d-b01e-d3548a913aba admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:15.743813 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-d06c9c7c-dff0-4d0d-b01e-d3548a913aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:15.759407 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c9c7c-dff0-4d0d-b01e-d3548a913aba admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:15.765878 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d836b1d-da38-408f-9bfa-a280feee2ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:15.766749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d836b1d-da38-408f-9bfa-a280feee2ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:15.767179 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d836b1d-da38-408f-9bfa-a280feee2ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:15.767593 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d836b1d-da38-408f-9bfa-a280feee2ed8 admin admin] PATH_INFO: `/v3/users/1ef263df6fcb49268f79cf604277e74b` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:15.769177 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d836b1d-da38-408f-9bfa-a280feee2ed8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ef263df6fcb49268f79cf604277e74b)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:15.771792 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d836b1d-da38-408f-9bfa-a280feee2ed8 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:15.817291 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca0a36-df5d-4c1e-87f7-9b5d452eb78e admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:15.821530 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea416a-88fe-4e42-905a-4c7edb4f118b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:15.822371 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea416a-88fe-4e42-905a-4c7edb4f118b service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:15.822654 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea416a-88fe-4e42-905a-4c7edb4f118b service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:15.822923 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea416a-88fe-4e42-905a-4c7edb4f118b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:15.824789 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c8ea416a-88fe-4e42-905a-4c7edb4f118b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:15.839065 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea416a-88fe-4e42-905a-4c7edb4f118b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:15.840572 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea416a-88fe-4e42-905a-4c7edb4f118b service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:15.850764 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 988/1963] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:15.851405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea416a-88fe-4e42-905a-4c7edb4f118b service neutron] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:15.852714 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c8ea416a-88fe-4e42-905a-4c7edb4f118b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:15.865695 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea416a-88fe-4e42-905a-4c7edb4f118b service neutron] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:15.871626 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f09301-dcc9-4254-b2dc-e02c6080685b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:15.872250 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f09301-dcc9-4254-b2dc-e02c6080685b admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:15.872537 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f09301-dcc9-4254-b2dc-e02c6080685b admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:15.872818 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f09301-dcc9-4254-b2dc-e02c6080685b admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:15.873622 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f09301-dcc9-4254-b2dc-e02c6080685b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:15.875299 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f09301-dcc9-4254-b2dc-e02c6080685b admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:15.886183 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 989/1964] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:15.890087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f09301-dcc9-4254-b2dc-e02c6080685b admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:15.901047 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f09301-dcc9-4254-b2dc-e02c6080685b admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:15.907698 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7e52c-edf8-4be1-936a-d9cc55df455b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:15.911808 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7e52c-edf8-4be1-936a-d9cc55df455b admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:15.911808 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7e52c-edf8-4be1-936a-d9cc55df455b admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:15.911808 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7e52c-edf8-4be1-936a-d9cc55df455b admin admin] PATH_INFO: `/v3/projects/489f05eb0e0c48cca7b9818aa32bca1e/users/6179909a7ed142109a61c482ecd04066/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:15.925720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef7e52c-edf8-4be1-936a-d9cc55df455b admin admin] RBAC: Authorizing `identity:create_grant(project_id=489f05eb0e0c48cca7b9818aa32bca1e, user_id=6179909a7ed142109a61c482ecd04066, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:15.928467 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef7e52c-edf8-4be1-936a-d9cc55df455b admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:16.042303 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-8d836b1d-da38-408f-9bfa-a280feee2ed8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ef263df6fcb49268f79cf604277e74b'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:16.043122 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-8d836b1d-da38-408f-9bfa-a280feee2ed8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ef263df6fcb49268f79cf604277e74b'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:16.043676 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-8d836b1d-da38-408f-9bfa-a280feee2ed8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ef263df6fcb49268f79cf604277e74b'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:16.063120 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 990/1965] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:15 2022] PUT /identity/v3/projects/489f05eb0e0c48cca7b9818aa32bca1e/users/6179909a7ed142109a61c482ecd04066/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:18:16.074139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b908d20-8f35-43fe-95eb-25a8cf5121af None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:16.074826 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b908d20-8f35-43fe-95eb-25a8cf5121af None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:16.075314 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b908d20-8f35-43fe-95eb-25a8cf5121af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:16.113605 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-5b908d20-8f35-43fe-95eb-25a8cf5121af None None] MFA Rules not processed for user `6179909a7ed142109a61c482ecd04066`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:16.115606 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-5b908d20-8f35-43fe-95eb-25a8cf5121af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:16.159786 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-8d836b1d-da38-408f-9bfa-a280feee2ed8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ef263df6fcb49268f79cf604277e74b'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:16.162364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:16.169135 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-8d836b1d-da38-408f-9bfa-a280feee2ed8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ef263df6fcb49268f79cf604277e74b'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:16.188997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 991/1966] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:18:16.192213 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 976/1967] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:15 2022] DELETE /identity/v3/users/1ef263df6fcb49268f79cf604277e74b => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:16.229821 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b908d20-8f35-43fe-95eb-25a8cf5121af None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:16.231280 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-5b908d20-8f35-43fe-95eb-25a8cf5121af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:16.338491 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b908d20-8f35-43fe-95eb-25a8cf5121af None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:16.396542 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63050b8-7ce6-489d-ab8c-433a15b00192 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:16.407370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63050b8-7ce6-489d-ab8c-433a15b00192 service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:16.407370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63050b8-7ce6-489d-ab8c-433a15b00192 service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:16.407370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63050b8-7ce6-489d-ab8c-433a15b00192 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:16.464313 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63050b8-7ce6-489d-ab8c-433a15b00192 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:16.465772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63050b8-7ce6-489d-ab8c-433a15b00192 service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:16.477513 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 992/1968] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:16.494369 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d836b1d-da38-408f-9bfa-a280feee2ed8 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:16.496270 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-8d836b1d-da38-408f-9bfa-a280feee2ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:16.608696 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d836b1d-da38-408f-9bfa-a280feee2ed8 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:16.613627 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1e27d-3b3e-4cac-9712-4c3f609f053e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:16.614276 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1e27d-3b3e-4cac-9712-4c3f609f053e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:16.614584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1e27d-3b3e-4cac-9712-4c3f609f053e admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:16.615541 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1e27d-3b3e-4cac-9712-4c3f609f053e admin admin] PATH_INFO: `/v3/users/6179909a7ed142109a61c482ecd04066` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:16.616411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1e27d-3b3e-4cac-9712-4c3f609f053e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6179909a7ed142109a61c482ecd04066)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:16.618612 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1e27d-3b3e-4cac-9712-4c3f609f053e admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:16.663022 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63050b8-7ce6-489d-ab8c-433a15b00192 service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:16.665208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c63050b8-7ce6-489d-ab8c-433a15b00192 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:16.682844 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63050b8-7ce6-489d-ab8c-433a15b00192 service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:16.690934 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0b355-30c5-406f-b541-d9fda16a4e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:16.690934 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0b355-30c5-406f-b541-d9fda16a4e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:16.690934 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0b355-30c5-406f-b541-d9fda16a4e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:16.690934 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0b355-30c5-406f-b541-d9fda16a4e68 admin admin] PATH_INFO: `/v3/users/9807b575746a410a87ce81fa819a88b5` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:16.691668 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0b355-30c5-406f-b541-d9fda16a4e68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9807b575746a410a87ce81fa819a88b5)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:16.693834 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0b355-30c5-406f-b541-d9fda16a4e68 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:16.750676 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:16.848159 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-46b1e27d-3b3e-4cac-9712-4c3f609f053e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6179909a7ed142109a61c482ecd04066'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:16.848872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-46b1e27d-3b3e-4cac-9712-4c3f609f053e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6179909a7ed142109a61c482ecd04066'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:16.849530 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-46b1e27d-3b3e-4cac-9712-4c3f609f053e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6179909a7ed142109a61c482ecd04066'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:16.984539 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-46b1e27d-3b3e-4cac-9712-4c3f609f053e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6179909a7ed142109a61c482ecd04066'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:17.000046 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-46b1e27d-3b3e-4cac-9712-4c3f609f053e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6179909a7ed142109a61c482ecd04066'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:17.016956 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-94f0b355-30c5-406f-b541-d9fda16a4e68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9807b575746a410a87ce81fa819a88b5'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:17.017989 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-94f0b355-30c5-406f-b541-d9fda16a4e68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9807b575746a410a87ce81fa819a88b5'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:17.019728 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-94f0b355-30c5-406f-b541-d9fda16a4e68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9807b575746a410a87ce81fa819a88b5'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:17.046639 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 977/1969] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:16 2022] DELETE /identity/v3/users/6179909a7ed142109a61c482ecd04066 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:18:17.047875 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1e27d-3b3e-4cac-9712-4c3f609f053e admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:17.050023 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-46b1e27d-3b3e-4cac-9712-4c3f609f053e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:17.158061 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1e27d-3b3e-4cac-9712-4c3f609f053e admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:17.164037 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ce38d-0c3f-4f0d-ad4b-45aa3f427e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:17.164527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ce38d-0c3f-4f0d-ad4b-45aa3f427e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:17.165042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ce38d-0c3f-4f0d-ad4b-45aa3f427e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:17.165405 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ce38d-0c3f-4f0d-ad4b-45aa3f427e6a admin admin] PATH_INFO: `/v3/projects/cad7b646879f4bee8563b746a7587c83` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:17.168054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ce38d-0c3f-4f0d-ad4b-45aa3f427e6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cad7b646879f4bee8563b746a7587c83)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:17.169769 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-94f0b355-30c5-406f-b541-d9fda16a4e68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9807b575746a410a87ce81fa819a88b5'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:17.170352 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ce38d-0c3f-4f0d-ad4b-45aa3f427e6a admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:17.203495 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-94f0b355-30c5-406f-b541-d9fda16a4e68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9807b575746a410a87ce81fa819a88b5'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:17.241691 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 993/1970] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:16 2022] DELETE /identity/v3/users/9807b575746a410a87ce81fa819a88b5 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:17.246977 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0b355-30c5-406f-b541-d9fda16a4e68 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:17.252316 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-94f0b355-30c5-406f-b541-d9fda16a4e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:17.358237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-919ce38d-0c3f-4f0d-ad4b-45aa3f427e6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cad7b646879f4bee8563b746a7587c83', 'request_id': 'req-919ce38d-0c3f-4f0d-ad4b-45aa3f427e6a'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:17.379327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-919ce38d-0c3f-4f0d-ad4b-45aa3f427e6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cad7b646879f4bee8563b746a7587c83', 'request_id': 'req-919ce38d-0c3f-4f0d-ad4b-45aa3f427e6a'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:17.390198 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-919ce38d-0c3f-4f0d-ad4b-45aa3f427e6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cad7b646879f4bee8563b746a7587c83', 'request_id': 'req-919ce38d-0c3f-4f0d-ad4b-45aa3f427e6a'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:17.430470 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0b355-30c5-406f-b541-d9fda16a4e68 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:17.506188 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-919ce38d-0c3f-4f0d-ad4b-45aa3f427e6a admin admin] The token cache is being invalidate because project cad7b646879f4bee8563b746a7587c83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:17.506788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-919ce38d-0c3f-4f0d-ad4b-45aa3f427e6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:17.508512 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-919ce38d-0c3f-4f0d-ad4b-45aa3f427e6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:17.515408 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 978/1971] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:17 2022] DELETE /identity/v3/projects/cad7b646879f4bee8563b746a7587c83 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:17.515660 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7acdf9-4059-40b0-90b0-e2e0435cf15e None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:17.516147 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7acdf9-4059-40b0-90b0-e2e0435cf15e None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:17.517853 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7acdf9-4059-40b0-90b0-e2e0435cf15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:17.519238 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e5f18-1e5f-4467-9629-8629b0d76aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:17.522092 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e5f18-1e5f-4467-9629-8629b0d76aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:17.523580 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e5f18-1e5f-4467-9629-8629b0d76aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:17.524302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e5f18-1e5f-4467-9629-8629b0d76aa7 admin admin] PATH_INFO: `/v3/projects/31020d14354b42a89f6af617f486e35e` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:17.525864 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e5f18-1e5f-4467-9629-8629b0d76aa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31020d14354b42a89f6af617f486e35e)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:17.528586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e5f18-1e5f-4467-9629-8629b0d76aa7 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:17.542580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-7d7acdf9-4059-40b0-90b0-e2e0435cf15e None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:17.544546 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-7d7acdf9-4059-40b0-90b0-e2e0435cf15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:17.555063 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 979/1972] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:17.568183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66368225-8477-476b-b3b6-c64b49b4cd87 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:17.568832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66368225-8477-476b-b3b6-c64b49b4cd87 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:17.569393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66368225-8477-476b-b3b6-c64b49b4cd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:17.604094 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-66368225-8477-476b-b3b6-c64b49b4cd87 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:17.609373 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-66368225-8477-476b-b3b6-c64b49b4cd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:17.616461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 980/1973] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:17.617693 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66368225-8477-476b-b3b6-c64b49b4cd87 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:17.621059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-66368225-8477-476b-b3b6-c64b49b4cd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:17.639742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66368225-8477-476b-b3b6-c64b49b4cd87 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:17.643059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f07bb3-20d7-4c18-bab6-18a268659461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:17.646387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f07bb3-20d7-4c18-bab6-18a268659461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:17.646387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f07bb3-20d7-4c18-bab6-18a268659461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:17.646387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f07bb3-20d7-4c18-bab6-18a268659461 admin admin] PATH_INFO: `/v3/users/dc1e75a725e64eea8723e470c5a65b2d` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:17.647336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f07bb3-20d7-4c18-bab6-18a268659461 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc1e75a725e64eea8723e470c5a65b2d)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:17.649530 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f07bb3-20d7-4c18-bab6-18a268659461 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:17.689685 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f80e5f18-1e5f-4467-9629-8629b0d76aa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31020d14354b42a89f6af617f486e35e', 'request_id': 'req-f80e5f18-1e5f-4467-9629-8629b0d76aa7'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:17.701719 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f80e5f18-1e5f-4467-9629-8629b0d76aa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31020d14354b42a89f6af617f486e35e', 'request_id': 'req-f80e5f18-1e5f-4467-9629-8629b0d76aa7'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:17.709536 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f80e5f18-1e5f-4467-9629-8629b0d76aa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31020d14354b42a89f6af617f486e35e', 'request_id': 'req-f80e5f18-1e5f-4467-9629-8629b0d76aa7'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:17.830941 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f80e5f18-1e5f-4467-9629-8629b0d76aa7 admin admin] The token cache is being invalidate because project 31020d14354b42a89f6af617f486e35e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:17.835634 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f80e5f18-1e5f-4467-9629-8629b0d76aa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:17.835634 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f80e5f18-1e5f-4467-9629-8629b0d76aa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:17.835634 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 994/1974] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:17 2022] DELETE /identity/v3/projects/31020d14354b42a89f6af617f486e35e => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:17.835634 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e5f18-1e5f-4467-9629-8629b0d76aa7 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:17.838126 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-f80e5f18-1e5f-4467-9629-8629b0d76aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:17.909910 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e5f18-1e5f-4467-9629-8629b0d76aa7 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:17.915133 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af2766-6e7c-483d-a92a-247057f825ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:17.916062 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af2766-6e7c-483d-a92a-247057f825ff service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:17.917182 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af2766-6e7c-483d-a92a-247057f825ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:17.917695 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af2766-6e7c-483d-a92a-247057f825ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:17.920546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-70af2766-6e7c-483d-a92a-247057f825ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:17.929902 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-a9f07bb3-20d7-4c18-bab6-18a268659461 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc1e75a725e64eea8723e470c5a65b2d'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:17.931755 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-a9f07bb3-20d7-4c18-bab6-18a268659461 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc1e75a725e64eea8723e470c5a65b2d'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:17.933152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-a9f07bb3-20d7-4c18-bab6-18a268659461 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc1e75a725e64eea8723e470c5a65b2d'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:18.001750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af2766-6e7c-483d-a92a-247057f825ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:18.003363 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af2766-6e7c-483d-a92a-247057f825ff service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:18.013926 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 995/1975] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:18.014847 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af2766-6e7c-483d-a92a-247057f825ff service neutron] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:18.022683 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af2766-6e7c-483d-a92a-247057f825ff service neutron] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:18.025471 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-a9f07bb3-20d7-4c18-bab6-18a268659461 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc1e75a725e64eea8723e470c5a65b2d'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:18.036506 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-a9f07bb3-20d7-4c18-bab6-18a268659461 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc1e75a725e64eea8723e470c5a65b2d'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:18.038980 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b253d20-a86c-4fa4-b91b-4f658d10550c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:18.039812 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b253d20-a86c-4fa4-b91b-4f658d10550c service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:18.040098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b253d20-a86c-4fa4-b91b-4f658d10550c service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:18.040868 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b253d20-a86c-4fa4-b91b-4f658d10550c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:18.044297 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-1b253d20-a86c-4fa4-b91b-4f658d10550c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:18.059424 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b253d20-a86c-4fa4-b91b-4f658d10550c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:18.065547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b253d20-a86c-4fa4-b91b-4f658d10550c service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:18.066177 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 981/1976] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:17 2022] DELETE /identity/v3/users/dc1e75a725e64eea8723e470c5a65b2d => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:18.066177 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2621b06-ebfb-4b58-a7db-6bd49863cfda None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:18.066177 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2621b06-ebfb-4b58-a7db-6bd49863cfda None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:18.066177 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2621b06-ebfb-4b58-a7db-6bd49863cfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:18.087889 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-a2621b06-ebfb-4b58-a7db-6bd49863cfda None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:18.090225 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a2621b06-ebfb-4b58-a7db-6bd49863cfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:18.095527 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 996/1977] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:18.184697 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 982/1978] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:18.193293 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9608ed-4c45-4314-a881-87ed452e2f9f None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:18.193481 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9608ed-4c45-4314-a881-87ed452e2f9f None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:18.193803 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9608ed-4c45-4314-a881-87ed452e2f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:18.216177 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-2b9608ed-4c45-4314-a881-87ed452e2f9f None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:18.226969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-2b9608ed-4c45-4314-a881-87ed452e2f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:18.236664 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 997/1979] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:18.242436 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2621b06-ebfb-4b58-a7db-6bd49863cfda None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:18.254863 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2621b06-ebfb-4b58-a7db-6bd49863cfda None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:18.261837 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a890645-3176-4da1-8200-88d9ee464943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:18.262989 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a890645-3176-4da1-8200-88d9ee464943 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:18.263548 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a890645-3176-4da1-8200-88d9ee464943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:18.264009 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a890645-3176-4da1-8200-88d9ee464943 admin admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:18.264902 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a890645-3176-4da1-8200-88d9ee464943 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:18:18.265558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a890645-3176-4da1-8200-88d9ee464943 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:18.267489 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a890645-3176-4da1-8200-88d9ee464943 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:18.290206 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 983/1980] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:18:18.291686 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9608ed-4c45-4314-a881-87ed452e2f9f None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:18.329015 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:18.329952 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9608ed-4c45-4314-a881-87ed452e2f9f None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:18.350785 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72e47e-f211-4bfb-a1f2-901afa6bfa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:18.351271 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72e47e-f211-4bfb-a1f2-901afa6bfa44 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:18.352826 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72e47e-f211-4bfb-a1f2-901afa6bfa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:18.355346 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72e47e-f211-4bfb-a1f2-901afa6bfa44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:18.357505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72e47e-f211-4bfb-a1f2-901afa6bfa44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:18.367436 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72e47e-f211-4bfb-a1f2-901afa6bfa44 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:18.536749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 998/1981] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:18:18 2022] POST /identity/v3/projects => generated 381 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:18.541067 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a890645-3176-4da1-8200-88d9ee464943 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:18.551874 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a890645-3176-4da1-8200-88d9ee464943 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:18.614796 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952b87c-ee9f-41ae-b32d-9082f8f344a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:18.615671 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952b87c-ee9f-41ae-b32d-9082f8f344a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:18.615959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952b87c-ee9f-41ae-b32d-9082f8f344a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:18.616235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952b87c-ee9f-41ae-b32d-9082f8f344a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:18.616871 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952b87c-ee9f-41ae-b32d-9082f8f344a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:18.618966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952b87c-ee9f-41ae-b32d-9082f8f344a0 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:18.627395 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72e47e-f211-4bfb-a1f2-901afa6bfa44 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:18.629166 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-8c72e47e-f211-4bfb-a1f2-901afa6bfa44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:18.661007 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72e47e-f211-4bfb-a1f2-901afa6bfa44 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:18.670961 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de8d0d-4e7f-461c-84b9-110467125fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:18.671485 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de8d0d-4e7f-461c-84b9-110467125fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:18.671771 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de8d0d-4e7f-461c-84b9-110467125fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:18.672048 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de8d0d-4e7f-461c-84b9-110467125fb8 admin admin] PATH_INFO: `/v3/projects/33f8529022824fc5ad56584b70278ebc` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:18.674111 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de8d0d-4e7f-461c-84b9-110467125fb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33f8529022824fc5ad56584b70278ebc)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:18.676696 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de8d0d-4e7f-461c-84b9-110467125fb8 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:18.790323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 984/1982] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:18:18 2022] POST /identity/v3/users => generated 291 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:18.795541 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952b87c-ee9f-41ae-b32d-9082f8f344a0 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:18.806382 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952b87c-ee9f-41ae-b32d-9082f8f344a0 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:18.811987 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3cfa0-9927-48a6-be8e-af7e1771dd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:18.812699 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3cfa0-9927-48a6-be8e-af7e1771dd9c admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:18.813054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3cfa0-9927-48a6-be8e-af7e1771dd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:18.813400 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3cfa0-9927-48a6-be8e-af7e1771dd9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:18.814109 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3cfa0-9927-48a6-be8e-af7e1771dd9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:18.816436 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3cfa0-9927-48a6-be8e-af7e1771dd9c admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:18.833166 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 985/1983] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:18.837144 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3cfa0-9927-48a6-be8e-af7e1771dd9c admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:18.849632 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-36de8d0d-4e7f-461c-84b9-110467125fb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33f8529022824fc5ad56584b70278ebc', 'request_id': 'req-36de8d0d-4e7f-461c-84b9-110467125fb8'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:18.850207 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3cfa0-9927-48a6-be8e-af7e1771dd9c admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:18.856577 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-36de8d0d-4e7f-461c-84b9-110467125fb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33f8529022824fc5ad56584b70278ebc', 'request_id': 'req-36de8d0d-4e7f-461c-84b9-110467125fb8'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:18.863117 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-36de8d0d-4e7f-461c-84b9-110467125fb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33f8529022824fc5ad56584b70278ebc', 'request_id': 'req-36de8d0d-4e7f-461c-84b9-110467125fb8'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:18.908462 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae1e3a-2995-4c3e-9d78-3276c974a1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:18.909078 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae1e3a-2995-4c3e-9d78-3276c974a1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:18.909402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae1e3a-2995-4c3e-9d78-3276c974a1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:18.909624 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae1e3a-2995-4c3e-9d78-3276c974a1c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:18.910254 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae1e3a-2995-4c3e-9d78-3276c974a1c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:18.911907 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae1e3a-2995-4c3e-9d78-3276c974a1c6 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:18.922768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 986/1984] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:18.927254 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae1e3a-2995-4c3e-9d78-3276c974a1c6 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:18.938045 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae1e3a-2995-4c3e-9d78-3276c974a1c6 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:18.942921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d7134-69c6-477a-b69d-341ea643b029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:18.943425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d7134-69c6-477a-b69d-341ea643b029 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:18.943690 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d7134-69c6-477a-b69d-341ea643b029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:18.943960 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d7134-69c6-477a-b69d-341ea643b029 admin admin] PATH_INFO: `/v3/projects/ae967bef30e34cd0b48110629d7f53a6/users/a5d9729dfebb43f2a82bfaa3a45659cd/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:18.951875 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:18.970921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d7134-69c6-477a-b69d-341ea643b029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae967bef30e34cd0b48110629d7f53a6, user_id=a5d9729dfebb43f2a82bfaa3a45659cd, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:18.973658 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d7134-69c6-477a-b69d-341ea643b029 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:19.037518 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-36de8d0d-4e7f-461c-84b9-110467125fb8 admin admin] The token cache is being invalidate because project 33f8529022824fc5ad56584b70278ebc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:19.038432 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-36de8d0d-4e7f-461c-84b9-110467125fb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:19.039504 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-36de8d0d-4e7f-461c-84b9-110467125fb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:19.042975 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 999/1985] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:18 2022] DELETE /identity/v3/projects/33f8529022824fc5ad56584b70278ebc => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:19.048184 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7716116-799d-4a23-95c9-6587cfc40b9c None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:19.048545 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7716116-799d-4a23-95c9-6587cfc40b9c None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:19.048890 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7716116-799d-4a23-95c9-6587cfc40b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:19.081689 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 987/1986] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:18 2022] PUT /identity/v3/projects/ae967bef30e34cd0b48110629d7f53a6/users/a5d9729dfebb43f2a82bfaa3a45659cd/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:19.084147 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171adc91-4773-4c9a-a779-1fe669770e64 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:19.084445 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171adc91-4773-4c9a-a779-1fe669770e64 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:19.084866 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171adc91-4773-4c9a-a779-1fe669770e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:19.115834 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-b7716116-799d-4a23-95c9-6587cfc40b9c None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:19.117382 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-b7716116-799d-4a23-95c9-6587cfc40b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:19.138087 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-171adc91-4773-4c9a-a779-1fe669770e64 None None] MFA Rules not processed for user `a5d9729dfebb43f2a82bfaa3a45659cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:19.139490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-171adc91-4773-4c9a-a779-1fe669770e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:19.206744 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1000/1987] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:19.215688 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11541d5f-afeb-46e9-9b84-fcca0371a40d None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:19.215971 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11541d5f-afeb-46e9-9b84-fcca0371a40d None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:19.216828 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11541d5f-afeb-46e9-9b84-fcca0371a40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:19.235467 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 988/1988] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:19.237952 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-11541d5f-afeb-46e9-9b84-fcca0371a40d None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:19.239427 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-11541d5f-afeb-46e9-9b84-fcca0371a40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:19.241174 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171adc91-4773-4c9a-a779-1fe669770e64 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:19.242718 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-171adc91-4773-4c9a-a779-1fe669770e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:19.248991 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1001/1989] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:18:19.253327 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11541d5f-afeb-46e9-9b84-fcca0371a40d None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:19.259049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171adc91-4773-4c9a-a779-1fe669770e64 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:19.264574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449c55f-80e7-4b8b-94b1-d0aa35ec5527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:19.265193 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449c55f-80e7-4b8b-94b1-d0aa35ec5527 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:19.265471 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449c55f-80e7-4b8b-94b1-d0aa35ec5527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:19.265741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449c55f-80e7-4b8b-94b1-d0aa35ec5527 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:19.266471 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449c55f-80e7-4b8b-94b1-d0aa35ec5527 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:19.268439 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449c55f-80e7-4b8b-94b1-d0aa35ec5527 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:19.272778 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11541d5f-afeb-46e9-9b84-fcca0371a40d None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:19.278523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea75fa4-c8a2-4e97-b4d7-635c28370483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:19.279371 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea75fa4-c8a2-4e97-b4d7-635c28370483 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:19.279493 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea75fa4-c8a2-4e97-b4d7-635c28370483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:19.279870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea75fa4-c8a2-4e97-b4d7-635c28370483 admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:19.280625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea75fa4-c8a2-4e97-b4d7-635c28370483 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:18:19.280999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea75fa4-c8a2-4e97-b4d7-635c28370483 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:19.282965 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea75fa4-c8a2-4e97-b4d7-635c28370483 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:19.298715 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1002/1990] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 08:18:19.299980 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea75fa4-c8a2-4e97-b4d7-635c28370483 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:19.301789 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-aea75fa4-c8a2-4e97-b4d7-635c28370483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:19.314961 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea75fa4-c8a2-4e97-b4d7-635c28370483 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:19.325053 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3617e1-11e9-4439-a695-65f132f57903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:19.325053 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3617e1-11e9-4439-a695-65f132f57903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:19.325053 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3617e1-11e9-4439-a695-65f132f57903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:19.325053 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3617e1-11e9-4439-a695-65f132f57903 admin admin] PATH_INFO: `/v3/projects/489f05eb0e0c48cca7b9818aa32bca1e` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:19.325477 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3617e1-11e9-4439-a695-65f132f57903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=489f05eb0e0c48cca7b9818aa32bca1e)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:19.325952 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3617e1-11e9-4439-a695-65f132f57903 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:19.424264 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 989/1991] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:18:19 2022] POST /identity/v3/projects => generated 379 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:19.424264 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449c55f-80e7-4b8b-94b1-d0aa35ec5527 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:19.456583 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2a3617e1-11e9-4439-a695-65f132f57903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '489f05eb0e0c48cca7b9818aa32bca1e', 'request_id': 'req-2a3617e1-11e9-4439-a695-65f132f57903'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:19.465605 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2a3617e1-11e9-4439-a695-65f132f57903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '489f05eb0e0c48cca7b9818aa32bca1e', 'request_id': 'req-2a3617e1-11e9-4439-a695-65f132f57903'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:19.473116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2a3617e1-11e9-4439-a695-65f132f57903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '489f05eb0e0c48cca7b9818aa32bca1e', 'request_id': 'req-2a3617e1-11e9-4439-a695-65f132f57903'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:19.502111 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449c55f-80e7-4b8b-94b1-d0aa35ec5527 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:19.561270 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2a3617e1-11e9-4439-a695-65f132f57903 admin admin] The token cache is being invalidate because project 489f05eb0e0c48cca7b9818aa32bca1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:19.565372 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2a3617e1-11e9-4439-a695-65f132f57903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:19.567391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2a3617e1-11e9-4439-a695-65f132f57903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:19.569633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1003/1992] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:19 2022] DELETE /identity/v3/projects/489f05eb0e0c48cca7b9818aa32bca1e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:19.570697 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3617e1-11e9-4439-a695-65f132f57903 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:19.572299 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-2a3617e1-11e9-4439-a695-65f132f57903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:19.575301 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f711ff0-8fd2-42c7-a39b-90a14afe9790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:19.575690 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f711ff0-8fd2-42c7-a39b-90a14afe9790 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:19.575690 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f711ff0-8fd2-42c7-a39b-90a14afe9790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:19.575968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f711ff0-8fd2-42c7-a39b-90a14afe9790 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:19.576595 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f711ff0-8fd2-42c7-a39b-90a14afe9790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:19.580862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f711ff0-8fd2-42c7-a39b-90a14afe9790 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:19.588028 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3617e1-11e9-4439-a695-65f132f57903 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:19.595041 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3af22-8a98-4132-b0aa-b724903fe785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:19.595640 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3af22-8a98-4132-b0aa-b724903fe785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:19.595914 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3af22-8a98-4132-b0aa-b724903fe785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:19.596188 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3af22-8a98-4132-b0aa-b724903fe785 admin admin] PATH_INFO: `/v3/projects/38afe8293657437ea0360a69ca70d56a` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:19.597333 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3af22-8a98-4132-b0aa-b724903fe785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38afe8293657437ea0360a69ca70d56a)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:19.603954 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3af22-8a98-4132-b0aa-b724903fe785 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:19.721173 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 990/1993] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:18:19 2022] POST /identity/v3/projects => generated 377 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:19.722062 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f711ff0-8fd2-42c7-a39b-90a14afe9790 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:19.723666 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-2f711ff0-8fd2-42c7-a39b-90a14afe9790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:19.763223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-02a3af22-8a98-4132-b0aa-b724903fe785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38afe8293657437ea0360a69ca70d56a', 'request_id': 'req-02a3af22-8a98-4132-b0aa-b724903fe785'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:19.769259 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-02a3af22-8a98-4132-b0aa-b724903fe785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38afe8293657437ea0360a69ca70d56a', 'request_id': 'req-02a3af22-8a98-4132-b0aa-b724903fe785'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:19.777831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-02a3af22-8a98-4132-b0aa-b724903fe785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38afe8293657437ea0360a69ca70d56a', 'request_id': 'req-02a3af22-8a98-4132-b0aa-b724903fe785'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:19.796129 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f711ff0-8fd2-42c7-a39b-90a14afe9790 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:19.862694 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e5a47-4db1-4221-8686-d449734431f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:19.864492 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e5a47-4db1-4221-8686-d449734431f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:19.864492 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e5a47-4db1-4221-8686-d449734431f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:19.864492 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e5a47-4db1-4221-8686-d449734431f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:19.864943 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e5a47-4db1-4221-8686-d449734431f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:19.867240 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e5a47-4db1-4221-8686-d449734431f2 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:19.931671 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-02a3af22-8a98-4132-b0aa-b724903fe785 admin admin] The token cache is being invalidate because project 38afe8293657437ea0360a69ca70d56a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:19.932075 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-02a3af22-8a98-4132-b0aa-b724903fe785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:19.934691 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-02a3af22-8a98-4132-b0aa-b724903fe785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:19.950331 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1004/1994] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:19 2022] DELETE /identity/v3/projects/38afe8293657437ea0360a69ca70d56a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:19.950331 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66174859-9fc4-42f5-a5ed-a67ff713df52 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:19.950331 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66174859-9fc4-42f5-a5ed-a67ff713df52 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:19.950331 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66174859-9fc4-42f5-a5ed-a67ff713df52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:19.962386 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-66174859-9fc4-42f5-a5ed-a67ff713df52 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:19.962685 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 991/1995] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:18:19 2022] POST /identity/v3/users => generated 296 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:19.964775 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-66174859-9fc4-42f5-a5ed-a67ff713df52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:19.964880 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e5a47-4db1-4221-8686-d449734431f2 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:19.970584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a15e5a47-4db1-4221-8686-d449734431f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:19.994621 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1005/1996] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:19.995758 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66174859-9fc4-42f5-a5ed-a67ff713df52 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:19.996024 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e5a47-4db1-4221-8686-d449734431f2 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:19.999506 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-66174859-9fc4-42f5-a5ed-a67ff713df52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:20.008583 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1037680-854b-443d-818b-16ad13c4c191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:20.009336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1037680-854b-443d-818b-16ad13c4c191 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:20.009949 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1037680-854b-443d-818b-16ad13c4c191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:20.015772 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1037680-854b-443d-818b-16ad13c4c191 admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:20.016470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1037680-854b-443d-818b-16ad13c4c191 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:20.019381 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1037680-854b-443d-818b-16ad13c4c191 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:20.041939 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66174859-9fc4-42f5-a5ed-a67ff713df52 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:20.059317 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb44aab-710c-4713-8831-7c3e72a194d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:20.060987 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb44aab-710c-4713-8831-7c3e72a194d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:20.063882 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb44aab-710c-4713-8831-7c3e72a194d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:20.064308 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb44aab-710c-4713-8831-7c3e72a194d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:20.065088 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb44aab-710c-4713-8831-7c3e72a194d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:20.067792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb44aab-710c-4713-8831-7c3e72a194d3 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:20.100787 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1006/1997] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:20.104571 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:20.108928 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda9249-8ed9-461d-ba01-055b1176c908 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:20.113443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda9249-8ed9-461d-ba01-055b1176c908 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:20.113443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda9249-8ed9-461d-ba01-055b1176c908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:20.144648 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 992/1998] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:18:19 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:20.145969 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1037680-854b-443d-818b-16ad13c4c191 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:20.149397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-9cda9249-8ed9-461d-ba01-055b1176c908 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:20.150739 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-9cda9249-8ed9-461d-ba01-055b1176c908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:20.163581 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1037680-854b-443d-818b-16ad13c4c191 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:20.168982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56461e-a6a9-414e-a893-50ebd83c042d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:20.169889 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56461e-a6a9-414e-a893-50ebd83c042d admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:20.170336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56461e-a6a9-414e-a893-50ebd83c042d admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:20.170757 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56461e-a6a9-414e-a893-50ebd83c042d admin admin] PATH_INFO: `/v3/projects/994c3f131f304f9b90445255d001f19f/users/72fbe71439fe42ba91511a1ba10e77d2/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:20.171741 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1007/1999] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:20.176781 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda9249-8ed9-461d-ba01-055b1176c908 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:20.183691 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda9249-8ed9-461d-ba01-055b1176c908 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:20.188515 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eae2c5-e157-43c0-a06d-9a8b4c2982ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:20.189373 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eae2c5-e157-43c0-a06d-9a8b4c2982ed admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:20.189579 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eae2c5-e157-43c0-a06d-9a8b4c2982ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:20.189909 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eae2c5-e157-43c0-a06d-9a8b4c2982ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:20.190592 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eae2c5-e157-43c0-a06d-9a8b4c2982ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:20.192283 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eae2c5-e157-43c0-a06d-9a8b4c2982ed admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:20.192684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56461e-a6a9-414e-a893-50ebd83c042d admin admin] RBAC: Authorizing `identity:create_grant(project_id=994c3f131f304f9b90445255d001f19f, user_id=72fbe71439fe42ba91511a1ba10e77d2, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:20.196991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56461e-a6a9-414e-a893-50ebd83c042d admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:20.207875 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1008/2000] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:20.210096 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eae2c5-e157-43c0-a06d-9a8b4c2982ed admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:20.220824 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eae2c5-e157-43c0-a06d-9a8b4c2982ed admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:20.227000 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e90ef-a26e-4553-aa94-b97aee15a3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:20.227794 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e90ef-a26e-4553-aa94-b97aee15a3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:20.228710 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e90ef-a26e-4553-aa94-b97aee15a3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:20.229140 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e90ef-a26e-4553-aa94-b97aee15a3e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:20.230004 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e90ef-a26e-4553-aa94-b97aee15a3e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:18:20.230483 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e90ef-a26e-4553-aa94-b97aee15a3e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:20.232659 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e90ef-a26e-4553-aa94-b97aee15a3e2 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:20.247578 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1009/2001] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:18:20.248617 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e90ef-a26e-4553-aa94-b97aee15a3e2 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:20.261354 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e90ef-a26e-4553-aa94-b97aee15a3e2 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:20.266067 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049b713-b4d6-4d02-b66c-159f6e8bfdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:20.266705 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049b713-b4d6-4d02-b66c-159f6e8bfdd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:20.266981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049b713-b4d6-4d02-b66c-159f6e8bfdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:20.267275 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049b713-b4d6-4d02-b66c-159f6e8bfdd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:20.267912 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049b713-b4d6-4d02-b66c-159f6e8bfdd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:20.269548 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049b713-b4d6-4d02-b66c-159f6e8bfdd4 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:20.280385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1010/2002] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:20.284267 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049b713-b4d6-4d02-b66c-159f6e8bfdd4 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:20.292752 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 993/2003] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:20 2022] PUT /identity/v3/projects/994c3f131f304f9b90445255d001f19f/users/72fbe71439fe42ba91511a1ba10e77d2/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:20.293851 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56461e-a6a9-414e-a893-50ebd83c042d admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:20.298850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049b713-b4d6-4d02-b66c-159f6e8bfdd4 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:20.380499 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976b2db-3da0-46af-b851-575f5213148a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:20.381402 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976b2db-3da0-46af-b851-575f5213148a admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:20.381843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976b2db-3da0-46af-b851-575f5213148a admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:20.382798 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976b2db-3da0-46af-b851-575f5213148a admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:20.383720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976b2db-3da0-46af-b851-575f5213148a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:20.386436 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976b2db-3da0-46af-b851-575f5213148a admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:20.388939 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56461e-a6a9-414e-a893-50ebd83c042d admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:20.395687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068b979-4c91-4929-af21-7acff41bcb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:20.397288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068b979-4c91-4929-af21-7acff41bcb68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:20.397667 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068b979-4c91-4929-af21-7acff41bcb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:20.398004 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068b979-4c91-4929-af21-7acff41bcb68 admin admin] PATH_INFO: `/v3/projects/c3112ef0de9a44e2bedeb36bde2bf07a/users/77bc1f568e634e86a44040b8b2a20deb/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:20.430147 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068b979-4c91-4929-af21-7acff41bcb68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3112ef0de9a44e2bedeb36bde2bf07a, user_id=77bc1f568e634e86a44040b8b2a20deb, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:20.435630 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068b979-4c91-4929-af21-7acff41bcb68 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:20.633433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 994/2004] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:20 2022] PUT /identity/v3/projects/c3112ef0de9a44e2bedeb36bde2bf07a/users/77bc1f568e634e86a44040b8b2a20deb/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:20.642628 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068b979-4c91-4929-af21-7acff41bcb68 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:20.642711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1011/2005] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:18:20 2022] POST /identity/v3/projects => generated 375 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:20.642711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976b2db-3da0-46af-b851-575f5213148a admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:20.722237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068b979-4c91-4929-af21-7acff41bcb68 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:20.727246 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0b930-5083-4589-a5b1-d6a9dcbb1cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:20.728835 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0b930-5083-4589-a5b1-d6a9dcbb1cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:20.728835 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0b930-5083-4589-a5b1-d6a9dcbb1cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:20.728835 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0b930-5083-4589-a5b1-d6a9dcbb1cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:20.729169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0b930-5083-4589-a5b1-d6a9dcbb1cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:20.731634 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0b930-5083-4589-a5b1-d6a9dcbb1cb7 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:20.732755 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976b2db-3da0-46af-b851-575f5213148a admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:20.737547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686f0ab-96ec-4f44-8960-2bbff21e5989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:20.738171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686f0ab-96ec-4f44-8960-2bbff21e5989 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:20.738545 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686f0ab-96ec-4f44-8960-2bbff21e5989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:20.738828 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686f0ab-96ec-4f44-8960-2bbff21e5989 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:20.739455 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686f0ab-96ec-4f44-8960-2bbff21e5989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:20.741670 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686f0ab-96ec-4f44-8960-2bbff21e5989 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:20.747351 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 995/2006] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:20.748770 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422628fa-6b9c-4fef-914f-58cab83ccf51 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:20.749050 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422628fa-6b9c-4fef-914f-58cab83ccf51 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:20.749493 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422628fa-6b9c-4fef-914f-58cab83ccf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:20.779411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-422628fa-6b9c-4fef-914f-58cab83ccf51 None None] MFA Rules not processed for user `77bc1f568e634e86a44040b8b2a20deb`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:20.780655 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-422628fa-6b9c-4fef-914f-58cab83ccf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:20.851581 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 996/2007] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:20.852414 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422628fa-6b9c-4fef-914f-58cab83ccf51 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:20.864828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422628fa-6b9c-4fef-914f-58cab83ccf51 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:20.869824 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef98f7-b75e-4eb1-915a-6ad4cb3388d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:20.870556 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef98f7-b75e-4eb1-915a-6ad4cb3388d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:20.870842 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef98f7-b75e-4eb1-915a-6ad4cb3388d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:20.871108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef98f7-b75e-4eb1-915a-6ad4cb3388d0 admin admin] PATH_INFO: `/v3/projects/994c3f131f304f9b90445255d001f19f/users/72fbe71439fe42ba91511a1ba10e77d2/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:20.873061 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef98f7-b75e-4eb1-915a-6ad4cb3388d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=994c3f131f304f9b90445255d001f19f, user_id=72fbe71439fe42ba91511a1ba10e77d2, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:20.875832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef98f7-b75e-4eb1-915a-6ad4cb3388d0 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:20.886669 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 997/2008] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:20 2022] PUT /identity/v3/projects/994c3f131f304f9b90445255d001f19f/users/72fbe71439fe42ba91511a1ba10e77d2/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:20.897052 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef98f7-b75e-4eb1-915a-6ad4cb3388d0 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:20.902057 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1012/2009] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:18:20 2022] POST /identity/v3/users => generated 288 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:20.902727 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35d0a8-4759-4fd5-a180-99e126e44e88 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:20.903122 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35d0a8-4759-4fd5-a180-99e126e44e88 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:20.903408 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35d0a8-4759-4fd5-a180-99e126e44e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:20.936476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-df35d0a8-4759-4fd5-a180-99e126e44e88 None None] MFA Rules not processed for user `72fbe71439fe42ba91511a1ba10e77d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:20.937714 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-df35d0a8-4759-4fd5-a180-99e126e44e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:20.974896 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef98f7-b75e-4eb1-915a-6ad4cb3388d0 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:20.980463 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2580dbd-8c77-4844-9879-3e5356a6897d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:20.981099 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2580dbd-8c77-4844-9879-3e5356a6897d admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:20.981381 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2580dbd-8c77-4844-9879-3e5356a6897d admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:20.981678 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2580dbd-8c77-4844-9879-3e5356a6897d admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:20.982314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2580dbd-8c77-4844-9879-3e5356a6897d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:20.984237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2580dbd-8c77-4844-9879-3e5356a6897d admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:21.012918 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1013/2010] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:20 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:21.013690 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35d0a8-4759-4fd5-a180-99e126e44e88 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:21.034580 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35d0a8-4759-4fd5-a180-99e126e44e88 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:21.040785 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c17d64-ec96-45a8-8f71-85e20f472685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:21.040785 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c17d64-ec96-45a8-8f71-85e20f472685 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:21.040785 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c17d64-ec96-45a8-8f71-85e20f472685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:21.040785 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c17d64-ec96-45a8-8f71-85e20f472685 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:21.041085 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c17d64-ec96-45a8-8f71-85e20f472685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:21.042693 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c17d64-ec96-45a8-8f71-85e20f472685 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:21.052517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1014/2011] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:21.053298 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c17d64-ec96-45a8-8f71-85e20f472685 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:21.055110 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-e4c17d64-ec96-45a8-8f71-85e20f472685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:21.116946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c17d64-ec96-45a8-8f71-85e20f472685 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:21.121245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e03f1-8231-4908-9ed9-38b837a02239 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:21.121863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e03f1-8231-4908-9ed9-38b837a02239 service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:21.122144 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e03f1-8231-4908-9ed9-38b837a02239 service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:21.122481 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e03f1-8231-4908-9ed9-38b837a02239 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:21.141822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e03f1-8231-4908-9ed9-38b837a02239 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:21.141822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e03f1-8231-4908-9ed9-38b837a02239 service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:21.150693 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 998/2012] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:18:20 2022] POST /identity/v3/projects => generated 375 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:21.150693 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2580dbd-8c77-4844-9879-3e5356a6897d admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:21.150855 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1015/2013] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:21 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:21.151308 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e03f1-8231-4908-9ed9-38b837a02239 service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:21.164046 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e03f1-8231-4908-9ed9-38b837a02239 service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:21.230511 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40aa2a2-9501-4d15-b818-80c309581f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:21.231130 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40aa2a2-9501-4d15-b818-80c309581f6f admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:21.231409 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40aa2a2-9501-4d15-b818-80c309581f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:21.231699 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40aa2a2-9501-4d15-b818-80c309581f6f admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:21.232302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40aa2a2-9501-4d15-b818-80c309581f6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:21.234231 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40aa2a2-9501-4d15-b818-80c309581f6f admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:21.249306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2580dbd-8c77-4844-9879-3e5356a6897d admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:21.254726 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c974e-a265-457c-8196-3185ec29ed31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:21.255368 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c974e-a265-457c-8196-3185ec29ed31 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:21.255652 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c974e-a265-457c-8196-3185ec29ed31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:21.255933 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c974e-a265-457c-8196-3185ec29ed31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:21.256757 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c974e-a265-457c-8196-3185ec29ed31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:21.258479 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c974e-a265-457c-8196-3185ec29ed31 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:21.270624 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 999/2014] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:21.274582 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c974e-a265-457c-8196-3185ec29ed31 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:21.285283 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c974e-a265-457c-8196-3185ec29ed31 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:21.290227 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635ad8a-9251-475d-8530-97815376b179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:21.290944 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635ad8a-9251-475d-8530-97815376b179 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:21.291227 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635ad8a-9251-475d-8530-97815376b179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:21.291505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635ad8a-9251-475d-8530-97815376b179 admin admin] PATH_INFO: `/v3/projects/a8593f4bbca84a358d8fb9d1ad2bfde8/users/2de2759f117142ff81155794a45c370d/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:21.311489 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635ad8a-9251-475d-8530-97815376b179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8593f4bbca84a358d8fb9d1ad2bfde8, user_id=2de2759f117142ff81155794a45c370d, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:21.314420 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635ad8a-9251-475d-8530-97815376b179 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:21.393767 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1016/2015] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:18:21 2022] POST /identity/v3/users => generated 288 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:21.393767 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40aa2a2-9501-4d15-b818-80c309581f6f admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:21.403785 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40aa2a2-9501-4d15-b818-80c309581f6f admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:21.408540 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33337a03-1a05-4816-aa52-63376f8c07bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:21.409141 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33337a03-1a05-4816-aa52-63376f8c07bb admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:21.409421 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33337a03-1a05-4816-aa52-63376f8c07bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:21.409696 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33337a03-1a05-4816-aa52-63376f8c07bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:21.410377 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33337a03-1a05-4816-aa52-63376f8c07bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:21.411998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33337a03-1a05-4816-aa52-63376f8c07bb admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:21.423696 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1017/2016] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:21.427724 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33337a03-1a05-4816-aa52-63376f8c07bb admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:21.438523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33337a03-1a05-4816-aa52-63376f8c07bb admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:21.443087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ef592-da20-4fd5-b8b2-1ab99e32e452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:21.443672 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ef592-da20-4fd5-b8b2-1ab99e32e452 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:21.443951 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ef592-da20-4fd5-b8b2-1ab99e32e452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:21.444228 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ef592-da20-4fd5-b8b2-1ab99e32e452 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:21.444880 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ef592-da20-4fd5-b8b2-1ab99e32e452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:21.446558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ef592-da20-4fd5-b8b2-1ab99e32e452 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:21.457888 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1018/2017] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:18:21.461068 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ef592-da20-4fd5-b8b2-1ab99e32e452 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:21.470985 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ef592-da20-4fd5-b8b2-1ab99e32e452 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:21.475851 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d88c2-96e7-4d0b-8582-8de9387bf8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:21.476831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d88c2-96e7-4d0b-8582-8de9387bf8a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:21.477119 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d88c2-96e7-4d0b-8582-8de9387bf8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:21.477613 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d88c2-96e7-4d0b-8582-8de9387bf8a3 admin admin] PATH_INFO: `/v3/projects/4a90570279a2447eb30e33b378cdfab7/users/79300c0a4474428ca36ed7f4fe14e7b5/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:21.485477 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1000/2018] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:21 2022] PUT /identity/v3/projects/a8593f4bbca84a358d8fb9d1ad2bfde8/users/2de2759f117142ff81155794a45c370d/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:18:21.500700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d88c2-96e7-4d0b-8582-8de9387bf8a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a90570279a2447eb30e33b378cdfab7, user_id=79300c0a4474428ca36ed7f4fe14e7b5, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:21.501586 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f2909-7717-48fa-af9d-0b8b7448b492 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:21.501872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f2909-7717-48fa-af9d-0b8b7448b492 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:21.502146 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f2909-7717-48fa-af9d-0b8b7448b492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:21.503474 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d88c2-96e7-4d0b-8582-8de9387bf8a3 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:21.537532 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-748f2909-7717-48fa-af9d-0b8b7448b492 None None] MFA Rules not processed for user `2de2759f117142ff81155794a45c370d`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:21.537532 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-748f2909-7717-48fa-af9d-0b8b7448b492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:21.600704 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1019/2019] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:21 2022] PUT /identity/v3/projects/4a90570279a2447eb30e33b378cdfab7/users/79300c0a4474428ca36ed7f4fe14e7b5/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:18:21.609332 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1001/2020] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:18:21.612942 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b4b69-feec-4d0f-afe9-3a62ae484148 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:21.613261 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b4b69-feec-4d0f-afe9-3a62ae484148 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:21.613590 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b4b69-feec-4d0f-afe9-3a62ae484148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:21.623759 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f2909-7717-48fa-af9d-0b8b7448b492 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:21.625516 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-748f2909-7717-48fa-af9d-0b8b7448b492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:21.652535 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-926b4b69-feec-4d0f-afe9-3a62ae484148 None None] MFA Rules not processed for user `79300c0a4474428ca36ed7f4fe14e7b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:21.653847 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-926b4b69-feec-4d0f-afe9-3a62ae484148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:21.696515 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f2909-7717-48fa-af9d-0b8b7448b492 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:21.719225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:21.742392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1020/2021] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:21.747371 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b4b69-feec-4d0f-afe9-3a62ae484148 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:21.759997 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68b47c-0c09-4d2f-8657-f6eeed9205b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:21.760623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68b47c-0c09-4d2f-8657-f6eeed9205b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:21.761007 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68b47c-0c09-4d2f-8657-f6eeed9205b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:21.761286 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68b47c-0c09-4d2f-8657-f6eeed9205b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:21.809534 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b4b69-feec-4d0f-afe9-3a62ae484148 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:21.814427 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12058f8-ddf4-437e-879a-70e0c6225b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:21.815036 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12058f8-ddf4-437e-879a-70e0c6225b64 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:21.815315 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12058f8-ddf4-437e-879a-70e0c6225b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:21.815587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12058f8-ddf4-437e-879a-70e0c6225b64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:21.816203 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12058f8-ddf4-437e-879a-70e0c6225b64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:21.818103 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12058f8-ddf4-437e-879a-70e0c6225b64 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:21.818974 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68b47c-0c09-4d2f-8657-f6eeed9205b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:21.820462 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68b47c-0c09-4d2f-8657-f6eeed9205b2 service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:21.829954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1002/2022] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:18:21.862213 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68b47c-0c09-4d2f-8657-f6eeed9205b2 service cinder] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:21.873194 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68b47c-0c09-4d2f-8657-f6eeed9205b2 service cinder] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:21.881890 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb460291-eca1-40d6-805e-4cef9942a91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:21.882571 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb460291-eca1-40d6-805e-4cef9942a91d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:21.882860 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb460291-eca1-40d6-805e-4cef9942a91d admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:21.883467 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb460291-eca1-40d6-805e-4cef9942a91d admin admin] PATH_INFO: `/v3/users/a5d9729dfebb43f2a82bfaa3a45659cd` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:21.884765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb460291-eca1-40d6-805e-4cef9942a91d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5d9729dfebb43f2a82bfaa3a45659cd)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:21.887216 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb460291-eca1-40d6-805e-4cef9942a91d admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:21.990755 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1021/2023] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:18:21 2022] POST /identity/v3/projects => generated 379 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:18:21.995204 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12058f8-ddf4-437e-879a-70e0c6225b64 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:22.055535 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12058f8-ddf4-437e-879a-70e0c6225b64 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:22.060493 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7fc6b-6f90-4dd7-9938-0944f23a768b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:22.068797 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7fc6b-6f90-4dd7-9938-0944f23a768b admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:22.068797 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7fc6b-6f90-4dd7-9938-0944f23a768b admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:22.068797 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7fc6b-6f90-4dd7-9938-0944f23a768b admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:22.068797 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7fc6b-6f90-4dd7-9938-0944f23a768b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:22.068797 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7fc6b-6f90-4dd7-9938-0944f23a768b admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:22.137287 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-fb460291-eca1-40d6-805e-4cef9942a91d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5d9729dfebb43f2a82bfaa3a45659cd'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:22.137945 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-fb460291-eca1-40d6-805e-4cef9942a91d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5d9729dfebb43f2a82bfaa3a45659cd'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:22.138587 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-fb460291-eca1-40d6-805e-4cef9942a91d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5d9729dfebb43f2a82bfaa3a45659cd'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:22.189241 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1022/2024] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:18:21 2022] POST /identity/v3/users => generated 296 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:18:22.193375 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7fc6b-6f90-4dd7-9938-0944f23a768b admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:22.195191 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-5ec7fc6b-6f90-4dd7-9938-0944f23a768b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:22.207528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7fc6b-6f90-4dd7-9938-0944f23a768b admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:22.212083 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06292348-8181-4a15-aa8b-07142ffb0496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:22.212664 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06292348-8181-4a15-aa8b-07142ffb0496 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:22.212942 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06292348-8181-4a15-aa8b-07142ffb0496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:22.213213 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06292348-8181-4a15-aa8b-07142ffb0496 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:22.213842 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06292348-8181-4a15-aa8b-07142ffb0496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:22.216262 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06292348-8181-4a15-aa8b-07142ffb0496 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:22.226299 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1023/2025] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:18:22.230481 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06292348-8181-4a15-aa8b-07142ffb0496 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:22.239994 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06292348-8181-4a15-aa8b-07142ffb0496 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:22.240892 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-fb460291-eca1-40d6-805e-4cef9942a91d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5d9729dfebb43f2a82bfaa3a45659cd'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:22.243833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:22.245658 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68484f14-be0e-4792-b5d3-e64077e0e3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:22.246088 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68484f14-be0e-4792-b5d3-e64077e0e3ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:22.246404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68484f14-be0e-4792-b5d3-e64077e0e3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:22.246684 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68484f14-be0e-4792-b5d3-e64077e0e3ef admin admin] PATH_INFO: `/v3/projects/9c29e0f8e6bc49b9924727b959469de7/users/bbc5aace5d3f4adc936c47535259a73b/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:22.253146 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-fb460291-eca1-40d6-805e-4cef9942a91d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5d9729dfebb43f2a82bfaa3a45659cd'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:22.262847 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68484f14-be0e-4792-b5d3-e64077e0e3ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c29e0f8e6bc49b9924727b959469de7, user_id=bbc5aace5d3f4adc936c47535259a73b, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:22.265561 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68484f14-be0e-4792-b5d3-e64077e0e3ef admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:22.273398 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1003/2026] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:21 2022] DELETE /identity/v3/users/a5d9729dfebb43f2a82bfaa3a45659cd => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:18:22.278694 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b55282-b931-4925-bab9-81cc151e7cb7 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:22.278988 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b55282-b931-4925-bab9-81cc151e7cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:22.279274 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b55282-b931-4925-bab9-81cc151e7cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:22.298413 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-26b55282-b931-4925-bab9-81cc151e7cb7 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:22.299640 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-26b55282-b931-4925-bab9-81cc151e7cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:22.358494 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1004/2027] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:18:22.368759 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1024/2028] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:22 2022] PUT /identity/v3/projects/9c29e0f8e6bc49b9924727b959469de7/users/bbc5aace5d3f4adc936c47535259a73b/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:18:22.370956 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b55282-b931-4925-bab9-81cc151e7cb7 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:22.372914 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68484f14-be0e-4792-b5d3-e64077e0e3ef admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:22.374926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-26b55282-b931-4925-bab9-81cc151e7cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:22.451868 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68484f14-be0e-4792-b5d3-e64077e0e3ef admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:22.454885 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b55282-b931-4925-bab9-81cc151e7cb7 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:22.456744 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797120dd-3ac4-4bff-95de-e4e5877be808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:22.457373 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797120dd-3ac4-4bff-95de-e4e5877be808 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:22.458193 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797120dd-3ac4-4bff-95de-e4e5877be808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:22.458193 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797120dd-3ac4-4bff-95de-e4e5877be808 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:22.458774 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797120dd-3ac4-4bff-95de-e4e5877be808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:22.460436 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797120dd-3ac4-4bff-95de-e4e5877be808 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:22.471870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1025/2029] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:22.476045 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797120dd-3ac4-4bff-95de-e4e5877be808 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:22.487994 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797120dd-3ac4-4bff-95de-e4e5877be808 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:22.490698 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:22.497736 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0e2fc-35d7-40b8-89c6-a140fbf30cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:22.498478 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0e2fc-35d7-40b8-89c6-a140fbf30cd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:22.498821 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0e2fc-35d7-40b8-89c6-a140fbf30cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:22.499106 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0e2fc-35d7-40b8-89c6-a140fbf30cd2 admin admin] PATH_INFO: `/v3/projects/9c29e0f8e6bc49b9924727b959469de7/users/bbc5aace5d3f4adc936c47535259a73b/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:22.501018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0e2fc-35d7-40b8-89c6-a140fbf30cd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c29e0f8e6bc49b9924727b959469de7, user_id=bbc5aace5d3f4adc936c47535259a73b, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:22.503877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0e2fc-35d7-40b8-89c6-a140fbf30cd2 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:22.512192 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ecba27-2cc4-454a-8b1a-8a1df0c771b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:22.512880 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecba27-2cc4-454a-8b1a-8a1df0c771b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:22.513160 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecba27-2cc4-454a-8b1a-8a1df0c771b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:22.513490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecba27-2cc4-454a-8b1a-8a1df0c771b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:22.518146 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1026/2030] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:22 2022] PUT /identity/v3/projects/9c29e0f8e6bc49b9924727b959469de7/users/bbc5aace5d3f4adc936c47535259a73b/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:22.529476 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ecba27-2cc4-454a-8b1a-8a1df0c771b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:22.531064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ecba27-2cc4-454a-8b1a-8a1df0c771b6 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:22.531671 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb5c2c-0dd4-4244-b6b2-06becdd2b44d None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:22.532307 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb5c2c-0dd4-4244-b6b2-06becdd2b44d None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:22.532767 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb5c2c-0dd4-4244-b6b2-06becdd2b44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:22.544243 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1005/2031] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:22.569130 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-8cdb5c2c-0dd4-4244-b6b2-06becdd2b44d None None] MFA Rules not processed for user `bbc5aace5d3f4adc936c47535259a73b`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:22.570815 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-8cdb5c2c-0dd4-4244-b6b2-06becdd2b44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:22.669865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1027/2032] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:22 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:18:22.681598 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ecba27-2cc4-454a-8b1a-8a1df0c771b6 service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:22.686869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-e4ecba27-2cc4-454a-8b1a-8a1df0c771b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:22.739352 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ecba27-2cc4-454a-8b1a-8a1df0c771b6 service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:22.795608 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b346e-f1dc-4a17-950f-03719dff39ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:22.796293 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b346e-f1dc-4a17-950f-03719dff39ed service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:22.796574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b346e-f1dc-4a17-950f-03719dff39ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:22.799487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b346e-f1dc-4a17-950f-03719dff39ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:22.807439 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b346e-f1dc-4a17-950f-03719dff39ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:22.809142 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b346e-f1dc-4a17-950f-03719dff39ed service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:22.819391 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1006/2033] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:22 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:22.931375 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb5c2c-0dd4-4244-b6b2-06becdd2b44d None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:22.932803 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-8cdb5c2c-0dd4-4244-b6b2-06becdd2b44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:22.945351 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb5c2c-0dd4-4244-b6b2-06becdd2b44d None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:22.949325 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecb14e-c556-4391-8610-fa1a301d4019 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:22.949936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecb14e-c556-4391-8610-fa1a301d4019 service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:22.950221 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecb14e-c556-4391-8610-fa1a301d4019 service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:22.950524 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecb14e-c556-4391-8610-fa1a301d4019 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:22.952221 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-55ecb14e-c556-4391-8610-fa1a301d4019 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:23.010858 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecb14e-c556-4391-8610-fa1a301d4019 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:23.012522 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecb14e-c556-4391-8610-fa1a301d4019 service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:23.013625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b346e-f1dc-4a17-950f-03719dff39ed service cinder] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:23.015083 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-325b346e-f1dc-4a17-950f-03719dff39ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:23.022094 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1028/2034] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:23.089073 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:23.099642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b346e-f1dc-4a17-950f-03719dff39ed service cinder] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:23.104294 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26521f33-921c-406f-83eb-ce48fb05d5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:23.104862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26521f33-921c-406f-83eb-ce48fb05d5d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:23.105878 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26521f33-921c-406f-83eb-ce48fb05d5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:23.106150 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26521f33-921c-406f-83eb-ce48fb05d5d8 admin admin] PATH_INFO: `/v3/projects/ae967bef30e34cd0b48110629d7f53a6` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:23.107297 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26521f33-921c-406f-83eb-ce48fb05d5d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae967bef30e34cd0b48110629d7f53a6)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:23.109781 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26521f33-921c-406f-83eb-ce48fb05d5d8 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:23.704315 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-26521f33-921c-406f-83eb-ce48fb05d5d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae967bef30e34cd0b48110629d7f53a6', 'request_id': 'req-26521f33-921c-406f-83eb-ce48fb05d5d8'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:23.710607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-26521f33-921c-406f-83eb-ce48fb05d5d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae967bef30e34cd0b48110629d7f53a6', 'request_id': 'req-26521f33-921c-406f-83eb-ce48fb05d5d8'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:23.718860 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-26521f33-921c-406f-83eb-ce48fb05d5d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae967bef30e34cd0b48110629d7f53a6', 'request_id': 'req-26521f33-921c-406f-83eb-ce48fb05d5d8'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:23.857088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-26521f33-921c-406f-83eb-ce48fb05d5d8 admin admin] The token cache is being invalidate because project ae967bef30e34cd0b48110629d7f53a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:23.857719 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-26521f33-921c-406f-83eb-ce48fb05d5d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:23.858277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-26521f33-921c-406f-83eb-ce48fb05d5d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:23.860047 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1007/2035] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:23 2022] DELETE /identity/v3/projects/ae967bef30e34cd0b48110629d7f53a6 => generated 0 bytes in 847 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:18:23.863893 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecb14e-c556-4391-8610-fa1a301d4019 service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:23.875733 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecb14e-c556-4391-8610-fa1a301d4019 service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:23.935346 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526b1e1-504f-4362-aa7d-ea77dae4f124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:23.936017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526b1e1-504f-4362-aa7d-ea77dae4f124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:23.936300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526b1e1-504f-4362-aa7d-ea77dae4f124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:23.936578 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526b1e1-504f-4362-aa7d-ea77dae4f124 admin admin] PATH_INFO: `/v3/users/72fbe71439fe42ba91511a1ba10e77d2` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:23.937696 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526b1e1-504f-4362-aa7d-ea77dae4f124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72fbe71439fe42ba91511a1ba10e77d2)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:23.939674 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526b1e1-504f-4362-aa7d-ea77dae4f124 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:23.998616 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:24.206515 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-a526b1e1-504f-4362-aa7d-ea77dae4f124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72fbe71439fe42ba91511a1ba10e77d2'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:24.212148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-a526b1e1-504f-4362-aa7d-ea77dae4f124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72fbe71439fe42ba91511a1ba10e77d2'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:24.212148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-a526b1e1-504f-4362-aa7d-ea77dae4f124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72fbe71439fe42ba91511a1ba10e77d2'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:24.307630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-a526b1e1-504f-4362-aa7d-ea77dae4f124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72fbe71439fe42ba91511a1ba10e77d2'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:24.323628 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-a526b1e1-504f-4362-aa7d-ea77dae4f124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72fbe71439fe42ba91511a1ba10e77d2'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:24.337911 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1029/2036] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:23 2022] DELETE /identity/v3/users/72fbe71439fe42ba91511a1ba10e77d2 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:24.820511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c052a-d611-4493-a3ee-b40fa723b2a0 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:24.820824 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c052a-d611-4493-a3ee-b40fa723b2a0 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:24.821106 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c052a-d611-4493-a3ee-b40fa723b2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:24.841514 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-402c052a-d611-4493-a3ee-b40fa723b2a0 None None] MFA Rules not processed for user `2de2759f117142ff81155794a45c370d`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:24.842932 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-402c052a-d611-4493-a3ee-b40fa723b2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:24.911900 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1008/2037] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:24.929506 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526b1e1-504f-4362-aa7d-ea77dae4f124 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:24.931018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-a526b1e1-504f-4362-aa7d-ea77dae4f124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:25.005263 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526b1e1-504f-4362-aa7d-ea77dae4f124 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:25.022370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb252f-a36a-476e-9ead-8b8b7331af84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:25.022370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb252f-a36a-476e-9ead-8b8b7331af84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:25.022370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb252f-a36a-476e-9ead-8b8b7331af84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:25.022370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb252f-a36a-476e-9ead-8b8b7331af84 admin admin] PATH_INFO: `/v3/projects/994c3f131f304f9b90445255d001f19f` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:25.022782 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb252f-a36a-476e-9ead-8b8b7331af84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=994c3f131f304f9b90445255d001f19f)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:25.022782 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb252f-a36a-476e-9ead-8b8b7331af84 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:25.216222 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0bfb252f-a36a-476e-9ead-8b8b7331af84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '994c3f131f304f9b90445255d001f19f', 'request_id': 'req-0bfb252f-a36a-476e-9ead-8b8b7331af84'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:25.222389 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0bfb252f-a36a-476e-9ead-8b8b7331af84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '994c3f131f304f9b90445255d001f19f', 'request_id': 'req-0bfb252f-a36a-476e-9ead-8b8b7331af84'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:25.229305 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0bfb252f-a36a-476e-9ead-8b8b7331af84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '994c3f131f304f9b90445255d001f19f', 'request_id': 'req-0bfb252f-a36a-476e-9ead-8b8b7331af84'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:25.253137 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:25.376152 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0bfb252f-a36a-476e-9ead-8b8b7331af84 admin admin] The token cache is being invalidate because project 994c3f131f304f9b90445255d001f19f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:25.376564 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0bfb252f-a36a-476e-9ead-8b8b7331af84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:25.377883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0bfb252f-a36a-476e-9ead-8b8b7331af84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:25.383107 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1030/2038] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:24 2022] DELETE /identity/v3/projects/994c3f131f304f9b90445255d001f19f => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:25.384672 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521f25e-7551-489f-8496-0ad41776f9b7 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:25.384920 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521f25e-7551-489f-8496-0ad41776f9b7 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:25.385228 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521f25e-7551-489f-8496-0ad41776f9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:25.415179 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-4521f25e-7551-489f-8496-0ad41776f9b7 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:25.417055 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-4521f25e-7551-489f-8496-0ad41776f9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:25.481042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1009/2039] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:25.488553 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03800407-bf32-4616-98bf-246809401200 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:25.488871 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03800407-bf32-4616-98bf-246809401200 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:25.489170 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03800407-bf32-4616-98bf-246809401200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:25.509945 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-03800407-bf32-4616-98bf-246809401200 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:25.511252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-03800407-bf32-4616-98bf-246809401200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:25.519508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1031/2040] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:25.523774 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521f25e-7551-489f-8496-0ad41776f9b7 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:25.534223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521f25e-7551-489f-8496-0ad41776f9b7 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:25.538802 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03841504-a17a-466c-beb1-65b0ace30705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:25.539396 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03841504-a17a-466c-beb1-65b0ace30705 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:25.539687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03841504-a17a-466c-beb1-65b0ace30705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:25.539954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03841504-a17a-466c-beb1-65b0ace30705 admin admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:25.540621 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03841504-a17a-466c-beb1-65b0ace30705 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:18:25.540922 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03841504-a17a-466c-beb1-65b0ace30705 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:25.542535 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03841504-a17a-466c-beb1-65b0ace30705 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:25.554871 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1010/2041] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:18:25.559104 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03800407-bf32-4616-98bf-246809401200 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:25.569254 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03800407-bf32-4616-98bf-246809401200 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:25.573978 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99532c-1174-4d5c-9a86-3c4024b0ffa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:25.574591 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99532c-1174-4d5c-9a86-3c4024b0ffa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:25.574866 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99532c-1174-4d5c-9a86-3c4024b0ffa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:25.575138 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99532c-1174-4d5c-9a86-3c4024b0ffa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:25.575765 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99532c-1174-4d5c-9a86-3c4024b0ffa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:25.577789 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99532c-1174-4d5c-9a86-3c4024b0ffa9 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:25.720119 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1032/2042] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:18:25 2022] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:25.724061 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03841504-a17a-466c-beb1-65b0ace30705 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:25.735436 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03841504-a17a-466c-beb1-65b0ace30705 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:25.799596 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479782cf-cb25-4ea5-91f1-4694cc0b1344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:25.800203 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479782cf-cb25-4ea5-91f1-4694cc0b1344 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:25.800483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479782cf-cb25-4ea5-91f1-4694cc0b1344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:25.800756 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479782cf-cb25-4ea5-91f1-4694cc0b1344 admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:25.801398 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479782cf-cb25-4ea5-91f1-4694cc0b1344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:25.803423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479782cf-cb25-4ea5-91f1-4694cc0b1344 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:25.921871 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1011/2043] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:18:25 2022] POST /identity/v3/users => generated 291 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:25.926037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99532c-1174-4d5c-9a86-3c4024b0ffa9 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:25.936256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99532c-1174-4d5c-9a86-3c4024b0ffa9 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:25.940872 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12fb90-2e8c-491f-b9ef-767dd3b50377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:25.941467 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12fb90-2e8c-491f-b9ef-767dd3b50377 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:25.941747 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12fb90-2e8c-491f-b9ef-767dd3b50377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:25.942022 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12fb90-2e8c-491f-b9ef-767dd3b50377 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:25.942698 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12fb90-2e8c-491f-b9ef-767dd3b50377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:25.944297 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12fb90-2e8c-491f-b9ef-767dd3b50377 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:25.954823 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1033/2044] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:25.960214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479782cf-cb25-4ea5-91f1-4694cc0b1344 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:25.971170 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479782cf-cb25-4ea5-91f1-4694cc0b1344 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:25.975758 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b6fac-42de-426b-949e-f31d94a3bf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:25.976392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b6fac-42de-426b-949e-f31d94a3bf4a admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:25.976668 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b6fac-42de-426b-949e-f31d94a3bf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:25.976944 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b6fac-42de-426b-949e-f31d94a3bf4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:25.977576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b6fac-42de-426b-949e-f31d94a3bf4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:25.979345 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b6fac-42de-426b-949e-f31d94a3bf4a admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:25.989847 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1012/2045] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:25.996725 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12fb90-2e8c-491f-b9ef-767dd3b50377 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:26.007052 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12fb90-2e8c-491f-b9ef-767dd3b50377 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:26.011578 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f54d3-c39a-4163-a125-f1be20809da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:26.012761 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f54d3-c39a-4163-a125-f1be20809da3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:26.013041 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f54d3-c39a-4163-a125-f1be20809da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:26.013317 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f54d3-c39a-4163-a125-f1be20809da3 admin admin] PATH_INFO: `/v3/projects/8ec6731a1772408891a3873fcd7be5af/users/3741866f7e394ee8b81087794d192987/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:26.028848 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f54d3-c39a-4163-a125-f1be20809da3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec6731a1772408891a3873fcd7be5af, user_id=3741866f7e394ee8b81087794d192987, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:26.031913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f54d3-c39a-4163-a125-f1be20809da3 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:26.181726 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1034/2046] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:25 2022] PUT /identity/v3/projects/8ec6731a1772408891a3873fcd7be5af/users/3741866f7e394ee8b81087794d192987/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:26.197105 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0fd18-e6d7-4c9a-82ed-62421d90c36e None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:26.197391 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0fd18-e6d7-4c9a-82ed-62421d90c36e None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:26.197671 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0fd18-e6d7-4c9a-82ed-62421d90c36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:26.247210 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-60b0fd18-e6d7-4c9a-82ed-62421d90c36e None None] MFA Rules not processed for user `3741866f7e394ee8b81087794d192987`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:26.248528 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-60b0fd18-e6d7-4c9a-82ed-62421d90c36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:26.316575 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1013/2047] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:18:26.322238 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f54d3-c39a-4163-a125-f1be20809da3 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:26.391245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f54d3-c39a-4163-a125-f1be20809da3 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:26.396137 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd0fb4-6ce2-4cb6-bc14-4165d657ff87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:26.396795 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd0fb4-6ce2-4cb6-bc14-4165d657ff87 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:26.397181 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd0fb4-6ce2-4cb6-bc14-4165d657ff87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:26.397456 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd0fb4-6ce2-4cb6-bc14-4165d657ff87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:26.398077 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd0fb4-6ce2-4cb6-bc14-4165d657ff87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:26.400039 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd0fb4-6ce2-4cb6-bc14-4165d657ff87 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:26.558741 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1035/2048] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:18:26 2022] POST /identity/v3/projects => generated 381 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:26.563303 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0fd18-e6d7-4c9a-82ed-62421d90c36e None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:26.575130 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0fd18-e6d7-4c9a-82ed-62421d90c36e None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:26.630826 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bd7a6-3b09-443b-beb9-a9340f17c5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:26.631434 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bd7a6-3b09-443b-beb9-a9340f17c5c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:26.631717 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bd7a6-3b09-443b-beb9-a9340f17c5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:26.631991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bd7a6-3b09-443b-beb9-a9340f17c5c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:26.632618 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bd7a6-3b09-443b-beb9-a9340f17c5c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:26.634605 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bd7a6-3b09-443b-beb9-a9340f17c5c3 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:26.752962 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1014/2049] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:18:26 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:18:26.755352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd0fb4-6ce2-4cb6-bc14-4165d657ff87 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:26.765558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd0fb4-6ce2-4cb6-bc14-4165d657ff87 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:26.770440 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b35e95-386d-47b9-b66a-60d8e50fee1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:26.771046 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b35e95-386d-47b9-b66a-60d8e50fee1f admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:26.771322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b35e95-386d-47b9-b66a-60d8e50fee1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:26.771590 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b35e95-386d-47b9-b66a-60d8e50fee1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:26.772225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b35e95-386d-47b9-b66a-60d8e50fee1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:26.773842 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b35e95-386d-47b9-b66a-60d8e50fee1f admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:26.784638 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1036/2050] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:26.791235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bd7a6-3b09-443b-beb9-a9340f17c5c3 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:26.802098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bd7a6-3b09-443b-beb9-a9340f17c5c3 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:26.807134 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7002f-007d-49dd-bb03-af4142dfdeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:26.807800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7002f-007d-49dd-bb03-af4142dfdeb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:26.808084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7002f-007d-49dd-bb03-af4142dfdeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:26.808446 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7002f-007d-49dd-bb03-af4142dfdeb0 admin admin] PATH_INFO: `/v3/projects/602267d6805d417dab58f19156b9e835/users/98fbac85644446ef8b767ab9b045cb63/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:26.825102 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7002f-007d-49dd-bb03-af4142dfdeb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=602267d6805d417dab58f19156b9e835, user_id=98fbac85644446ef8b767ab9b045cb63, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:26.827970 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7002f-007d-49dd-bb03-af4142dfdeb0 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:26.926042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1015/2051] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:26 2022] PUT /identity/v3/projects/602267d6805d417dab58f19156b9e835/users/98fbac85644446ef8b767ab9b045cb63/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:26.926685 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b35e95-386d-47b9-b66a-60d8e50fee1f admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:26.933294 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b35e95-386d-47b9-b66a-60d8e50fee1f admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:26.993152 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fbbb4-7c28-47d7-aef2-64ff2db466e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:26.993760 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fbbb4-7c28-47d7-aef2-64ff2db466e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:26.994038 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fbbb4-7c28-47d7-aef2-64ff2db466e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:26.994334 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fbbb4-7c28-47d7-aef2-64ff2db466e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:26.994971 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4fbbb4-7c28-47d7-aef2-64ff2db466e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:26.997354 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4fbbb4-7c28-47d7-aef2-64ff2db466e2 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:27.007358 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1037/2052] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:27.011563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7002f-007d-49dd-bb03-af4142dfdeb0 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:27.021918 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7002f-007d-49dd-bb03-af4142dfdeb0 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:27.026487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4072b-1e97-4eed-9f17-84f1ce7dabd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:27.027129 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4072b-1e97-4eed-9f17-84f1ce7dabd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:27.027413 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4072b-1e97-4eed-9f17-84f1ce7dabd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:27.028195 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4072b-1e97-4eed-9f17-84f1ce7dabd5 admin admin] PATH_INFO: `/v3/projects/602267d6805d417dab58f19156b9e835/users/98fbac85644446ef8b767ab9b045cb63/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:27.030354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4072b-1e97-4eed-9f17-84f1ce7dabd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=602267d6805d417dab58f19156b9e835, user_id=98fbac85644446ef8b767ab9b045cb63, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:27.033004 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4072b-1e97-4eed-9f17-84f1ce7dabd5 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:27.043062 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1016/2053] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:27 2022] PUT /identity/v3/projects/602267d6805d417dab58f19156b9e835/users/98fbac85644446ef8b767ab9b045cb63/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:27.053845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439d2be-4d88-42ac-a366-3e450db3837d None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:27.054133 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439d2be-4d88-42ac-a366-3e450db3837d None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:27.054440 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439d2be-4d88-42ac-a366-3e450db3837d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:27.081969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-d439d2be-4d88-42ac-a366-3e450db3837d None None] MFA Rules not processed for user `98fbac85644446ef8b767ab9b045cb63`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:27.083273 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-d439d2be-4d88-42ac-a366-3e450db3837d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:27.165255 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1038/2054] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:27 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:27.175462 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4072b-1e97-4eed-9f17-84f1ce7dabd5 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:27.177257 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-d2d4072b-1e97-4eed-9f17-84f1ce7dabd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:27.238701 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4072b-1e97-4eed-9f17-84f1ce7dabd5 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:27.242274 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7067d11-8c5d-4473-9578-4e53698ca56c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:27.243200 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7067d11-8c5d-4473-9578-4e53698ca56c service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:27.243484 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7067d11-8c5d-4473-9578-4e53698ca56c service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:27.243758 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7067d11-8c5d-4473-9578-4e53698ca56c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:27.253601 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7067d11-8c5d-4473-9578-4e53698ca56c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:27.256416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7067d11-8c5d-4473-9578-4e53698ca56c service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:27.264987 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1017/2055] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:27 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:27.458543 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:27.477136 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439d2be-4d88-42ac-a366-3e450db3837d None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:27.491980 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439d2be-4d88-42ac-a366-3e450db3837d None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:27.491980 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d34e5-c429-4a4a-b15c-84cc7f4f0ab2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:27.491980 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d34e5-c429-4a4a-b15c-84cc7f4f0ab2 service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:27.491980 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d34e5-c429-4a4a-b15c-84cc7f4f0ab2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:27.493950 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d34e5-c429-4a4a-b15c-84cc7f4f0ab2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:27.548166 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d34e5-c429-4a4a-b15c-84cc7f4f0ab2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:27.549610 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d34e5-c429-4a4a-b15c-84cc7f4f0ab2 service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:27.558241 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1039/2056] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:28.366003 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7067d11-8c5d-4473-9578-4e53698ca56c service cinder] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:28.428765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7067d11-8c5d-4473-9578-4e53698ca56c service cinder] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:28.433889 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e7889-1700-4cde-8527-f8f1595f3089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:28.444722 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e7889-1700-4cde-8527-f8f1595f3089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:28.444722 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e7889-1700-4cde-8527-f8f1595f3089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:28.444722 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e7889-1700-4cde-8527-f8f1595f3089 admin admin] PATH_INFO: `/v3/users/3741866f7e394ee8b81087794d192987` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:28.444722 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e7889-1700-4cde-8527-f8f1595f3089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3741866f7e394ee8b81087794d192987)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:28.444722 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e7889-1700-4cde-8527-f8f1595f3089 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:28.718560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ea7e7889-1700-4cde-8527-f8f1595f3089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3741866f7e394ee8b81087794d192987'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:28.719417 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ea7e7889-1700-4cde-8527-f8f1595f3089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3741866f7e394ee8b81087794d192987'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:28.719878 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ea7e7889-1700-4cde-8527-f8f1595f3089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3741866f7e394ee8b81087794d192987'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:28.865180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ea7e7889-1700-4cde-8527-f8f1595f3089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3741866f7e394ee8b81087794d192987'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:28.872991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ea7e7889-1700-4cde-8527-f8f1595f3089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3741866f7e394ee8b81087794d192987'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:28.891366 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1018/2057] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:28 2022] DELETE /identity/v3/users/3741866f7e394ee8b81087794d192987 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:28.895846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba2ce6-3974-48b5-89a5-a43164636d50 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:28.896293 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba2ce6-3974-48b5-89a5-a43164636d50 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:28.896410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba2ce6-3974-48b5-89a5-a43164636d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:28.903046 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:28.918842 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-9fba2ce6-3974-48b5-89a5-a43164636d50 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:28.920528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-9fba2ce6-3974-48b5-89a5-a43164636d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:29.008428 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1040/2058] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:29.019016 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e7889-1700-4cde-8527-f8f1595f3089 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:29.020486 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-ea7e7889-1700-4cde-8527-f8f1595f3089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:29.087480 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e7889-1700-4cde-8527-f8f1595f3089 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:29.092166 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9681ca-6e9a-4c43-866c-62685207687b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:29.092786 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9681ca-6e9a-4c43-866c-62685207687b service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:29.093062 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9681ca-6e9a-4c43-866c-62685207687b service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:29.093330 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9681ca-6e9a-4c43-866c-62685207687b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:29.102893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9681ca-6e9a-4c43-866c-62685207687b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:29.104407 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9681ca-6e9a-4c43-866c-62685207687b service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:29.114841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1019/2059] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:29.486040 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba2ce6-3974-48b5-89a5-a43164636d50 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:29.487536 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-9fba2ce6-3974-48b5-89a5-a43164636d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:29.500921 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba2ce6-3974-48b5-89a5-a43164636d50 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:29.505668 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ca4e4-e072-4f88-ba63-57016de31515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:29.506404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ca4e4-e072-4f88-ba63-57016de31515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:29.506767 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ca4e4-e072-4f88-ba63-57016de31515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:29.507131 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ca4e4-e072-4f88-ba63-57016de31515 admin admin] PATH_INFO: `/v3/users/77bc1f568e634e86a44040b8b2a20deb` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:29.508324 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ca4e4-e072-4f88-ba63-57016de31515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77bc1f568e634e86a44040b8b2a20deb)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:29.510334 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ca4e4-e072-4f88-ba63-57016de31515 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:29.735724 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-804ca4e4-e072-4f88-ba63-57016de31515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77bc1f568e634e86a44040b8b2a20deb'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:29.736468 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-804ca4e4-e072-4f88-ba63-57016de31515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77bc1f568e634e86a44040b8b2a20deb'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:29.737127 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-804ca4e4-e072-4f88-ba63-57016de31515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77bc1f568e634e86a44040b8b2a20deb'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:29.839245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-804ca4e4-e072-4f88-ba63-57016de31515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77bc1f568e634e86a44040b8b2a20deb'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:29.854374 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-804ca4e4-e072-4f88-ba63-57016de31515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77bc1f568e634e86a44040b8b2a20deb'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:29.870745 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1041/2060] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:29 2022] DELETE /identity/v3/users/77bc1f568e634e86a44040b8b2a20deb => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:29.873636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045d5b5-7b7c-4564-ab90-4c6aa96cd6db None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:29.874180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045d5b5-7b7c-4564-ab90-4c6aa96cd6db None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:29.874276 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045d5b5-7b7c-4564-ab90-4c6aa96cd6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:29.894789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-9045d5b5-7b7c-4564-ab90-4c6aa96cd6db None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:29.896810 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-9045d5b5-7b7c-4564-ab90-4c6aa96cd6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:29.977088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1020/2061] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:29.987647 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ca4e4-e072-4f88-ba63-57016de31515 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:29.994519 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-804ca4e4-e072-4f88-ba63-57016de31515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:30.065392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ca4e4-e072-4f88-ba63-57016de31515 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:30.069765 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb95eae-7794-4702-97a4-dc1da0df5ffb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:30.070563 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb95eae-7794-4702-97a4-dc1da0df5ffb service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:30.070917 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb95eae-7794-4702-97a4-dc1da0df5ffb service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:30.071268 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb95eae-7794-4702-97a4-dc1da0df5ffb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:30.086447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb95eae-7794-4702-97a4-dc1da0df5ffb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:30.088484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb95eae-7794-4702-97a4-dc1da0df5ffb service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:30.103329 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1042/2062] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:30.219597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045d5b5-7b7c-4564-ab90-4c6aa96cd6db None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:30.222094 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-9045d5b5-7b7c-4564-ab90-4c6aa96cd6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:30.238992 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045d5b5-7b7c-4564-ab90-4c6aa96cd6db None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:30.244072 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec690b11-be4d-46f4-82ed-5ef6e9bce4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:30.245814 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec690b11-be4d-46f4-82ed-5ef6e9bce4b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:30.246334 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec690b11-be4d-46f4-82ed-5ef6e9bce4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:30.246779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec690b11-be4d-46f4-82ed-5ef6e9bce4b8 admin admin] PATH_INFO: `/v3/projects/8ec6731a1772408891a3873fcd7be5af` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:30.249628 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec690b11-be4d-46f4-82ed-5ef6e9bce4b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ec6731a1772408891a3873fcd7be5af)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:30.252098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec690b11-be4d-46f4-82ed-5ef6e9bce4b8 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:30.363947 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ec690b11-be4d-46f4-82ed-5ef6e9bce4b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ec6731a1772408891a3873fcd7be5af', 'request_id': 'req-ec690b11-be4d-46f4-82ed-5ef6e9bce4b8'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:30.373113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ec690b11-be4d-46f4-82ed-5ef6e9bce4b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ec6731a1772408891a3873fcd7be5af', 'request_id': 'req-ec690b11-be4d-46f4-82ed-5ef6e9bce4b8'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:30.379879 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ec690b11-be4d-46f4-82ed-5ef6e9bce4b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ec6731a1772408891a3873fcd7be5af', 'request_id': 'req-ec690b11-be4d-46f4-82ed-5ef6e9bce4b8'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:30.490442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ec690b11-be4d-46f4-82ed-5ef6e9bce4b8 admin admin] The token cache is being invalidate because project 8ec6731a1772408891a3873fcd7be5af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:30.490977 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ec690b11-be4d-46f4-82ed-5ef6e9bce4b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:30.491986 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ec690b11-be4d-46f4-82ed-5ef6e9bce4b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:30.494240 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1021/2063] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:30 2022] DELETE /identity/v3/projects/8ec6731a1772408891a3873fcd7be5af => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:30.498954 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb95eae-7794-4702-97a4-dc1da0df5ffb service neutron] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:30.511834 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb95eae-7794-4702-97a4-dc1da0df5ffb service neutron] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:30.528834 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:30.587383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f0daf-248c-4de8-b08c-121e349916d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:30.588342 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f0daf-248c-4de8-b08c-121e349916d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:30.588818 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f0daf-248c-4de8-b08c-121e349916d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:30.589314 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f0daf-248c-4de8-b08c-121e349916d3 admin admin] PATH_INFO: `/v3/users/98fbac85644446ef8b767ab9b045cb63` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:30.591089 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f0daf-248c-4de8-b08c-121e349916d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98fbac85644446ef8b767ab9b045cb63)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:30.593344 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f0daf-248c-4de8-b08c-121e349916d3 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:30.817067 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-8a3f0daf-248c-4de8-b08c-121e349916d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98fbac85644446ef8b767ab9b045cb63'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:30.817782 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-8a3f0daf-248c-4de8-b08c-121e349916d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98fbac85644446ef8b767ab9b045cb63'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:30.818436 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-8a3f0daf-248c-4de8-b08c-121e349916d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98fbac85644446ef8b767ab9b045cb63'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:30.899438 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-8a3f0daf-248c-4de8-b08c-121e349916d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98fbac85644446ef8b767ab9b045cb63'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:30.930857 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-8a3f0daf-248c-4de8-b08c-121e349916d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98fbac85644446ef8b767ab9b045cb63'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:30.947693 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1043/2064] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:30 2022] DELETE /identity/v3/users/98fbac85644446ef8b767ab9b045cb63 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:31.048060 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec690b11-be4d-46f4-82ed-5ef6e9bce4b8 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:31.049564 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-ec690b11-be4d-46f4-82ed-5ef6e9bce4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:31.071495 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec690b11-be4d-46f4-82ed-5ef6e9bce4b8 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:31.153969 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134f97c-624a-493b-9c51-557e3d17caa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:31.155002 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134f97c-624a-493b-9c51-557e3d17caa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:31.155462 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134f97c-624a-493b-9c51-557e3d17caa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:31.155889 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134f97c-624a-493b-9c51-557e3d17caa0 admin admin] PATH_INFO: `/v3/projects/c3112ef0de9a44e2bedeb36bde2bf07a` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:31.157795 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134f97c-624a-493b-9c51-557e3d17caa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3112ef0de9a44e2bedeb36bde2bf07a)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:31.160115 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134f97c-624a-493b-9c51-557e3d17caa0 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:31.348411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-6134f97c-624a-493b-9c51-557e3d17caa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3112ef0de9a44e2bedeb36bde2bf07a', 'request_id': 'req-6134f97c-624a-493b-9c51-557e3d17caa0'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:31.354155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-6134f97c-624a-493b-9c51-557e3d17caa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3112ef0de9a44e2bedeb36bde2bf07a', 'request_id': 'req-6134f97c-624a-493b-9c51-557e3d17caa0'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:31.363234 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-6134f97c-624a-493b-9c51-557e3d17caa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3112ef0de9a44e2bedeb36bde2bf07a', 'request_id': 'req-6134f97c-624a-493b-9c51-557e3d17caa0'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:31.532509 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-6134f97c-624a-493b-9c51-557e3d17caa0 admin admin] The token cache is being invalidate because project c3112ef0de9a44e2bedeb36bde2bf07a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:31.532805 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-6134f97c-624a-493b-9c51-557e3d17caa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:31.533519 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-6134f97c-624a-493b-9c51-557e3d17caa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:31.535351 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1022/2065] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:31 2022] DELETE /identity/v3/projects/c3112ef0de9a44e2bedeb36bde2bf07a => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:31.539449 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f0daf-248c-4de8-b08c-121e349916d3 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:31.541036 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-8a3f0daf-248c-4de8-b08c-121e349916d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:31.573589 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134f97c-624a-493b-9c51-557e3d17caa0 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:31.575467 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-6134f97c-624a-493b-9c51-557e3d17caa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:31.589699 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f0daf-248c-4de8-b08c-121e349916d3 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:31.712358 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9956e79-2f2b-4def-a54b-5f138c65146c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:31.713854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9956e79-2f2b-4def-a54b-5f138c65146c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:31.714976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9956e79-2f2b-4def-a54b-5f138c65146c admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:31.715466 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9956e79-2f2b-4def-a54b-5f138c65146c admin admin] PATH_INFO: `/v3/users/79300c0a4474428ca36ed7f4fe14e7b5` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:31.717572 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9956e79-2f2b-4def-a54b-5f138c65146c admin admin] RBAC: Authorizing `identity:delete_user(user_id=79300c0a4474428ca36ed7f4fe14e7b5)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:31.719948 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9956e79-2f2b-4def-a54b-5f138c65146c admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:31.739583 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134f97c-624a-493b-9c51-557e3d17caa0 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:31.755730 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a83d7-f2fa-4d3d-8768-e624ee9dbace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:31.756394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a83d7-f2fa-4d3d-8768-e624ee9dbace admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:31.758086 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a83d7-f2fa-4d3d-8768-e624ee9dbace admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:31.758402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a83d7-f2fa-4d3d-8768-e624ee9dbace admin admin] PATH_INFO: `/v3/projects/602267d6805d417dab58f19156b9e835` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:31.759641 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a83d7-f2fa-4d3d-8768-e624ee9dbace admin admin] RBAC: Authorizing `identity:delete_project(project_id=602267d6805d417dab58f19156b9e835)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:31.761898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a83d7-f2fa-4d3d-8768-e624ee9dbace admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:31.835491 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:31.953760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-816a83d7-f2fa-4d3d-8768-e624ee9dbace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '602267d6805d417dab58f19156b9e835', 'request_id': 'req-816a83d7-f2fa-4d3d-8768-e624ee9dbace'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:31.954263 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-e9956e79-2f2b-4def-a54b-5f138c65146c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79300c0a4474428ca36ed7f4fe14e7b5'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:31.954990 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-e9956e79-2f2b-4def-a54b-5f138c65146c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79300c0a4474428ca36ed7f4fe14e7b5'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:31.955611 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-e9956e79-2f2b-4def-a54b-5f138c65146c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79300c0a4474428ca36ed7f4fe14e7b5'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:31.961118 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-816a83d7-f2fa-4d3d-8768-e624ee9dbace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '602267d6805d417dab58f19156b9e835', 'request_id': 'req-816a83d7-f2fa-4d3d-8768-e624ee9dbace'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:31.967818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-816a83d7-f2fa-4d3d-8768-e624ee9dbace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '602267d6805d417dab58f19156b9e835', 'request_id': 'req-816a83d7-f2fa-4d3d-8768-e624ee9dbace'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:32.062920 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-e9956e79-2f2b-4def-a54b-5f138c65146c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79300c0a4474428ca36ed7f4fe14e7b5'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:32.081335 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-e9956e79-2f2b-4def-a54b-5f138c65146c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79300c0a4474428ca36ed7f4fe14e7b5'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:32.098779 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1044/2066] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:31 2022] DELETE /identity/v3/users/79300c0a4474428ca36ed7f4fe14e7b5 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:32.180301 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-816a83d7-f2fa-4d3d-8768-e624ee9dbace admin admin] The token cache is being invalidate because project 602267d6805d417dab58f19156b9e835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:32.182082 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-816a83d7-f2fa-4d3d-8768-e624ee9dbace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:32.182679 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-816a83d7-f2fa-4d3d-8768-e624ee9dbace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:32.188433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1023/2067] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:31 2022] DELETE /identity/v3/projects/602267d6805d417dab58f19156b9e835 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:32.193337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c684d-abaa-40c6-9738-87affc908db3 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:32.193667 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c684d-abaa-40c6-9738-87affc908db3 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:32.194225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c684d-abaa-40c6-9738-87affc908db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:32.223953 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-7a4c684d-abaa-40c6-9738-87affc908db3 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:32.225446 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-7a4c684d-abaa-40c6-9738-87affc908db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:32.261812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:32.326469 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1045/2068] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:32.329225 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2c225-79e1-4f31-b113-f850c0438ed2 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:32.329512 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2c225-79e1-4f31-b113-f850c0438ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:32.329786 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2c225-79e1-4f31-b113-f850c0438ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:32.352323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-46a2c225-79e1-4f31-b113-f850c0438ed2 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:32.353811 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-46a2c225-79e1-4f31-b113-f850c0438ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:32.366992 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1024/2069] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:32.371412 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c684d-abaa-40c6-9738-87affc908db3 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:32.384493 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c684d-abaa-40c6-9738-87affc908db3 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:32.391745 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5886787-e1bc-46d2-9143-06625e99ff56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:32.392852 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5886787-e1bc-46d2-9143-06625e99ff56 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:32.392852 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5886787-e1bc-46d2-9143-06625e99ff56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:32.393214 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5886787-e1bc-46d2-9143-06625e99ff56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:32.394113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5886787-e1bc-46d2-9143-06625e99ff56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:18:32.394512 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5886787-e1bc-46d2-9143-06625e99ff56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:32.396670 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5886787-e1bc-46d2-9143-06625e99ff56 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:32.414573 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1046/2070] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:18:32.415887 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2c225-79e1-4f31-b113-f850c0438ed2 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:32.427307 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2c225-79e1-4f31-b113-f850c0438ed2 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:32.435405 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ca629-ca8c-4ee1-b92b-f433f0387a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:32.436200 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ca629-ca8c-4ee1-b92b-f433f0387a64 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:32.437283 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ca629-ca8c-4ee1-b92b-f433f0387a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:32.437283 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ca629-ca8c-4ee1-b92b-f433f0387a64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:32.437634 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ca629-ca8c-4ee1-b92b-f433f0387a64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:32.439680 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ca629-ca8c-4ee1-b92b-f433f0387a64 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:32.553985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1025/2071] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:18:32 2022] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:32.558693 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5886787-e1bc-46d2-9143-06625e99ff56 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:32.570048 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5886787-e1bc-46d2-9143-06625e99ff56 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:32.663829 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8b0ec-2a80-4cd6-8304-b495cd001f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:32.665229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8b0ec-2a80-4cd6-8304-b495cd001f51 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:32.665890 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8b0ec-2a80-4cd6-8304-b495cd001f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:32.666540 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8b0ec-2a80-4cd6-8304-b495cd001f51 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:32.672362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8b0ec-2a80-4cd6-8304-b495cd001f51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:32.672362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8b0ec-2a80-4cd6-8304-b495cd001f51 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:32.834052 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1047/2072] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:18:32 2022] POST /identity/v3/users => generated 289 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:32.837626 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ca629-ca8c-4ee1-b92b-f433f0387a64 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:32.850467 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ca629-ca8c-4ee1-b92b-f433f0387a64 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:32.857719 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d1d74-c90f-4e56-b5df-4c60357b530b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:32.858368 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d1d74-c90f-4e56-b5df-4c60357b530b admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:32.858709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d1d74-c90f-4e56-b5df-4c60357b530b admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:32.859021 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d1d74-c90f-4e56-b5df-4c60357b530b admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:32.859617 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d1d74-c90f-4e56-b5df-4c60357b530b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:32.862318 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d1d74-c90f-4e56-b5df-4c60357b530b admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:32.875471 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1026/2073] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:32.879299 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8b0ec-2a80-4cd6-8304-b495cd001f51 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:32.892408 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8b0ec-2a80-4cd6-8304-b495cd001f51 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:32.897818 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce2b1c-5c23-46d7-9ba5-57c6ef226760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:32.898344 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce2b1c-5c23-46d7-9ba5-57c6ef226760 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:32.898701 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce2b1c-5c23-46d7-9ba5-57c6ef226760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:32.898894 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce2b1c-5c23-46d7-9ba5-57c6ef226760 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:32.899534 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce2b1c-5c23-46d7-9ba5-57c6ef226760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:32.901135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce2b1c-5c23-46d7-9ba5-57c6ef226760 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:32.916105 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1048/2074] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:18:32.917336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d1d74-c90f-4e56-b5df-4c60357b530b admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:32.933478 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d1d74-c90f-4e56-b5df-4c60357b530b admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:32.939334 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46eb03b-b7e2-4373-b7ea-5713e68063a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:32.940047 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46eb03b-b7e2-4373-b7ea-5713e68063a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:32.940327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46eb03b-b7e2-4373-b7ea-5713e68063a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:32.940639 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46eb03b-b7e2-4373-b7ea-5713e68063a2 admin admin] PATH_INFO: `/v3/projects/64e144137d44495796efd726c0ae3cb8/users/4b86febd6e5a47e18b246fe69375d7a9/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:32.956157 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46eb03b-b7e2-4373-b7ea-5713e68063a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e144137d44495796efd726c0ae3cb8, user_id=4b86febd6e5a47e18b246fe69375d7a9, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:32.958987 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46eb03b-b7e2-4373-b7ea-5713e68063a2 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:33.037344 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce2b1c-5c23-46d7-9ba5-57c6ef226760 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:33.039299 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-76ce2b1c-5c23-46d7-9ba5-57c6ef226760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:33.056089 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce2b1c-5c23-46d7-9ba5-57c6ef226760 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:33.061444 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18bc06-5cff-4f90-9dea-e13954d59ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:33.062428 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18bc06-5cff-4f90-9dea-e13954d59ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:33.062739 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18bc06-5cff-4f90-9dea-e13954d59ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:33.063218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18bc06-5cff-4f90-9dea-e13954d59ea2 admin admin] PATH_INFO: `/v3/projects/4a90570279a2447eb30e33b378cdfab7` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:33.069167 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18bc06-5cff-4f90-9dea-e13954d59ea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a90570279a2447eb30e33b378cdfab7)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:33.071295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18bc06-5cff-4f90-9dea-e13954d59ea2 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:33.077277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1027/2075] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:32 2022] PUT /identity/v3/projects/64e144137d44495796efd726c0ae3cb8/users/4b86febd6e5a47e18b246fe69375d7a9/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:33.089517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934d82c-cfde-458d-b9c2-1f74a1688d9a None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:33.090535 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934d82c-cfde-458d-b9c2-1f74a1688d9a None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:33.090953 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934d82c-cfde-458d-b9c2-1f74a1688d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:33.146197 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-e934d82c-cfde-458d-b9c2-1f74a1688d9a None None] MFA Rules not processed for user `4b86febd6e5a47e18b246fe69375d7a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:33.147767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-e934d82c-cfde-458d-b9c2-1f74a1688d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:33.219384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1028/2076] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:33.223874 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934d82c-cfde-458d-b9c2-1f74a1688d9a None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:33.256780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0f18bc06-5cff-4f90-9dea-e13954d59ea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a90570279a2447eb30e33b378cdfab7', 'request_id': 'req-0f18bc06-5cff-4f90-9dea-e13954d59ea2'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:33.262423 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0f18bc06-5cff-4f90-9dea-e13954d59ea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a90570279a2447eb30e33b378cdfab7', 'request_id': 'req-0f18bc06-5cff-4f90-9dea-e13954d59ea2'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:33.269110 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0f18bc06-5cff-4f90-9dea-e13954d59ea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a90570279a2447eb30e33b378cdfab7', 'request_id': 'req-0f18bc06-5cff-4f90-9dea-e13954d59ea2'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:33.300627 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934d82c-cfde-458d-b9c2-1f74a1688d9a None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:33.367211 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f63484-a4d2-411d-b731-640f60da7361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:33.367211 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f63484-a4d2-411d-b731-640f60da7361 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:33.367211 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f63484-a4d2-411d-b731-640f60da7361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:33.367211 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f63484-a4d2-411d-b731-640f60da7361 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:33.367657 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f63484-a4d2-411d-b731-640f60da7361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:33.367657 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f63484-a4d2-411d-b731-640f60da7361 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:33.367813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0f18bc06-5cff-4f90-9dea-e13954d59ea2 admin admin] The token cache is being invalidate because project 4a90570279a2447eb30e33b378cdfab7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:33.367813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0f18bc06-5cff-4f90-9dea-e13954d59ea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:33.368473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0f18bc06-5cff-4f90-9dea-e13954d59ea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:33.373346 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1049/2077] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:33 2022] DELETE /identity/v3/projects/4a90570279a2447eb30e33b378cdfab7 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:18:33.374820 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18bc06-5cff-4f90-9dea-e13954d59ea2 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:33.376153 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-0f18bc06-5cff-4f90-9dea-e13954d59ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:33.396129 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18bc06-5cff-4f90-9dea-e13954d59ea2 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:33.402614 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1f2e7-1919-465b-8b12-e62fed60604a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:33.403413 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1f2e7-1919-465b-8b12-e62fed60604a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:33.403773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1f2e7-1919-465b-8b12-e62fed60604a admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:33.404276 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1f2e7-1919-465b-8b12-e62fed60604a admin admin] PATH_INFO: `/v3/users/bbc5aace5d3f4adc936c47535259a73b` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:33.405862 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1f2e7-1919-465b-8b12-e62fed60604a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbc5aace5d3f4adc936c47535259a73b)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:33.407905 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1f2e7-1919-465b-8b12-e62fed60604a admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:33.508398 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1029/2078] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:18:33 2022] POST /identity/v3/projects => generated 377 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:18:33.509577 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f63484-a4d2-411d-b731-640f60da7361 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:33.511702 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-70f63484-a4d2-411d-b731-640f60da7361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:33.563899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:33.577056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f63484-a4d2-411d-b731-640f60da7361 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:33.581746 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5f1f5-259a-4cb1-86ce-e87ae0ac3b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:33.582384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5f1f5-259a-4cb1-86ce-e87ae0ac3b32 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:33.582667 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5f1f5-259a-4cb1-86ce-e87ae0ac3b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:33.582939 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5f1f5-259a-4cb1-86ce-e87ae0ac3b32 admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:33.583555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5f1f5-259a-4cb1-86ce-e87ae0ac3b32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:33.585491 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5f1f5-259a-4cb1-86ce-e87ae0ac3b32 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:33.716347 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1030/2079] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:18:33 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:18:33.718052 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5f1f5-259a-4cb1-86ce-e87ae0ac3b32 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:33.727932 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d2f1f2e7-1919-465b-8b12-e62fed60604a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbc5aace5d3f4adc936c47535259a73b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:33.728700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d2f1f2e7-1919-465b-8b12-e62fed60604a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbc5aace5d3f4adc936c47535259a73b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:33.729394 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d2f1f2e7-1919-465b-8b12-e62fed60604a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbc5aace5d3f4adc936c47535259a73b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:33.737034 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5f1f5-259a-4cb1-86ce-e87ae0ac3b32 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:33.742646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ee15f-2e58-4d4d-8ec5-203f14c9c24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:33.743316 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ee15f-2e58-4d4d-8ec5-203f14c9c24a admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:33.743603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ee15f-2e58-4d4d-8ec5-203f14c9c24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:33.743884 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ee15f-2e58-4d4d-8ec5-203f14c9c24a admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:33.746160 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ee15f-2e58-4d4d-8ec5-203f14c9c24a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:33.747909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ee15f-2e58-4d4d-8ec5-203f14c9c24a admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:33.759459 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1031/2080] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:33.764226 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ee15f-2e58-4d4d-8ec5-203f14c9c24a admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:33.766073 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-bb1ee15f-2e58-4d4d-8ec5-203f14c9c24a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:33.782051 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ee15f-2e58-4d4d-8ec5-203f14c9c24a admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:33.789018 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1dc0e-96d4-48e5-a1b7-a38ea10c5f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:33.789018 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1dc0e-96d4-48e5-a1b7-a38ea10c5f39 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:33.789018 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1dc0e-96d4-48e5-a1b7-a38ea10c5f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:33.789018 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1dc0e-96d4-48e5-a1b7-a38ea10c5f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:33.789564 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1dc0e-96d4-48e5-a1b7-a38ea10c5f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:33.790456 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1dc0e-96d4-48e5-a1b7-a38ea10c5f39 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:33.802811 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1032/2081] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:18:33.806753 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1dc0e-96d4-48e5-a1b7-a38ea10c5f39 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:33.819086 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1dc0e-96d4-48e5-a1b7-a38ea10c5f39 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:33.825443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c25045-d4b9-4438-a1ef-cd8828d003c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:33.826141 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c25045-d4b9-4438-a1ef-cd8828d003c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:33.826609 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c25045-d4b9-4438-a1ef-cd8828d003c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:33.826820 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c25045-d4b9-4438-a1ef-cd8828d003c4 admin admin] PATH_INFO: `/v3/projects/5bee32d4983c462d8e84e529360f71ec/users/87940332d2754bb2b0381f2d775d1109/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:33.838514 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d2f1f2e7-1919-465b-8b12-e62fed60604a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbc5aace5d3f4adc936c47535259a73b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:33.847266 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c25045-d4b9-4438-a1ef-cd8828d003c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bee32d4983c462d8e84e529360f71ec, user_id=87940332d2754bb2b0381f2d775d1109, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:33.850927 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c25045-d4b9-4438-a1ef-cd8828d003c4 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:33.860608 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d2f1f2e7-1919-465b-8b12-e62fed60604a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbc5aace5d3f4adc936c47535259a73b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:33.878180 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1050/2082] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:33 2022] DELETE /identity/v3/users/bbc5aace5d3f4adc936c47535259a73b => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:33.982562 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1033/2083] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:33 2022] PUT /identity/v3/projects/5bee32d4983c462d8e84e529360f71ec/users/87940332d2754bb2b0381f2d775d1109/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:18:33.984611 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414ed0a-3ea1-44f7-a61c-f053eaa530b8 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:33.984930 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414ed0a-3ea1-44f7-a61c-f053eaa530b8 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:33.985256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414ed0a-3ea1-44f7-a61c-f053eaa530b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:34.014298 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-e414ed0a-3ea1-44f7-a61c-f053eaa530b8 None None] MFA Rules not processed for user `87940332d2754bb2b0381f2d775d1109`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:34.015565 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-e414ed0a-3ea1-44f7-a61c-f053eaa530b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:34.025103 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:34.132394 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1051/2084] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:34.138024 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c25045-d4b9-4438-a1ef-cd8828d003c4 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:34.272059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c25045-d4b9-4438-a1ef-cd8828d003c4 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:34.277832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bb21c-1f5b-44ec-94b7-300300f2ff27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:34.278499 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bb21c-1f5b-44ec-94b7-300300f2ff27 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:34.278863 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bb21c-1f5b-44ec-94b7-300300f2ff27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:34.279137 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bb21c-1f5b-44ec-94b7-300300f2ff27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:34.279773 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402bb21c-1f5b-44ec-94b7-300300f2ff27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:34.281908 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402bb21c-1f5b-44ec-94b7-300300f2ff27 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:34.431242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1034/2085] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:18:34 2022] POST /identity/v3/projects => generated 377 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:34.435516 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414ed0a-3ea1-44f7-a61c-f053eaa530b8 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:34.454344 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414ed0a-3ea1-44f7-a61c-f053eaa530b8 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:34.505962 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75a153-213e-4a31-bb38-890488787d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:34.506678 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75a153-213e-4a31-bb38-890488787d75 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:34.506954 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75a153-213e-4a31-bb38-890488787d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:34.507225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75a153-213e-4a31-bb38-890488787d75 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:34.507846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba75a153-213e-4a31-bb38-890488787d75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:34.513363 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba75a153-213e-4a31-bb38-890488787d75 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:34.579451 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5902d87-071c-4241-9b38-f9f582821a46 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:34.579903 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5902d87-071c-4241-9b38-f9f582821a46 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:34.580188 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5902d87-071c-4241-9b38-f9f582821a46 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:34.583640 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1035/2086] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 23 08:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 08:18:34.584807 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5902d87-071c-4241-9b38-f9f582821a46 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:34.586644 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-f5902d87-071c-4241-9b38-f9f582821a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:34.614272 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5902d87-071c-4241-9b38-f9f582821a46 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:34.620262 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3edef-3e78-4f22-9386-f15226a9a21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:34.620910 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3edef-3e78-4f22-9386-f15226a9a21b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:34.621194 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3edef-3e78-4f22-9386-f15226a9a21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:34.621472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3edef-3e78-4f22-9386-f15226a9a21b admin admin] PATH_INFO: `/v3/projects/9c29e0f8e6bc49b9924727b959469de7` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:34.622739 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3edef-3e78-4f22-9386-f15226a9a21b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c29e0f8e6bc49b9924727b959469de7)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:34.624645 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3edef-3e78-4f22-9386-f15226a9a21b admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:34.639695 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1052/2087] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:18:34 2022] POST /identity/v3/users => generated 295 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:34.642462 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9d378-e53e-46d1-bede-3bc3dc5233ce None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:34.642462 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9d378-e53e-46d1-bede-3bc3dc5233ce None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:34.642462 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9d378-e53e-46d1-bede-3bc3dc5233ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:34.660783 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-bdd9d378-e53e-46d1-bede-3bc3dc5233ce None None] MFA Rules not processed for user `8e92560dd9da4c7cbcac5a84bcaca483`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:34.661996 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-bdd9d378-e53e-46d1-bede-3bc3dc5233ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:34.730115 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1053/2088] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 23 08:18:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:34.731873 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9d378-e53e-46d1-bede-3bc3dc5233ce None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:34.746673 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9d378-e53e-46d1-bede-3bc3dc5233ce None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:34.754062 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d320bcc-c44e-415c-bf07-ccd3b5e8a8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:34.754729 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d320bcc-c44e-415c-bf07-ccd3b5e8a8fb admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:34.755053 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d320bcc-c44e-415c-bf07-ccd3b5e8a8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:34.755330 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d320bcc-c44e-415c-bf07-ccd3b5e8a8fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:34.755985 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d320bcc-c44e-415c-bf07-ccd3b5e8a8fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:34.757599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d320bcc-c44e-415c-bf07-ccd3b5e8a8fb admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:34.766845 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-b6d3edef-3e78-4f22-9386-f15226a9a21b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c29e0f8e6bc49b9924727b959469de7', 'request_id': 'req-b6d3edef-3e78-4f22-9386-f15226a9a21b'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:34.769491 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1054/2089] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:34.770556 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d320bcc-c44e-415c-bf07-ccd3b5e8a8fb admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:34.772184 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-5d320bcc-c44e-415c-bf07-ccd3b5e8a8fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:34.772396 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-b6d3edef-3e78-4f22-9386-f15226a9a21b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c29e0f8e6bc49b9924727b959469de7', 'request_id': 'req-b6d3edef-3e78-4f22-9386-f15226a9a21b'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:34.779127 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-b6d3edef-3e78-4f22-9386-f15226a9a21b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c29e0f8e6bc49b9924727b959469de7', 'request_id': 'req-b6d3edef-3e78-4f22-9386-f15226a9a21b'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:34.785212 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d320bcc-c44e-415c-bf07-ccd3b5e8a8fb admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:34.840231 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b059c3-5e8b-4993-a16c-065d019168e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:34.840892 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b059c3-5e8b-4993-a16c-065d019168e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:34.841173 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b059c3-5e8b-4993-a16c-065d019168e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:34.841446 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b059c3-5e8b-4993-a16c-065d019168e4 admin admin] PATH_INFO: `/v3/users/256afdbdf6c240af87478fe03996f5c0` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:34.842602 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b059c3-5e8b-4993-a16c-065d019168e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=256afdbdf6c240af87478fe03996f5c0)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:34.844528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b059c3-5e8b-4993-a16c-065d019168e4 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:34.875445 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-b6d3edef-3e78-4f22-9386-f15226a9a21b admin admin] The token cache is being invalidate because project 9c29e0f8e6bc49b9924727b959469de7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:34.875744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-b6d3edef-3e78-4f22-9386-f15226a9a21b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:34.876552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-b6d3edef-3e78-4f22-9386-f15226a9a21b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:34.878058 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1036/2090] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:34 2022] DELETE /identity/v3/projects/9c29e0f8e6bc49b9924727b959469de7 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:34.878843 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3edef-3e78-4f22-9386-f15226a9a21b admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:34.881475 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-b6d3edef-3e78-4f22-9386-f15226a9a21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:34.956430 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3edef-3e78-4f22-9386-f15226a9a21b admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:34.961659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74163f2-1a08-42d2-a985-87bbe0f9a340 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e92560dd9da4c7cbcac5a84bcaca483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:34.962382 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74163f2-1a08-42d2-a985-87bbe0f9a340 service placement] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:34.962804 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74163f2-1a08-42d2-a985-87bbe0f9a340 service placement] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:34.963087 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74163f2-1a08-42d2-a985-87bbe0f9a340 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:34.964839 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-d74163f2-1a08-42d2-a985-87bbe0f9a340 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:34.976720 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74163f2-1a08-42d2-a985-87bbe0f9a340 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:34.978925 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74163f2-1a08-42d2-a985-87bbe0f9a340 service placement] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:34.988899 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1037/2091] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:34.989718 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74163f2-1a08-42d2-a985-87bbe0f9a340 service placement] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:34.991263 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-d74163f2-1a08-42d2-a985-87bbe0f9a340 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:35.007941 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74163f2-1a08-42d2-a985-87bbe0f9a340 service placement] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:35.012021 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc32d6-6a9b-4956-af5c-e99ccbcdaca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:35.012172 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-c6b059c3-5e8b-4993-a16c-065d019168e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '256afdbdf6c240af87478fe03996f5c0'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:35.012746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-c6b059c3-5e8b-4993-a16c-065d019168e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '256afdbdf6c240af87478fe03996f5c0'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:35.012859 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc32d6-6a9b-4956-af5c-e99ccbcdaca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:35.013108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc32d6-6a9b-4956-af5c-e99ccbcdaca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:35.013349 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc32d6-6a9b-4956-af5c-e99ccbcdaca6 admin admin] PATH_INFO: `/v3/projects/37f8932b9e8c4bbb8f1fc1f3dad93b43/users/2faf244dfc2a4ee8851cf1befaeda873/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:35.013493 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-c6b059c3-5e8b-4993-a16c-065d019168e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '256afdbdf6c240af87478fe03996f5c0'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:35.030212 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc32d6-6a9b-4956-af5c-e99ccbcdaca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f8932b9e8c4bbb8f1fc1f3dad93b43, user_id=2faf244dfc2a4ee8851cf1befaeda873, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:35.032964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc32d6-6a9b-4956-af5c-e99ccbcdaca6 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:35.112745 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-c6b059c3-5e8b-4993-a16c-065d019168e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '256afdbdf6c240af87478fe03996f5c0'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:35.126081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-c6b059c3-5e8b-4993-a16c-065d019168e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '256afdbdf6c240af87478fe03996f5c0'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:35.132658 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1038/2092] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:34 2022] PUT /identity/v3/projects/37f8932b9e8c4bbb8f1fc1f3dad93b43/users/2faf244dfc2a4ee8851cf1befaeda873/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:35.133898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1784db-3e2b-44dd-8dd1-6ec1ba05ff55 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:35.134828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1784db-3e2b-44dd-8dd1-6ec1ba05ff55 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:35.134995 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1784db-3e2b-44dd-8dd1-6ec1ba05ff55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:35.140719 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1055/2093] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:34 2022] DELETE /identity/v3/users/256afdbdf6c240af87478fe03996f5c0 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:35.141611 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b059c3-5e8b-4993-a16c-065d019168e4 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:35.143277 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c6b059c3-5e8b-4993-a16c-065d019168e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:35.166508 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-8c1784db-3e2b-44dd-8dd1-6ec1ba05ff55 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:35.167737 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-8c1784db-3e2b-44dd-8dd1-6ec1ba05ff55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:35.216172 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b059c3-5e8b-4993-a16c-065d019168e4 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:35.221187 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac949e89-549b-4619-9932-7f030c35681a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:35.221795 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac949e89-549b-4619-9932-7f030c35681a admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:35.222075 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac949e89-549b-4619-9932-7f030c35681a admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:35.222495 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac949e89-549b-4619-9932-7f030c35681a admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:35.223170 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac949e89-549b-4619-9932-7f030c35681a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:35.224838 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac949e89-549b-4619-9932-7f030c35681a admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:35.234420 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1039/2094] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:35.235971 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1056/2095] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:35.243655 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1784db-3e2b-44dd-8dd1-6ec1ba05ff55 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:35.245658 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1deb08c-ca0a-43ad-9840-94a1677af5e4 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:35.245943 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1deb08c-ca0a-43ad-9840-94a1677af5e4 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:35.250496 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1deb08c-ca0a-43ad-9840-94a1677af5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:35.250970 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=81,keystone:DELETE=14,keystone:INSERT=5 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:35.254707 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1784db-3e2b-44dd-8dd1-6ec1ba05ff55 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:35.259593 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76325af8-fac9-499e-88de-6dd61531e5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:35.260332 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76325af8-fac9-499e-88de-6dd61531e5e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:35.260613 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76325af8-fac9-499e-88de-6dd61531e5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:35.260886 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76325af8-fac9-499e-88de-6dd61531e5e0 admin admin] PATH_INFO: `/v3/projects/37f8932b9e8c4bbb8f1fc1f3dad93b43/users/2faf244dfc2a4ee8851cf1befaeda873/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:35.263077 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76325af8-fac9-499e-88de-6dd61531e5e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f8932b9e8c4bbb8f1fc1f3dad93b43, user_id=2faf244dfc2a4ee8851cf1befaeda873, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:35.265915 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76325af8-fac9-499e-88de-6dd61531e5e0 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:35.271853 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-d1deb08c-ca0a-43ad-9840-94a1677af5e4 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:35.273060 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-d1deb08c-ca0a-43ad-9840-94a1677af5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:35.279198 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1040/2096] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:35 2022] PUT /identity/v3/projects/37f8932b9e8c4bbb8f1fc1f3dad93b43/users/2faf244dfc2a4ee8851cf1befaeda873/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:35.289153 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdd919-2617-40e0-9ce8-08d140af27d2 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:35.289435 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdd919-2617-40e0-9ce8-08d140af27d2 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:35.289707 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdd919-2617-40e0-9ce8-08d140af27d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:35.324354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-e4fdd919-2617-40e0-9ce8-08d140af27d2 None None] MFA Rules not processed for user `2faf244dfc2a4ee8851cf1befaeda873`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:35.325743 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-e4fdd919-2617-40e0-9ce8-08d140af27d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:35.341740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1057/2097] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:35.345955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1deb08c-ca0a-43ad-9840-94a1677af5e4 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:35.355379 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1deb08c-ca0a-43ad-9840-94a1677af5e4 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:35.360306 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2e3cb-2604-4903-8c84-0953a8092887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:35.360952 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2e3cb-2604-4903-8c84-0953a8092887 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:35.361235 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2e3cb-2604-4903-8c84-0953a8092887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:35.362906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2e3cb-2604-4903-8c84-0953a8092887 admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:35.362906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2e3cb-2604-4903-8c84-0953a8092887 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:18:35.362906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2e3cb-2604-4903-8c84-0953a8092887 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:35.364049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2e3cb-2604-4903-8c84-0953a8092887 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:35.376201 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1058/2098] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 08:18:35.382655 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2e3cb-2604-4903-8c84-0953a8092887 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:35.391227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2e3cb-2604-4903-8c84-0953a8092887 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:35.396730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea11a29-c070-4bcd-8685-7dc794d811ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:35.397117 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea11a29-c070-4bcd-8685-7dc794d811ce admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:35.401852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1041/2099] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:18:35.402008 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea11a29-c070-4bcd-8685-7dc794d811ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:35.402008 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea11a29-c070-4bcd-8685-7dc794d811ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:35.402008 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea11a29-c070-4bcd-8685-7dc794d811ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:35.402008 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea11a29-c070-4bcd-8685-7dc794d811ce admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:35.411434 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdd919-2617-40e0-9ce8-08d140af27d2 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:35.413635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-e4fdd919-2617-40e0-9ce8-08d140af27d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:35.431736 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdd919-2617-40e0-9ce8-08d140af27d2 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:35.436718 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b8866-c119-449a-9f39-179831de03cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:35.437361 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b8866-c119-449a-9f39-179831de03cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:35.437640 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b8866-c119-449a-9f39-179831de03cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:35.437915 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b8866-c119-449a-9f39-179831de03cd admin admin] PATH_INFO: `/v3/projects/5bd118a2368e43cda4de3b820d9cbdf2` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:35.439134 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b8866-c119-449a-9f39-179831de03cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bd118a2368e43cda4de3b820d9cbdf2)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:35.441072 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b8866-c119-449a-9f39-179831de03cd admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:35.522507 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1059/2100] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:18:35 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:18:35.523696 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea11a29-c070-4bcd-8685-7dc794d811ce admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:35.526353 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-4ea11a29-c070-4bcd-8685-7dc794d811ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:35.564126 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-840b8866-c119-449a-9f39-179831de03cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bd118a2368e43cda4de3b820d9cbdf2', 'request_id': 'req-840b8866-c119-449a-9f39-179831de03cd'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:35.572474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-840b8866-c119-449a-9f39-179831de03cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bd118a2368e43cda4de3b820d9cbdf2', 'request_id': 'req-840b8866-c119-449a-9f39-179831de03cd'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:35.584207 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-840b8866-c119-449a-9f39-179831de03cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bd118a2368e43cda4de3b820d9cbdf2', 'request_id': 'req-840b8866-c119-449a-9f39-179831de03cd'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:35.595812 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea11a29-c070-4bcd-8685-7dc794d811ce admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:35.606494 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:35.650261 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cb675-8868-4cfe-bb16-a22e54a662fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:35.650261 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cb675-8868-4cfe-bb16-a22e54a662fc service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:35.650261 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cb675-8868-4cfe-bb16-a22e54a662fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:35.650261 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cb675-8868-4cfe-bb16-a22e54a662fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:35.651043 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c66cb675-8868-4cfe-bb16-a22e54a662fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:35.669992 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-840b8866-c119-449a-9f39-179831de03cd admin admin] The token cache is being invalidate because project 5bd118a2368e43cda4de3b820d9cbdf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:35.670402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-840b8866-c119-449a-9f39-179831de03cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:35.676104 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-840b8866-c119-449a-9f39-179831de03cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:35.676104 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1042/2101] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:35 2022] DELETE /identity/v3/projects/5bd118a2368e43cda4de3b820d9cbdf2 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:35.676104 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b8866-c119-449a-9f39-179831de03cd admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:35.676104 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-840b8866-c119-449a-9f39-179831de03cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:35.712339 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66cb675-8868-4cfe-bb16-a22e54a662fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:35.714239 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66cb675-8868-4cfe-bb16-a22e54a662fc service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:35.723566 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1060/2102] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:35.724620 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651af548-4fb8-44d8-b874-f1bec23352cd None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:35.724950 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651af548-4fb8-44d8-b874-f1bec23352cd None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:35.725630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651af548-4fb8-44d8-b874-f1bec23352cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:35.741912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b8866-c119-449a-9f39-179831de03cd admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:35.746892 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6596f7-2892-440c-a8ed-438ae1fa7603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:35.747509 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6596f7-2892-440c-a8ed-438ae1fa7603 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:35.747725 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-651af548-4fb8-44d8-b874-f1bec23352cd None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:35.747859 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6596f7-2892-440c-a8ed-438ae1fa7603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:35.748079 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6596f7-2892-440c-a8ed-438ae1fa7603 admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:35.748731 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6596f7-2892-440c-a8ed-438ae1fa7603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:35.748947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-651af548-4fb8-44d8-b874-f1bec23352cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:35.750705 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6596f7-2892-440c-a8ed-438ae1fa7603 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:35.762600 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1061/2103] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:35.769468 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ff6b4-a990-4380-8989-6b46ed8ad8d7 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:35.769468 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ff6b4-a990-4380-8989-6b46ed8ad8d7 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:35.769468 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ff6b4-a990-4380-8989-6b46ed8ad8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:35.788772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-717ff6b4-a990-4380-8989-6b46ed8ad8d7 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:35.790190 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-717ff6b4-a990-4380-8989-6b46ed8ad8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:35.797969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1062/2104] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:18:35.801938 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ff6b4-a990-4380-8989-6b46ed8ad8d7 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:35.811077 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ff6b4-a990-4380-8989-6b46ed8ad8d7 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:35.815804 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1603ac-bfae-4556-8c24-9bbe3b9478e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:35.816383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1603ac-bfae-4556-8c24-9bbe3b9478e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:35.816659 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1603ac-bfae-4556-8c24-9bbe3b9478e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:35.816931 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1603ac-bfae-4556-8c24-9bbe3b9478e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:35.817560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1603ac-bfae-4556-8c24-9bbe3b9478e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:18:35.817857 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1603ac-bfae-4556-8c24-9bbe3b9478e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:35.819473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1603ac-bfae-4556-8c24-9bbe3b9478e6 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:35.835831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1063/2105] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 08:18:35.837576 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1603ac-bfae-4556-8c24-9bbe3b9478e6 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:35.847801 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1603ac-bfae-4556-8c24-9bbe3b9478e6 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:35.853566 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c4f79-430e-47c7-bba9-d9087ff783d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:35.854569 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c4f79-430e-47c7-bba9-d9087ff783d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:35.854948 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c4f79-430e-47c7-bba9-d9087ff783d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:35.855228 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c4f79-430e-47c7-bba9-d9087ff783d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:35.855844 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c4f79-430e-47c7-bba9-d9087ff783d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:35.856726 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1043/2106] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:18:35 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:35.857780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c4f79-430e-47c7-bba9-d9087ff783d7 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:35.861184 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6596f7-2892-440c-a8ed-438ae1fa7603 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:35.872917 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6596f7-2892-440c-a8ed-438ae1fa7603 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:35.878156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58ae9d-1fc8-460b-a6b7-44e3bb54027f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:35.878859 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58ae9d-1fc8-460b-a6b7-44e3bb54027f admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:35.879141 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58ae9d-1fc8-460b-a6b7-44e3bb54027f admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:35.879418 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58ae9d-1fc8-460b-a6b7-44e3bb54027f admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:35.880065 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58ae9d-1fc8-460b-a6b7-44e3bb54027f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:35.881669 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58ae9d-1fc8-460b-a6b7-44e3bb54027f admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:35.893106 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1044/2107] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:18:35.897008 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58ae9d-1fc8-460b-a6b7-44e3bb54027f admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:35.907094 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58ae9d-1fc8-460b-a6b7-44e3bb54027f admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:35.911654 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3d5d6-6487-4831-8299-092e79c412d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:35.912215 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3d5d6-6487-4831-8299-092e79c412d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:35.912499 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3d5d6-6487-4831-8299-092e79c412d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:35.912769 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3d5d6-6487-4831-8299-092e79c412d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:35.913378 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3d5d6-6487-4831-8299-092e79c412d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:35.914998 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3d5d6-6487-4831-8299-092e79c412d4 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:35.924631 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1045/2108] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:18:35.928341 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3d5d6-6487-4831-8299-092e79c412d4 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:35.938051 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3d5d6-6487-4831-8299-092e79c412d4 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:35.942772 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80d13f-dba6-4dbc-bfe9-001c0fc1454e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:35.943385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80d13f-dba6-4dbc-bfe9-001c0fc1454e admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:35.943666 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80d13f-dba6-4dbc-bfe9-001c0fc1454e admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:35.943938 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80d13f-dba6-4dbc-bfe9-001c0fc1454e admin admin] PATH_INFO: `/v3/projects/04a8828f51054c91876e6625249949f2/users/9cc3915f22a7453f8a8548e2e7b07b74/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:35.958984 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80d13f-dba6-4dbc-bfe9-001c0fc1454e admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a8828f51054c91876e6625249949f2, user_id=9cc3915f22a7453f8a8548e2e7b07b74, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:35.962342 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80d13f-dba6-4dbc-bfe9-001c0fc1454e admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:36.048946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1064/2109] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:18:35 2022] POST /identity/v3/projects => generated 377 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:18:36.054185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c4f79-430e-47c7-bba9-d9087ff783d7 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:36.104125 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1046/2110] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:35 2022] PUT /identity/v3/projects/04a8828f51054c91876e6625249949f2/users/9cc3915f22a7453f8a8548e2e7b07b74/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:18:36.115324 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f561c-141e-4468-b4ce-bf71cd330b7e None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:36.115610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f561c-141e-4468-b4ce-bf71cd330b7e None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:36.115711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c4f79-430e-47c7-bba9-d9087ff783d7 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:36.115890 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f561c-141e-4468-b4ce-bf71cd330b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:36.144930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-756f561c-141e-4468-b4ce-bf71cd330b7e None None] MFA Rules not processed for user `9cc3915f22a7453f8a8548e2e7b07b74`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:36.146148 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-756f561c-141e-4468-b4ce-bf71cd330b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:36.176487 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4754a8e-4128-4e3e-ac2a-0b44a8d1bed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:36.177094 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4754a8e-4128-4e3e-ac2a-0b44a8d1bed0 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:36.177385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4754a8e-4128-4e3e-ac2a-0b44a8d1bed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:36.177664 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4754a8e-4128-4e3e-ac2a-0b44a8d1bed0 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:36.178306 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4754a8e-4128-4e3e-ac2a-0b44a8d1bed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:36.180859 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4754a8e-4128-4e3e-ac2a-0b44a8d1bed0 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:36.212513 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1047/2111] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:18:36.217292 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f561c-141e-4468-b4ce-bf71cd330b7e None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:36.227264 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f561c-141e-4468-b4ce-bf71cd330b7e None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:36.231781 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253eb23-47dc-463d-b034-634fb17a0fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:36.232348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253eb23-47dc-463d-b034-634fb17a0fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:36.232625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253eb23-47dc-463d-b034-634fb17a0fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:36.232893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253eb23-47dc-463d-b034-634fb17a0fd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:36.233496 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253eb23-47dc-463d-b034-634fb17a0fd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:36.235455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253eb23-47dc-463d-b034-634fb17a0fd0 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:36.298107 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1065/2112] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:18:36 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:18:36.299109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4754a8e-4128-4e3e-ac2a-0b44a8d1bed0 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:36.309473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4754a8e-4128-4e3e-ac2a-0b44a8d1bed0 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:36.314147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27297c8e-5404-4aa9-9072-b1232cdc5e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:36.314760 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27297c8e-5404-4aa9-9072-b1232cdc5e97 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:36.315053 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27297c8e-5404-4aa9-9072-b1232cdc5e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:36.315313 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27297c8e-5404-4aa9-9072-b1232cdc5e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:36.316066 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27297c8e-5404-4aa9-9072-b1232cdc5e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:36.317659 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27297c8e-5404-4aa9-9072-b1232cdc5e97 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:36.328467 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1066/2113] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:36.332308 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27297c8e-5404-4aa9-9072-b1232cdc5e97 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:36.341847 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27297c8e-5404-4aa9-9072-b1232cdc5e97 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:36.346646 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e0003-4447-4509-b6fc-c02f47d39e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:36.347211 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e0003-4447-4509-b6fc-c02f47d39e93 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:36.347489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e0003-4447-4509-b6fc-c02f47d39e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:36.347760 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e0003-4447-4509-b6fc-c02f47d39e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:36.348373 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e0003-4447-4509-b6fc-c02f47d39e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:36.350091 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e0003-4447-4509-b6fc-c02f47d39e93 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:36.361019 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1067/2114] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:18:36.365259 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e0003-4447-4509-b6fc-c02f47d39e93 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:36.375426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e0003-4447-4509-b6fc-c02f47d39e93 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:36.380162 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779b3d3-8da4-45a8-8b13-fd0204e10ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:36.380774 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779b3d3-8da4-45a8-8b13-fd0204e10ea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:36.381053 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779b3d3-8da4-45a8-8b13-fd0204e10ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:36.381327 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779b3d3-8da4-45a8-8b13-fd0204e10ea5 admin admin] PATH_INFO: `/v3/projects/f133163cd74e4517b36716642bc5a22d/users/a7d7c99fd9e842bdaf539186f7aa0492/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:36.388293 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1048/2115] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:18:36 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:18:36.396254 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779b3d3-8da4-45a8-8b13-fd0204e10ea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f133163cd74e4517b36716642bc5a22d, user_id=a7d7c99fd9e842bdaf539186f7aa0492, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:36.397741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253eb23-47dc-463d-b034-634fb17a0fd0 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:36.399275 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779b3d3-8da4-45a8-8b13-fd0204e10ea5 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:36.458645 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253eb23-47dc-463d-b034-634fb17a0fd0 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:36.463335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37031550-cd38-41db-bd46-55a117019585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:36.463933 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37031550-cd38-41db-bd46-55a117019585 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:36.464211 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37031550-cd38-41db-bd46-55a117019585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:36.464483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37031550-cd38-41db-bd46-55a117019585 admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:36.465089 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37031550-cd38-41db-bd46-55a117019585 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:36.467078 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37031550-cd38-41db-bd46-55a117019585 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:36.485251 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1068/2116] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:36 2022] PUT /identity/v3/projects/f133163cd74e4517b36716642bc5a22d/users/a7d7c99fd9e842bdaf539186f7aa0492/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:18:36.490642 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af83298-d475-42bb-a015-883df6c6d54b None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:36.491042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af83298-d475-42bb-a015-883df6c6d54b None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:36.491323 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af83298-d475-42bb-a015-883df6c6d54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:36.512424 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-6af83298-d475-42bb-a015-883df6c6d54b None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:36.515604 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-6af83298-d475-42bb-a015-883df6c6d54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:36.576503 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1049/2117] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:18:36 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:18:36.577387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37031550-cd38-41db-bd46-55a117019585 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:36.581890 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1069/2118] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:18:36.591621 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af83298-d475-42bb-a015-883df6c6d54b None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:36.593008 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-6af83298-d475-42bb-a015-883df6c6d54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:36.594725 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37031550-cd38-41db-bd46-55a117019585 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:36.602969 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c74f15-5566-412e-82d7-2775951d19e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:36.603612 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c74f15-5566-412e-82d7-2775951d19e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:36.603975 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c74f15-5566-412e-82d7-2775951d19e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:36.604323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c74f15-5566-412e-82d7-2775951d19e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:36.605095 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c74f15-5566-412e-82d7-2775951d19e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:36.607217 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c74f15-5566-412e-82d7-2775951d19e0 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:36.622650 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1050/2119] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:36.626889 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c74f15-5566-412e-82d7-2775951d19e0 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:36.644087 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c74f15-5566-412e-82d7-2775951d19e0 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:36.645207 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a8ffd-b072-4e5b-b5a4-63c5981b24d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:36.645951 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a8ffd-b072-4e5b-b5a4-63c5981b24d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:36.646336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a8ffd-b072-4e5b-b5a4-63c5981b24d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:36.646630 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a8ffd-b072-4e5b-b5a4-63c5981b24d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:36.647380 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a8ffd-b072-4e5b-b5a4-63c5981b24d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:36.649291 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a8ffd-b072-4e5b-b5a4-63c5981b24d0 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:36.661342 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1051/2120] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:18:36.682238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a8ffd-b072-4e5b-b5a4-63c5981b24d0 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:36.682683 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af83298-d475-42bb-a015-883df6c6d54b None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:36.685668 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a8ffd-b072-4e5b-b5a4-63c5981b24d0 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:36.688390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce848a0-893b-4c42-8937-ec0e972fa958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:36.689012 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce848a0-893b-4c42-8937-ec0e972fa958 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:36.690487 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce848a0-893b-4c42-8937-ec0e972fa958 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:36.690965 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce848a0-893b-4c42-8937-ec0e972fa958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:36.692676 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd392712-9e8b-4368-b558-fff937ea18a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:36.693552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd392712-9e8b-4368-b558-fff937ea18a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:36.693937 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd392712-9e8b-4368-b558-fff937ea18a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:36.694372 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd392712-9e8b-4368-b558-fff937ea18a6 admin admin] PATH_INFO: `/v3/projects/f2863a5b8d824c51a1d3ad4b1a9fc983/users/e7179d1ead0644199db9c7f07f70c7b2/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:36.702821 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce848a0-893b-4c42-8937-ec0e972fa958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:36.704496 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce848a0-893b-4c42-8937-ec0e972fa958 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:36.721797 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd392712-9e8b-4368-b558-fff937ea18a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2863a5b8d824c51a1d3ad4b1a9fc983, user_id=e7179d1ead0644199db9c7f07f70c7b2, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:36.727201 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd392712-9e8b-4368-b558-fff937ea18a6 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:36.734195 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1070/2121] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:18:36.827452 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1052/2122] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:36 2022] PUT /identity/v3/projects/f2863a5b8d824c51a1d3ad4b1a9fc983/users/e7179d1ead0644199db9c7f07f70c7b2/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:36.829539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f8984-1dd8-40e0-9acf-f02c8ff1a4d2 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:36.829832 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f8984-1dd8-40e0-9acf-f02c8ff1a4d2 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:36.830111 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f8984-1dd8-40e0-9acf-f02c8ff1a4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:36.865245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-964f8984-1dd8-40e0-9acf-f02c8ff1a4d2 None None] MFA Rules not processed for user `e7179d1ead0644199db9c7f07f70c7b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:36.867513 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-964f8984-1dd8-40e0-9acf-f02c8ff1a4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:36.963516 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1071/2123] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:36.967980 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd392712-9e8b-4368-b558-fff937ea18a6 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:37.035919 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd392712-9e8b-4368-b558-fff937ea18a6 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:37.040787 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff48754-ade6-4107-ab0e-bd5b7736fe10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:37.041429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff48754-ade6-4107-ab0e-bd5b7736fe10 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:37.041711 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff48754-ade6-4107-ab0e-bd5b7736fe10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:37.041986 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff48754-ade6-4107-ab0e-bd5b7736fe10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:37.042674 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff48754-ade6-4107-ab0e-bd5b7736fe10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:37.044593 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff48754-ade6-4107-ab0e-bd5b7736fe10 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:37.153652 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:37.160848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1053/2124] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:18:36 2022] POST /identity/v3/projects => generated 385 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:37.166093 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f8984-1dd8-40e0-9acf-f02c8ff1a4d2 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:37.180349 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f8984-1dd8-40e0-9acf-f02c8ff1a4d2 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:37.238065 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ed56c-ef6c-479c-a6a7-360d426732cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:37.238769 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ed56c-ef6c-479c-a6a7-360d426732cd admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:37.239035 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ed56c-ef6c-479c-a6a7-360d426732cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:37.239340 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ed56c-ef6c-479c-a6a7-360d426732cd admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:37.241658 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ed56c-ef6c-479c-a6a7-360d426732cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:37.242615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ed56c-ef6c-479c-a6a7-360d426732cd admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:37.356266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1072/2125] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:18:37 2022] POST /identity/v3/users => generated 299 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:18:37.357538 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff48754-ade6-4107-ab0e-bd5b7736fe10 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:37.369414 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff48754-ade6-4107-ab0e-bd5b7736fe10 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:37.374472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41845153-2c0b-453f-a0f4-3ad28c9c7313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:37.375123 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41845153-2c0b-453f-a0f4-3ad28c9c7313 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:37.375407 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41845153-2c0b-453f-a0f4-3ad28c9c7313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:37.375681 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41845153-2c0b-453f-a0f4-3ad28c9c7313 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:37.376323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41845153-2c0b-453f-a0f4-3ad28c9c7313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:37.377982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41845153-2c0b-453f-a0f4-3ad28c9c7313 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:37.389929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1054/2126] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:18:37.394468 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ed56c-ef6c-479c-a6a7-360d426732cd admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:37.405118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ed56c-ef6c-479c-a6a7-360d426732cd admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:37.409801 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc41bc-501d-4ba0-b2e8-0218937313cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:37.410494 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc41bc-501d-4ba0-b2e8-0218937313cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:37.410777 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc41bc-501d-4ba0-b2e8-0218937313cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:37.411054 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc41bc-501d-4ba0-b2e8-0218937313cc admin admin] PATH_INFO: `/v3/projects/feffaeda682c464aba71035fac77523d/users/9c981908b08247759dc9f9d6449036a1/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:37.431457 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc41bc-501d-4ba0-b2e8-0218937313cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=feffaeda682c464aba71035fac77523d, user_id=9c981908b08247759dc9f9d6449036a1, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:37.434153 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc41bc-501d-4ba0-b2e8-0218937313cc admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:37.542528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1073/2127] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:37 2022] PUT /identity/v3/projects/feffaeda682c464aba71035fac77523d/users/9c981908b08247759dc9f9d6449036a1/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:18:37.546710 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41845153-2c0b-453f-a0f4-3ad28c9c7313 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:37.556942 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41845153-2c0b-453f-a0f4-3ad28c9c7313 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:37.627761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad53b1-72d8-43c9-a3b5-b9c6693e7e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:37.629581 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad53b1-72d8-43c9-a3b5-b9c6693e7e19 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:37.629581 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad53b1-72d8-43c9-a3b5-b9c6693e7e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:37.629581 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad53b1-72d8-43c9-a3b5-b9c6693e7e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:37.629921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad53b1-72d8-43c9-a3b5-b9c6693e7e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:37.631529 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad53b1-72d8-43c9-a3b5-b9c6693e7e19 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:37.658874 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1055/2128] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:37.661025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc41bc-501d-4ba0-b2e8-0218937313cc admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:37.676748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc41bc-501d-4ba0-b2e8-0218937313cc admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:37.683039 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8e699-95cb-4702-8fe5-767118aff1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:37.683717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8e699-95cb-4702-8fe5-767118aff1b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:37.684003 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8e699-95cb-4702-8fe5-767118aff1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:37.684281 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8e699-95cb-4702-8fe5-767118aff1b7 admin admin] PATH_INFO: `/v3/projects/feffaeda682c464aba71035fac77523d/users/9c981908b08247759dc9f9d6449036a1/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:37.686467 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8e699-95cb-4702-8fe5-767118aff1b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feffaeda682c464aba71035fac77523d, user_id=9c981908b08247759dc9f9d6449036a1, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:37.689666 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8e699-95cb-4702-8fe5-767118aff1b7 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:37.702144 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1074/2129] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:37 2022] PUT /identity/v3/projects/feffaeda682c464aba71035fac77523d/users/9c981908b08247759dc9f9d6449036a1/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:37.714244 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fe868-3cfe-4ea0-99d5-46c8a06db782 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:37.714730 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fe868-3cfe-4ea0-99d5-46c8a06db782 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:37.715014 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fe868-3cfe-4ea0-99d5-46c8a06db782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:37.752988 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-298fe868-3cfe-4ea0-99d5-46c8a06db782 None None] MFA Rules not processed for user `9c981908b08247759dc9f9d6449036a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:37.754212 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-298fe868-3cfe-4ea0-99d5-46c8a06db782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:37.829248 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1056/2130] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:37.837900 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8e699-95cb-4702-8fe5-767118aff1b7 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:37.839704 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-baf8e699-95cb-4702-8fe5-767118aff1b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:37.918200 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8e699-95cb-4702-8fe5-767118aff1b7 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:37.923709 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578257ca-014d-4107-88f1-07187967118e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:37.923709 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578257ca-014d-4107-88f1-07187967118e service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:37.923709 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578257ca-014d-4107-88f1-07187967118e service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:37.923709 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578257ca-014d-4107-88f1-07187967118e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:37.992240 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578257ca-014d-4107-88f1-07187967118e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:37.994376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578257ca-014d-4107-88f1-07187967118e service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:38.005163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1075/2131] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:38.127829 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:39.028358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fe868-3cfe-4ea0-99d5-46c8a06db782 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:39.029835 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-298fe868-3cfe-4ea0-99d5-46c8a06db782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:39.047059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fe868-3cfe-4ea0-99d5-46c8a06db782 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:39.054423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778dd7de-4b80-430d-a2b0-d8aa7a0b356a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:39.055298 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778dd7de-4b80-430d-a2b0-d8aa7a0b356a service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:39.055744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778dd7de-4b80-430d-a2b0-d8aa7a0b356a service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:39.056220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778dd7de-4b80-430d-a2b0-d8aa7a0b356a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:39.058805 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-778dd7de-4b80-430d-a2b0-d8aa7a0b356a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:39.166892 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778dd7de-4b80-430d-a2b0-d8aa7a0b356a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:39.171482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778dd7de-4b80-430d-a2b0-d8aa7a0b356a service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:39.195946 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1057/2132] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:40.396875 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:40.989664 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:41.115286 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578257ca-014d-4107-88f1-07187967118e service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:41.126659 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578257ca-014d-4107-88f1-07187967118e service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:41.132760 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba891528-d582-411b-82e5-0be987f0148f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:41.133388 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba891528-d582-411b-82e5-0be987f0148f service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:41.133673 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba891528-d582-411b-82e5-0be987f0148f service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:41.133949 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba891528-d582-411b-82e5-0be987f0148f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:41.136154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-ba891528-d582-411b-82e5-0be987f0148f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:41.207811 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778dd7de-4b80-430d-a2b0-d8aa7a0b356a service cinder] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:41.216366 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778dd7de-4b80-430d-a2b0-d8aa7a0b356a service cinder] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:41.220170 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba891528-d582-411b-82e5-0be987f0148f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:41.220513 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d36cc-abe5-40e7-ad51-4fdc17ad2eac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:41.221474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d36cc-abe5-40e7-ad51-4fdc17ad2eac service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:41.221888 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d36cc-abe5-40e7-ad51-4fdc17ad2eac service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:41.222232 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d36cc-abe5-40e7-ad51-4fdc17ad2eac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:41.222867 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba891528-d582-411b-82e5-0be987f0148f service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:41.247998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1076/2133] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:41.287530 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d36cc-abe5-40e7-ad51-4fdc17ad2eac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:41.288992 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d36cc-abe5-40e7-ad51-4fdc17ad2eac service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:41.299900 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1058/2134] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:18:41.821708 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:43.337039 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba891528-d582-411b-82e5-0be987f0148f service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:43.346507 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba891528-d582-411b-82e5-0be987f0148f service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:43.353429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fc0c5-d29a-4c23-9b19-7484e153e7a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:43.354060 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fc0c5-d29a-4c23-9b19-7484e153e7a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:43.354537 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fc0c5-d29a-4c23-9b19-7484e153e7a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:43.354818 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fc0c5-d29a-4c23-9b19-7484e153e7a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:43.369504 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290fc0c5-d29a-4c23-9b19-7484e153e7a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:43.371523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290fc0c5-d29a-4c23-9b19-7484e153e7a0 service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:43.405393 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1077/2135] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:43 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:43.672352 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:43.693493 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bed1c2-74b1-4559-a292-14b04b29a55c None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:43.693875 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bed1c2-74b1-4559-a292-14b04b29a55c None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:43.694207 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bed1c2-74b1-4559-a292-14b04b29a55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:43.729555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-80bed1c2-74b1-4559-a292-14b04b29a55c None None] MFA Rules not processed for user `a7d7c99fd9e842bdaf539186f7aa0492`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:43.730640 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-80bed1c2-74b1-4559-a292-14b04b29a55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:43.744553 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:43.815006 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1059/2136] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:43.829408 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fc0c5-d29a-4c23-9b19-7484e153e7a0 service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:43.830873 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-290fc0c5-d29a-4c23-9b19-7484e153e7a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:43.905871 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fc0c5-d29a-4c23-9b19-7484e153e7a0 service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:43.911355 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977c81f-81fb-41a1-8193-623d80cb2f4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:43.911952 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977c81f-81fb-41a1-8193-623d80cb2f4b service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:43.912307 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977c81f-81fb-41a1-8193-623d80cb2f4b service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:43.912622 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977c81f-81fb-41a1-8193-623d80cb2f4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:43.920598 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977c81f-81fb-41a1-8193-623d80cb2f4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:43.922373 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977c81f-81fb-41a1-8193-623d80cb2f4b service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:43.931063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1078/2137] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:18:45.556428 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:46.811527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:47.165310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc846085-5dee-4465-b78d-ada597897187 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:47.165944 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc846085-5dee-4465-b78d-ada597897187 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:47.166584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc846085-5dee-4465-b78d-ada597897187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:47.199824 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-fc846085-5dee-4465-b78d-ada597897187 None None] MFA Rules not processed for user `a7d7c99fd9e842bdaf539186f7aa0492`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:47.201045 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-fc846085-5dee-4465-b78d-ada597897187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:47.208419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1060/2138] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:47.787094 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977c81f-81fb-41a1-8193-623d80cb2f4b service nova] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:47.788609 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-0977c81f-81fb-41a1-8193-623d80cb2f4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:47.873996 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977c81f-81fb-41a1-8193-623d80cb2f4b service nova] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:47.878750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214549f-801f-4c17-995c-57bd8d67ed8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:47.880178 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214549f-801f-4c17-995c-57bd8d67ed8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:47.880178 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214549f-801f-4c17-995c-57bd8d67ed8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:47.880178 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214549f-801f-4c17-995c-57bd8d67ed8a admin admin] PATH_INFO: `/v3/users/4b86febd6e5a47e18b246fe69375d7a9` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:47.881234 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214549f-801f-4c17-995c-57bd8d67ed8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b86febd6e5a47e18b246fe69375d7a9)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:47.883216 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214549f-801f-4c17-995c-57bd8d67ed8a admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:48.097300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:48.252041 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-c214549f-801f-4c17-995c-57bd8d67ed8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b86febd6e5a47e18b246fe69375d7a9'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:48.253007 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-c214549f-801f-4c17-995c-57bd8d67ed8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b86febd6e5a47e18b246fe69375d7a9'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:48.253651 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-c214549f-801f-4c17-995c-57bd8d67ed8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b86febd6e5a47e18b246fe69375d7a9'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:48.485066 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-c214549f-801f-4c17-995c-57bd8d67ed8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b86febd6e5a47e18b246fe69375d7a9'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:48.513893 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-c214549f-801f-4c17-995c-57bd8d67ed8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b86febd6e5a47e18b246fe69375d7a9'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:48.532727 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1079/2139] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:47 2022] DELETE /identity/v3/users/4b86febd6e5a47e18b246fe69375d7a9 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:48.538391 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb41de-72f2-4bd6-b5d8-a320559f4860 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:48.538867 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb41de-72f2-4bd6-b5d8-a320559f4860 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:48.538957 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb41de-72f2-4bd6-b5d8-a320559f4860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:48.560215 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-3efb41de-72f2-4bd6-b5d8-a320559f4860 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:48.563108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-3efb41de-72f2-4bd6-b5d8-a320559f4860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:48.631585 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1061/2140] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:48.642149 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214549f-801f-4c17-995c-57bd8d67ed8a admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:48.644118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c214549f-801f-4c17-995c-57bd8d67ed8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:48.735118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214549f-801f-4c17-995c-57bd8d67ed8a admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:48.739002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e8e51-eb4b-47be-9a77-d7c95dd9a098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:48.739622 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e8e51-eb4b-47be-9a77-d7c95dd9a098 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:48.739906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e8e51-eb4b-47be-9a77-d7c95dd9a098 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:48.740184 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e8e51-eb4b-47be-9a77-d7c95dd9a098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:48.752383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e8e51-eb4b-47be-9a77-d7c95dd9a098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:48.753859 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e8e51-eb4b-47be-9a77-d7c95dd9a098 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:48.769423 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1080/2141] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:48.805262 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53639b38-90fe-43fe-b31b-af58a1aa4b25 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:48.805563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53639b38-90fe-43fe-b31b-af58a1aa4b25 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:48.812020 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53639b38-90fe-43fe-b31b-af58a1aa4b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:48.852511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-53639b38-90fe-43fe-b31b-af58a1aa4b25 None None] MFA Rules not processed for user `970300b51d504a2bbc48158855f02f34`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:48.866405 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-53639b38-90fe-43fe-b31b-af58a1aa4b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:48.966370 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1062/2142] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 23 08:18:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:49.023883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e8e51-eb4b-47be-9a77-d7c95dd9a098 service neutron] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:49.025980 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-326e8e51-eb4b-47be-9a77-d7c95dd9a098 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:49.123113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e8e51-eb4b-47be-9a77-d7c95dd9a098 service neutron] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:49.127027 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7dca08-5b40-45fd-b155-70dbfe121da3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4718cad0c0b9461d9c4152d7ea4b385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:49.127895 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dca08-5b40-45fd-b155-70dbfe121da3 service swift] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:49.128274 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dca08-5b40-45fd-b155-70dbfe121da3 service swift] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:49.128558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dca08-5b40-45fd-b155-70dbfe121da3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:49.139652 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7dca08-5b40-45fd-b155-70dbfe121da3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:49.143004 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7dca08-5b40-45fd-b155-70dbfe121da3 service swift] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:49.155212 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1081/2143] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 23 08:18:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 08:18:49.424646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53639b38-90fe-43fe-b31b-af58a1aa4b25 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:49.427310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-53639b38-90fe-43fe-b31b-af58a1aa4b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:49.452308 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53639b38-90fe-43fe-b31b-af58a1aa4b25 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:49.458938 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa3fdf-8a0f-4776-97b7-a1bf076b4bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:49.459840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa3fdf-8a0f-4776-97b7-a1bf076b4bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:49.459996 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa3fdf-8a0f-4776-97b7-a1bf076b4bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:49.460597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa3fdf-8a0f-4776-97b7-a1bf076b4bd7 admin admin] PATH_INFO: `/v3/projects/64e144137d44495796efd726c0ae3cb8` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:49.461800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa3fdf-8a0f-4776-97b7-a1bf076b4bd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64e144137d44495796efd726c0ae3cb8)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:49.476185 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa3fdf-8a0f-4776-97b7-a1bf076b4bd7 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:49.545119 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7dca08-5b40-45fd-b155-70dbfe121da3 service swift] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:49.546579 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-ed7dca08-5b40-45fd-b155-70dbfe121da3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:49.560158 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7dca08-5b40-45fd-b155-70dbfe121da3 service swift] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:49.564802 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0830840-c729-4551-a5a4-9472a103e0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:49.565363 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0830840-c729-4551-a5a4-9472a103e0d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:49.565612 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0830840-c729-4551-a5a4-9472a103e0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:49.566049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0830840-c729-4551-a5a4-9472a103e0d4 admin admin] PATH_INFO: `/v3/users/9cc3915f22a7453f8a8548e2e7b07b74` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:49.570819 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0830840-c729-4551-a5a4-9472a103e0d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cc3915f22a7453f8a8548e2e7b07b74)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:49.570819 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0830840-c729-4551-a5a4-9472a103e0d4 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:49.641691 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-f3aa3fdf-8a0f-4776-97b7-a1bf076b4bd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64e144137d44495796efd726c0ae3cb8', 'request_id': 'req-f3aa3fdf-8a0f-4776-97b7-a1bf076b4bd7'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:49.648082 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-f3aa3fdf-8a0f-4776-97b7-a1bf076b4bd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64e144137d44495796efd726c0ae3cb8', 'request_id': 'req-f3aa3fdf-8a0f-4776-97b7-a1bf076b4bd7'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:49.657328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-f3aa3fdf-8a0f-4776-97b7-a1bf076b4bd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64e144137d44495796efd726c0ae3cb8', 'request_id': 'req-f3aa3fdf-8a0f-4776-97b7-a1bf076b4bd7'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:49.782829 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-f3aa3fdf-8a0f-4776-97b7-a1bf076b4bd7 admin admin] The token cache is being invalidate because project 64e144137d44495796efd726c0ae3cb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:49.783122 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-f3aa3fdf-8a0f-4776-97b7-a1bf076b4bd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:49.783761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-f3aa3fdf-8a0f-4776-97b7-a1bf076b4bd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:49.785261 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1063/2144] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:49 2022] DELETE /identity/v3/projects/64e144137d44495796efd726c0ae3cb8 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:49.789139 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa3fdf-8a0f-4776-97b7-a1bf076b4bd7 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:49.790926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-f3aa3fdf-8a0f-4776-97b7-a1bf076b4bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:49.846765 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-b0830840-c729-4551-a5a4-9472a103e0d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cc3915f22a7453f8a8548e2e7b07b74'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:49.847451 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-b0830840-c729-4551-a5a4-9472a103e0d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cc3915f22a7453f8a8548e2e7b07b74'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:49.848117 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-b0830840-c729-4551-a5a4-9472a103e0d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cc3915f22a7453f8a8548e2e7b07b74'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:49.866953 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa3fdf-8a0f-4776-97b7-a1bf076b4bd7 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:49.873076 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf589d7-2df5-4e56-be88-37ad40a8c660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:49.873731 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf589d7-2df5-4e56-be88-37ad40a8c660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:49.873995 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf589d7-2df5-4e56-be88-37ad40a8c660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:49.874459 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf589d7-2df5-4e56-be88-37ad40a8c660 admin admin] PATH_INFO: `/v3/users/87940332d2754bb2b0381f2d775d1109` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:49.880421 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf589d7-2df5-4e56-be88-37ad40a8c660 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87940332d2754bb2b0381f2d775d1109)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:49.880421 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf589d7-2df5-4e56-be88-37ad40a8c660 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:49.937156 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-b0830840-c729-4551-a5a4-9472a103e0d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cc3915f22a7453f8a8548e2e7b07b74'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:49.955657 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-b0830840-c729-4551-a5a4-9472a103e0d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cc3915f22a7453f8a8548e2e7b07b74'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:49.970526 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1082/2145] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:49 2022] DELETE /identity/v3/users/9cc3915f22a7453f8a8548e2e7b07b74 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:18:49.976135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13de2f-77c9-40c4-a1f4-1a9153bc442e None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:49.981557 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13de2f-77c9-40c4-a1f4-1a9153bc442e None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:49.981557 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13de2f-77c9-40c4-a1f4-1a9153bc442e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:50.009514 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-df13de2f-77c9-40c4-a1f4-1a9153bc442e None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:50.012064 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-df13de2f-77c9-40c4-a1f4-1a9153bc442e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:50.075556 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1083/2146] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:50.086039 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13de2f-77c9-40c4-a1f4-1a9153bc442e None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:50.088170 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-df13de2f-77c9-40c4-a1f4-1a9153bc442e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:50.100517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-bbf589d7-2df5-4e56-be88-37ad40a8c660 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87940332d2754bb2b0381f2d775d1109'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:50.105305 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-bbf589d7-2df5-4e56-be88-37ad40a8c660 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87940332d2754bb2b0381f2d775d1109'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:50.106817 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-bbf589d7-2df5-4e56-be88-37ad40a8c660 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87940332d2754bb2b0381f2d775d1109'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:50.160600 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13de2f-77c9-40c4-a1f4-1a9153bc442e None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:50.164532 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d381d-4efd-425b-9cac-a1a8a25f2270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:50.165693 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d381d-4efd-425b-9cac-a1a8a25f2270 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:50.165973 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d381d-4efd-425b-9cac-a1a8a25f2270 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:50.166275 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d381d-4efd-425b-9cac-a1a8a25f2270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:50.168015 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-fd4d381d-4efd-425b-9cac-a1a8a25f2270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:50.179976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d381d-4efd-425b-9cac-a1a8a25f2270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:50.181545 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d381d-4efd-425b-9cac-a1a8a25f2270 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:50.191160 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1084/2147] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:50.256945 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-bbf589d7-2df5-4e56-be88-37ad40a8c660 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87940332d2754bb2b0381f2d775d1109'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:50.267248 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-bbf589d7-2df5-4e56-be88-37ad40a8c660 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87940332d2754bb2b0381f2d775d1109'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:50.289277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1064/2148] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:49 2022] DELETE /identity/v3/users/87940332d2754bb2b0381f2d775d1109 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:18:50.313031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368a2b3-ce54-4d8d-af64-4f9bdb867355 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:50.313576 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368a2b3-ce54-4d8d-af64-4f9bdb867355 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:50.314109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368a2b3-ce54-4d8d-af64-4f9bdb867355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:50.335936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-d368a2b3-ce54-4d8d-af64-4f9bdb867355 None None] MFA Rules not processed for user `970300b51d504a2bbc48158855f02f34`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:50.338762 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-d368a2b3-ce54-4d8d-af64-4f9bdb867355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:50.428487 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1085/2149] 10.222.0.57 () {58 vars in 967 bytes} [Tue Aug 23 08:18:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:50.442098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf589d7-2df5-4e56-be88-37ad40a8c660 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:50.443625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-bbf589d7-2df5-4e56-be88-37ad40a8c660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:50.520032 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:50.534178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf589d7-2df5-4e56-be88-37ad40a8c660 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:50.543777 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea404a9-9b60-4f4a-82b7-afb2a5f55c21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4718cad0c0b9461d9c4152d7ea4b385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:50.543777 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea404a9-9b60-4f4a-82b7-afb2a5f55c21 service swift] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:50.543777 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea404a9-9b60-4f4a-82b7-afb2a5f55c21 service swift] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:50.543777 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea404a9-9b60-4f4a-82b7-afb2a5f55c21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:50.560696 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea404a9-9b60-4f4a-82b7-afb2a5f55c21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:50.562422 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea404a9-9b60-4f4a-82b7-afb2a5f55c21 service swift] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:50.571304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1065/2150] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 23 08:18:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 08:18:50.641983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:50.717377 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368a2b3-ce54-4d8d-af64-4f9bdb867355 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:50.718964 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-d368a2b3-ce54-4d8d-af64-4f9bdb867355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:50.788172 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368a2b3-ce54-4d8d-af64-4f9bdb867355 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:50.790546 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea404a9-9b60-4f4a-82b7-afb2a5f55c21 service swift] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:50.792970 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-7ea404a9-9b60-4f4a-82b7-afb2a5f55c21 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:50.793633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bed53-d711-47f1-a5d7-a775e562d863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:50.794401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bed53-d711-47f1-a5d7-a775e562d863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:50.794401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bed53-d711-47f1-a5d7-a775e562d863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:50.794592 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bed53-d711-47f1-a5d7-a775e562d863 admin admin] PATH_INFO: `/v3/projects/04a8828f51054c91876e6625249949f2` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:50.796005 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960bed53-d711-47f1-a5d7-a775e562d863 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04a8828f51054c91876e6625249949f2)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:50.798194 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960bed53-d711-47f1-a5d7-a775e562d863 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:50.817552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea404a9-9b60-4f4a-82b7-afb2a5f55c21 service swift] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:50.823863 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3cea84-f5ea-4a08-bc72-1f4c6e994dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:50.824524 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cea84-f5ea-4a08-bc72-1f4c6e994dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:50.824803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cea84-f5ea-4a08-bc72-1f4c6e994dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:50.825060 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cea84-f5ea-4a08-bc72-1f4c6e994dd8 admin admin] PATH_INFO: `/v3/projects/5bee32d4983c462d8e84e529360f71ec` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:50.827287 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3cea84-f5ea-4a08-bc72-1f4c6e994dd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bee32d4983c462d8e84e529360f71ec)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:50.829817 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3cea84-f5ea-4a08-bc72-1f4c6e994dd8 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:50.931720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-960bed53-d711-47f1-a5d7-a775e562d863 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04a8828f51054c91876e6625249949f2', 'request_id': 'req-960bed53-d711-47f1-a5d7-a775e562d863'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:50.939303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-960bed53-d711-47f1-a5d7-a775e562d863 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04a8828f51054c91876e6625249949f2', 'request_id': 'req-960bed53-d711-47f1-a5d7-a775e562d863'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:50.951302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-960bed53-d711-47f1-a5d7-a775e562d863 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04a8828f51054c91876e6625249949f2', 'request_id': 'req-960bed53-d711-47f1-a5d7-a775e562d863'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:50.958358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-8c3cea84-f5ea-4a08-bc72-1f4c6e994dd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bee32d4983c462d8e84e529360f71ec', 'request_id': 'req-8c3cea84-f5ea-4a08-bc72-1f4c6e994dd8'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:50.964457 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-8c3cea84-f5ea-4a08-bc72-1f4c6e994dd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bee32d4983c462d8e84e529360f71ec', 'request_id': 'req-8c3cea84-f5ea-4a08-bc72-1f4c6e994dd8'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:50.971973 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-8c3cea84-f5ea-4a08-bc72-1f4c6e994dd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bee32d4983c462d8e84e529360f71ec', 'request_id': 'req-8c3cea84-f5ea-4a08-bc72-1f4c6e994dd8'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:51.041950 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-960bed53-d711-47f1-a5d7-a775e562d863 admin admin] The token cache is being invalidate because project 04a8828f51054c91876e6625249949f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:51.042515 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-960bed53-d711-47f1-a5d7-a775e562d863 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:51.043268 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-960bed53-d711-47f1-a5d7-a775e562d863 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:51.044789 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1086/2151] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:50 2022] DELETE /identity/v3/projects/04a8828f51054c91876e6625249949f2 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:51.049317 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bed53-d711-47f1-a5d7-a775e562d863 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:51.050868 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-960bed53-d711-47f1-a5d7-a775e562d863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:51.119331 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bed53-d711-47f1-a5d7-a775e562d863 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:51.123250 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-8c3cea84-f5ea-4a08-bc72-1f4c6e994dd8 admin admin] The token cache is being invalidate because project 5bee32d4983c462d8e84e529360f71ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:51.123842 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-8c3cea84-f5ea-4a08-bc72-1f4c6e994dd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:51.124669 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-8c3cea84-f5ea-4a08-bc72-1f4c6e994dd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:51.129623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1066/2152] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:50 2022] DELETE /identity/v3/projects/5bee32d4983c462d8e84e529360f71ec => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:51.130576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3cea84-f5ea-4a08-bc72-1f4c6e994dd8 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:51.132107 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-8c3cea84-f5ea-4a08-bc72-1f4c6e994dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:51.193552 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7463c-9135-44b1-90fc-d9c57cf2a856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:51.194402 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7463c-9135-44b1-90fc-d9c57cf2a856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:51.194743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7463c-9135-44b1-90fc-d9c57cf2a856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:51.195033 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7463c-9135-44b1-90fc-d9c57cf2a856 admin admin] PATH_INFO: `/v3/users/e7179d1ead0644199db9c7f07f70c7b2` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:51.196717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b7463c-9135-44b1-90fc-d9c57cf2a856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7179d1ead0644199db9c7f07f70c7b2)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:51.199238 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b7463c-9135-44b1-90fc-d9c57cf2a856 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:51.213594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3cea84-f5ea-4a08-bc72-1f4c6e994dd8 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:51.220228 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dff05-a954-4933-beda-0234b6015ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:51.221001 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dff05-a954-4933-beda-0234b6015ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:51.221305 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dff05-a954-4933-beda-0234b6015ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:51.221717 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dff05-a954-4933-beda-0234b6015ca9 admin admin] PATH_INFO: `/v3/users/2faf244dfc2a4ee8851cf1befaeda873` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:51.223544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625dff05-a954-4933-beda-0234b6015ca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2faf244dfc2a4ee8851cf1befaeda873)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:51.227418 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625dff05-a954-4933-beda-0234b6015ca9 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:51.575002 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-625dff05-a954-4933-beda-0234b6015ca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2faf244dfc2a4ee8851cf1befaeda873'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:51.575583 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d5b7463c-9135-44b1-90fc-d9c57cf2a856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7179d1ead0644199db9c7f07f70c7b2'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:51.576017 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-625dff05-a954-4933-beda-0234b6015ca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2faf244dfc2a4ee8851cf1befaeda873'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:51.576289 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d5b7463c-9135-44b1-90fc-d9c57cf2a856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7179d1ead0644199db9c7f07f70c7b2'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:51.576898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-625dff05-a954-4933-beda-0234b6015ca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2faf244dfc2a4ee8851cf1befaeda873'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:51.577018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d5b7463c-9135-44b1-90fc-d9c57cf2a856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7179d1ead0644199db9c7f07f70c7b2'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:51.706736 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-625dff05-a954-4933-beda-0234b6015ca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2faf244dfc2a4ee8851cf1befaeda873'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:51.708213 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:51.716145 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-625dff05-a954-4933-beda-0234b6015ca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2faf244dfc2a4ee8851cf1befaeda873'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:51.735319 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1067/2153] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:51 2022] DELETE /identity/v3/users/2faf244dfc2a4ee8851cf1befaeda873 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:51.736649 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8a9e2-aad8-4717-896b-721b529060b1 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:51.736930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8a9e2-aad8-4717-896b-721b529060b1 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:51.737204 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8a9e2-aad8-4717-896b-721b529060b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:51.756411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-37c8a9e2-aad8-4717-896b-721b529060b1 None None] MFA Rules not processed for user `970300b51d504a2bbc48158855f02f34`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:51.758162 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-37c8a9e2-aad8-4717-896b-721b529060b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:51.814109 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1068/2154] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 23 08:18:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:51.827009 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8a9e2-aad8-4717-896b-721b529060b1 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:51.828378 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-37c8a9e2-aad8-4717-896b-721b529060b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:51.878712 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d5b7463c-9135-44b1-90fc-d9c57cf2a856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7179d1ead0644199db9c7f07f70c7b2'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:51.893111 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d5b7463c-9135-44b1-90fc-d9c57cf2a856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7179d1ead0644199db9c7f07f70c7b2'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:51.902231 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8a9e2-aad8-4717-896b-721b529060b1 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:51.909502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1087/2155] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:51 2022] DELETE /identity/v3/users/e7179d1ead0644199db9c7f07f70c7b2 => generated 0 bytes in 858 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:51.910488 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f840057-1cdb-4a05-abf1-9a3eaaab83ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4718cad0c0b9461d9c4152d7ea4b385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:51.911159 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f840057-1cdb-4a05-abf1-9a3eaaab83ce service swift] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:51.911446 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f840057-1cdb-4a05-abf1-9a3eaaab83ce service swift] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:51.911717 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f840057-1cdb-4a05-abf1-9a3eaaab83ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:51.921488 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f840057-1cdb-4a05-abf1-9a3eaaab83ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:51.928384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f840057-1cdb-4a05-abf1-9a3eaaab83ce service swift] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:51.932915 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1069/2156] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 23 08:18:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 08:18:52.173590 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7463c-9135-44b1-90fc-d9c57cf2a856 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:52.176238 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-d5b7463c-9135-44b1-90fc-d9c57cf2a856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:52.280699 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7463c-9135-44b1-90fc-d9c57cf2a856 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:52.289130 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd39bd6-9b42-4634-8c76-d74a060b7c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:52.290953 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd39bd6-9b42-4634-8c76-d74a060b7c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:52.290953 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd39bd6-9b42-4634-8c76-d74a060b7c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:52.291500 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd39bd6-9b42-4634-8c76-d74a060b7c11 admin admin] PATH_INFO: `/v3/projects/37f8932b9e8c4bbb8f1fc1f3dad93b43` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:52.292798 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd39bd6-9b42-4634-8c76-d74a060b7c11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37f8932b9e8c4bbb8f1fc1f3dad93b43)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:52.296300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd39bd6-9b42-4634-8c76-d74a060b7c11 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:52.434580 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-7cd39bd6-9b42-4634-8c76-d74a060b7c11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37f8932b9e8c4bbb8f1fc1f3dad93b43', 'request_id': 'req-7cd39bd6-9b42-4634-8c76-d74a060b7c11'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:52.442005 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-7cd39bd6-9b42-4634-8c76-d74a060b7c11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37f8932b9e8c4bbb8f1fc1f3dad93b43', 'request_id': 'req-7cd39bd6-9b42-4634-8c76-d74a060b7c11'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:52.453474 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-7cd39bd6-9b42-4634-8c76-d74a060b7c11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37f8932b9e8c4bbb8f1fc1f3dad93b43', 'request_id': 'req-7cd39bd6-9b42-4634-8c76-d74a060b7c11'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:52.589078 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-7cd39bd6-9b42-4634-8c76-d74a060b7c11 admin admin] The token cache is being invalidate because project 37f8932b9e8c4bbb8f1fc1f3dad93b43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:52.591153 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-7cd39bd6-9b42-4634-8c76-d74a060b7c11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:52.591153 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-7cd39bd6-9b42-4634-8c76-d74a060b7c11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:52.592464 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1088/2157] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:52 2022] DELETE /identity/v3/projects/37f8932b9e8c4bbb8f1fc1f3dad93b43 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:52.597486 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65368567-7e23-474d-ad64-7767fee02528 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:52.597777 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65368567-7e23-474d-ad64-7767fee02528 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:52.598059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65368567-7e23-474d-ad64-7767fee02528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:52.629860 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd39bd6-9b42-4634-8c76-d74a060b7c11 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:52.631480 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-7cd39bd6-9b42-4634-8c76-d74a060b7c11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:52.656200 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-65368567-7e23-474d-ad64-7767fee02528 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:52.657374 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-65368567-7e23-474d-ad64-7767fee02528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:52.734809 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd39bd6-9b42-4634-8c76-d74a060b7c11 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:52.740132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f9bb4-567e-4dc0-b1b4-26a83634b1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:52.741047 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f9bb4-567e-4dc0-b1b4-26a83634b1bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:52.741719 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f9bb4-567e-4dc0-b1b4-26a83634b1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:52.742209 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f9bb4-567e-4dc0-b1b4-26a83634b1bf admin admin] PATH_INFO: `/v3/projects/f2863a5b8d824c51a1d3ad4b1a9fc983` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:52.743704 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f9bb4-567e-4dc0-b1b4-26a83634b1bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2863a5b8d824c51a1d3ad4b1a9fc983)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:52.745885 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f9bb4-567e-4dc0-b1b4-26a83634b1bf admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:52.764388 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1070/2158] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:52.769667 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fb10b-0b28-45ef-849b-cd65a729f448 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:52.771460 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fb10b-0b28-45ef-849b-cd65a729f448 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:52.772932 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fb10b-0b28-45ef-849b-cd65a729f448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:52.793007 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-a79fb10b-0b28-45ef-849b-cd65a729f448 None None] MFA Rules not processed for user `970300b51d504a2bbc48158855f02f34`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:52.794226 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a79fb10b-0b28-45ef-849b-cd65a729f448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:52.850400 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1071/2159] 10.222.0.57 () {58 vars in 967 bytes} [Tue Aug 23 08:18:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:18:52.851669 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403fed3-59d0-4410-bdf2-d2f1d4938751 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:52.855528 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403fed3-59d0-4410-bdf2-d2f1d4938751 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:52.855528 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403fed3-59d0-4410-bdf2-d2f1d4938751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:52.874154 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-9403fed3-59d0-4410-bdf2-d2f1d4938751 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:52.875402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-9403fed3-59d0-4410-bdf2-d2f1d4938751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:52.886232 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1072/2160] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:52.887204 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403fed3-59d0-4410-bdf2-d2f1d4938751 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:52.890659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-9403fed3-59d0-4410-bdf2-d2f1d4938751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:52.895059 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-a36f9bb4-567e-4dc0-b1b4-26a83634b1bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2863a5b8d824c51a1d3ad4b1a9fc983', 'request_id': 'req-a36f9bb4-567e-4dc0-b1b4-26a83634b1bf'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:52.901504 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-a36f9bb4-567e-4dc0-b1b4-26a83634b1bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2863a5b8d824c51a1d3ad4b1a9fc983', 'request_id': 'req-a36f9bb4-567e-4dc0-b1b4-26a83634b1bf'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:52.909010 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-a36f9bb4-567e-4dc0-b1b4-26a83634b1bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2863a5b8d824c51a1d3ad4b1a9fc983', 'request_id': 'req-a36f9bb4-567e-4dc0-b1b4-26a83634b1bf'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:52.944951 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:DELETE=2,keystone:SELECT=89,keystone:INSERT=9 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:52.969809 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403fed3-59d0-4410-bdf2-d2f1d4938751 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:53.008598 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-a36f9bb4-567e-4dc0-b1b4-26a83634b1bf admin admin] The token cache is being invalidate because project f2863a5b8d824c51a1d3ad4b1a9fc983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:53.008957 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-a36f9bb4-567e-4dc0-b1b4-26a83634b1bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:53.009606 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-a36f9bb4-567e-4dc0-b1b4-26a83634b1bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:53.011182 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1089/2161] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:52 2022] DELETE /identity/v3/projects/f2863a5b8d824c51a1d3ad4b1a9fc983 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:53.014776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f9bb4-567e-4dc0-b1b4-26a83634b1bf admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:53.016086 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-a36f9bb4-567e-4dc0-b1b4-26a83634b1bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:53.029639 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66d487-1db9-4e7e-9db0-950b8423bbfc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4718cad0c0b9461d9c4152d7ea4b385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:53.030253 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66d487-1db9-4e7e-9db0-950b8423bbfc service swift] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:53.030561 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66d487-1db9-4e7e-9db0-950b8423bbfc service swift] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:53.030835 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66d487-1db9-4e7e-9db0-950b8423bbfc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:53.034545 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-bc66d487-1db9-4e7e-9db0-950b8423bbfc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:53.104322 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f9bb4-567e-4dc0-b1b4-26a83634b1bf admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:53.109532 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1efa3a-6263-43e3-a860-64ad44d253b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:53.117404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1efa3a-6263-43e3-a860-64ad44d253b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:53.117404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1efa3a-6263-43e3-a860-64ad44d253b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:53.117404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1efa3a-6263-43e3-a860-64ad44d253b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:53.117404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1efa3a-6263-43e3-a860-64ad44d253b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:18:53.117404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1efa3a-6263-43e3-a860-64ad44d253b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:53.117404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1efa3a-6263-43e3-a860-64ad44d253b3 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:53.120304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66d487-1db9-4e7e-9db0-950b8423bbfc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:53.122503 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66d487-1db9-4e7e-9db0-950b8423bbfc service swift] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:53.134957 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1073/2162] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 23 08:18:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 08:18:53.136718 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66d487-1db9-4e7e-9db0-950b8423bbfc service swift] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:53.139447 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-bc66d487-1db9-4e7e-9db0-950b8423bbfc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:53.140401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1090/2163] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:18:53.145083 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1efa3a-6263-43e3-a860-64ad44d253b3 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:53.165085 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1efa3a-6263-43e3-a860-64ad44d253b3 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:53.168046 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66d487-1db9-4e7e-9db0-950b8423bbfc service swift] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:53.179344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74486581-d88b-4f41-9ce7-ee64fe020f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:53.180014 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74486581-d88b-4f41-9ce7-ee64fe020f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:53.180299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74486581-d88b-4f41-9ce7-ee64fe020f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:53.180581 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74486581-d88b-4f41-9ce7-ee64fe020f18 admin admin] PATH_INFO: `/v3/users/9c981908b08247759dc9f9d6449036a1` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:53.182186 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26b51e-0af0-496a-a421-06fdad574d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:53.182829 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26b51e-0af0-496a-a421-06fdad574d83 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:53.183108 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26b51e-0af0-496a-a421-06fdad574d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:53.183387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26b51e-0af0-496a-a421-06fdad574d83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:53.184488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26b51e-0af0-496a-a421-06fdad574d83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:53.185994 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74486581-d88b-4f41-9ce7-ee64fe020f18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c981908b08247759dc9f9d6449036a1)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:53.187404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26b51e-0af0-496a-a421-06fdad574d83 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:53.188352 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74486581-d88b-4f41-9ce7-ee64fe020f18 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:53.308377 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:53.317821 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1091/2164] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:18:53 2022] POST /identity/v3/projects => generated 371 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:18:53.319461 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26b51e-0af0-496a-a421-06fdad574d83 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:53.396467 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26b51e-0af0-496a-a421-06fdad574d83 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:53.401724 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd823e2a-e9d9-4610-94cb-e4ae3544e284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:53.402450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd823e2a-e9d9-4610-94cb-e4ae3544e284 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:53.402798 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd823e2a-e9d9-4610-94cb-e4ae3544e284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:53.403079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd823e2a-e9d9-4610-94cb-e4ae3544e284 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:53.403719 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd823e2a-e9d9-4610-94cb-e4ae3544e284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:53.405663 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd823e2a-e9d9-4610-94cb-e4ae3544e284 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:53.431695 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-74486581-d88b-4f41-9ce7-ee64fe020f18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c981908b08247759dc9f9d6449036a1'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:53.433401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-74486581-d88b-4f41-9ce7-ee64fe020f18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c981908b08247759dc9f9d6449036a1'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:53.434208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-74486581-d88b-4f41-9ce7-ee64fe020f18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c981908b08247759dc9f9d6449036a1'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:53.512041 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-74486581-d88b-4f41-9ce7-ee64fe020f18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c981908b08247759dc9f9d6449036a1'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:53.518482 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1092/2165] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:18:53 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:18:53.522805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd823e2a-e9d9-4610-94cb-e4ae3544e284 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:53.524859 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-fd823e2a-e9d9-4610-94cb-e4ae3544e284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:53.525637 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-74486581-d88b-4f41-9ce7-ee64fe020f18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c981908b08247759dc9f9d6449036a1'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:53.541180 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd823e2a-e9d9-4610-94cb-e4ae3544e284 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:53.546046 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1074/2166] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:53 2022] DELETE /identity/v3/users/9c981908b08247759dc9f9d6449036a1 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:53.546593 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ab720-ca63-4e41-bf8b-ec3f6cc13011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:53.550034 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ab720-ca63-4e41-bf8b-ec3f6cc13011 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:53.550034 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ab720-ca63-4e41-bf8b-ec3f6cc13011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:53.550034 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ab720-ca63-4e41-bf8b-ec3f6cc13011 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:53.550034 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ab720-ca63-4e41-bf8b-ec3f6cc13011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:53.550034 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ab720-ca63-4e41-bf8b-ec3f6cc13011 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:53.564154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1093/2167] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:18:53.565431 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74486581-d88b-4f41-9ce7-ee64fe020f18 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:53.630113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74486581-d88b-4f41-9ce7-ee64fe020f18 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:53.640293 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab333d-2084-4cd3-892a-3e3414963150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:53.640940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab333d-2084-4cd3-892a-3e3414963150 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:53.641222 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab333d-2084-4cd3-892a-3e3414963150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:53.641498 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab333d-2084-4cd3-892a-3e3414963150 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:53.642153 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab333d-2084-4cd3-892a-3e3414963150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:53.643902 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab333d-2084-4cd3-892a-3e3414963150 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:53.659760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1075/2168] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:53.661203 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ab720-ca63-4e41-bf8b-ec3f6cc13011 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:53.675816 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ab720-ca63-4e41-bf8b-ec3f6cc13011 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:53.684369 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57f1c6-0e1c-4a90-9554-ce5fb0431179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:53.685184 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57f1c6-0e1c-4a90-9554-ce5fb0431179 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:53.685572 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57f1c6-0e1c-4a90-9554-ce5fb0431179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:53.685960 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57f1c6-0e1c-4a90-9554-ce5fb0431179 admin admin] PATH_INFO: `/v3/projects/3f7b2f59cd2d4afc9f44a631b97b8fb7/users/e49cc252d1f24cd981b63bc5e5e7d9f5/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:53.726936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57f1c6-0e1c-4a90-9554-ce5fb0431179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f7b2f59cd2d4afc9f44a631b97b8fb7, user_id=e49cc252d1f24cd981b63bc5e5e7d9f5, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:53.731675 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57f1c6-0e1c-4a90-9554-ce5fb0431179 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:53.814866 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1094/2169] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:53 2022] PUT /identity/v3/projects/3f7b2f59cd2d4afc9f44a631b97b8fb7/users/e49cc252d1f24cd981b63bc5e5e7d9f5/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:53.823392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc7adb-f43a-4d35-b371-57de8e4c8199 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:53.823682 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc7adb-f43a-4d35-b371-57de8e4c8199 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:53.823969 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc7adb-f43a-4d35-b371-57de8e4c8199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:53.858848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-98fc7adb-f43a-4d35-b371-57de8e4c8199 None None] MFA Rules not processed for user `e49cc252d1f24cd981b63bc5e5e7d9f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:53.860470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-98fc7adb-f43a-4d35-b371-57de8e4c8199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:53.948009 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1076/2170] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:53.960445 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57f1c6-0e1c-4a90-9554-ce5fb0431179 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:53.962382 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-6c57f1c6-0e1c-4a90-9554-ce5fb0431179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:54.054171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57f1c6-0e1c-4a90-9554-ce5fb0431179 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:54.061669 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c859d-90c1-4b4e-bce7-585083eec10a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:54.062581 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c859d-90c1-4b4e-bce7-585083eec10a service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:54.064013 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c859d-90c1-4b4e-bce7-585083eec10a service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:54.065145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c859d-90c1-4b4e-bce7-585083eec10a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:54.081651 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c859d-90c1-4b4e-bce7-585083eec10a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:54.084566 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c859d-90c1-4b4e-bce7-585083eec10a service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:54.096632 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1095/2171] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:54.125487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc7adb-f43a-4d35-b371-57de8e4c8199 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:54.199203 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc7adb-f43a-4d35-b371-57de8e4c8199 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:54.203779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa51952-2128-49fe-8d4d-b7b53c8f5c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:54.204395 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa51952-2128-49fe-8d4d-b7b53c8f5c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:54.204672 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa51952-2128-49fe-8d4d-b7b53c8f5c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:54.204943 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa51952-2128-49fe-8d4d-b7b53c8f5c67 admin admin] PATH_INFO: `/v3/users/e49cc252d1f24cd981b63bc5e5e7d9f5` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:54.206060 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa51952-2128-49fe-8d4d-b7b53c8f5c67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e49cc252d1f24cd981b63bc5e5e7d9f5)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:54.208292 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa51952-2128-49fe-8d4d-b7b53c8f5c67 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:54.341848 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c859d-90c1-4b4e-bce7-585083eec10a service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:54.344049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-e10c859d-90c1-4b4e-bce7-585083eec10a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:54.360061 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c859d-90c1-4b4e-bce7-585083eec10a service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:54.365468 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393c23b-7958-4e48-bfd9-abe7013b8e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:54.366275 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393c23b-7958-4e48-bfd9-abe7013b8e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:54.366773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393c23b-7958-4e48-bfd9-abe7013b8e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:54.367201 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393c23b-7958-4e48-bfd9-abe7013b8e8a admin admin] PATH_INFO: `/v3/projects/feffaeda682c464aba71035fac77523d` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:54.368664 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393c23b-7958-4e48-bfd9-abe7013b8e8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=feffaeda682c464aba71035fac77523d)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:54.371445 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393c23b-7958-4e48-bfd9-abe7013b8e8a admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:54.700670 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-caa51952-2128-49fe-8d4d-b7b53c8f5c67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e49cc252d1f24cd981b63bc5e5e7d9f5'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:54.701320 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-caa51952-2128-49fe-8d4d-b7b53c8f5c67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e49cc252d1f24cd981b63bc5e5e7d9f5'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:54.701965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-caa51952-2128-49fe-8d4d-b7b53c8f5c67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e49cc252d1f24cd981b63bc5e5e7d9f5'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:54.765674 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f393c23b-7958-4e48-bfd9-abe7013b8e8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feffaeda682c464aba71035fac77523d', 'request_id': 'req-f393c23b-7958-4e48-bfd9-abe7013b8e8a'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:54.771661 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f393c23b-7958-4e48-bfd9-abe7013b8e8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feffaeda682c464aba71035fac77523d', 'request_id': 'req-f393c23b-7958-4e48-bfd9-abe7013b8e8a'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:54.778027 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f393c23b-7958-4e48-bfd9-abe7013b8e8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feffaeda682c464aba71035fac77523d', 'request_id': 'req-f393c23b-7958-4e48-bfd9-abe7013b8e8a'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:54.783891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-caa51952-2128-49fe-8d4d-b7b53c8f5c67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e49cc252d1f24cd981b63bc5e5e7d9f5'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:54.803061 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-caa51952-2128-49fe-8d4d-b7b53c8f5c67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e49cc252d1f24cd981b63bc5e5e7d9f5'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:54.821574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1077/2172] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:54 2022] DELETE /identity/v3/users/e49cc252d1f24cd981b63bc5e5e7d9f5 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:54.826121 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221a89b-fd95-4d81-85cf-367049ac0763 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:54.826427 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221a89b-fd95-4d81-85cf-367049ac0763 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:54.826708 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221a89b-fd95-4d81-85cf-367049ac0763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:54.856948 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-a221a89b-fd95-4d81-85cf-367049ac0763 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:54.858306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a221a89b-fd95-4d81-85cf-367049ac0763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:54.898820 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f393c23b-7958-4e48-bfd9-abe7013b8e8a admin admin] The token cache is being invalidate because project feffaeda682c464aba71035fac77523d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:54.899111 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f393c23b-7958-4e48-bfd9-abe7013b8e8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:54.899995 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f393c23b-7958-4e48-bfd9-abe7013b8e8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:54.904582 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1096/2173] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:54 2022] DELETE /identity/v3/projects/feffaeda682c464aba71035fac77523d => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:54.911679 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcab675-2647-484a-bedd-5d666371bfd0 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:54.911967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcab675-2647-484a-bedd-5d666371bfd0 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:54.912241 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcab675-2647-484a-bedd-5d666371bfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:54.944976 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1078/2174] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:54.951714 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-7bcab675-2647-484a-bedd-5d666371bfd0 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:54.953151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-7bcab675-2647-484a-bedd-5d666371bfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:54.960100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221a89b-fd95-4d81-85cf-367049ac0763 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:54.972325 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1097/2175] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:54.983803 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cf169-6b7f-4442-9653-c3c096448569 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:54.984258 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cf169-6b7f-4442-9653-c3c096448569 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:54.984543 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cf169-6b7f-4442-9653-c3c096448569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:54.997138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a221a89b-fd95-4d81-85cf-367049ac0763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:55.029529 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-141cf169-6b7f-4442-9653-c3c096448569 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:55.030789 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-141cf169-6b7f-4442-9653-c3c096448569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:55.065535 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1098/2176] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:55.067573 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141cf169-6b7f-4442-9653-c3c096448569 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:55.090527 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141cf169-6b7f-4442-9653-c3c096448569 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:55.105363 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01959cf-7b11-4966-8feb-32acd129dd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:55.105986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01959cf-7b11-4966-8feb-32acd129dd3c admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:55.106266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01959cf-7b11-4966-8feb-32acd129dd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:55.106561 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01959cf-7b11-4966-8feb-32acd129dd3c admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:55.107207 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01959cf-7b11-4966-8feb-32acd129dd3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:18:55.107602 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01959cf-7b11-4966-8feb-32acd129dd3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:55.109137 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01959cf-7b11-4966-8feb-32acd129dd3c admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:55.121385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221a89b-fd95-4d81-85cf-367049ac0763 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:55.122798 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1099/2177] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:18:55.136189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0bd93-ac53-474b-9efb-bdc445fd5072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:55.136813 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0bd93-ac53-474b-9efb-bdc445fd5072 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:55.137091 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0bd93-ac53-474b-9efb-bdc445fd5072 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:55.137358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0bd93-ac53-474b-9efb-bdc445fd5072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:55.138151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01959cf-7b11-4966-8feb-32acd129dd3c admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:55.159665 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01959cf-7b11-4966-8feb-32acd129dd3c admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:55.174222 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0bd93-ac53-474b-9efb-bdc445fd5072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:55.174437 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b4a35-d6e0-467a-a679-a73daaab9227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:55.174437 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b4a35-d6e0-467a-a679-a73daaab9227 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:55.174437 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b4a35-d6e0-467a-a679-a73daaab9227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:55.174437 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b4a35-d6e0-467a-a679-a73daaab9227 admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:55.174756 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b4a35-d6e0-467a-a679-a73daaab9227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:55.174834 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0bd93-ac53-474b-9efb-bdc445fd5072 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:55.179530 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b4a35-d6e0-467a-a679-a73daaab9227 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:55.196261 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1079/2178] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:18:55.198078 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:55.348260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0bd93-ac53-474b-9efb-bdc445fd5072 service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:55.353949 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1100/2179] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:18:55 2022] POST /identity/v3/projects => generated 373 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:55.359406 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0bd93-ac53-474b-9efb-bdc445fd5072 service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:55.388241 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:55.451731 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0574a-63bc-4e71-bf34-cf120ca0175a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:55.452489 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0574a-63bc-4e71-bf34-cf120ca0175a admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:55.452904 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0574a-63bc-4e71-bf34-cf120ca0175a admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:55.453412 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0574a-63bc-4e71-bf34-cf120ca0175a admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:55.454523 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0574a-63bc-4e71-bf34-cf120ca0175a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:55.457559 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0574a-63bc-4e71-bf34-cf120ca0175a admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:55.582357 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1080/2180] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:18:55 2022] POST /identity/v3/users => generated 287 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:55.586396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b4a35-d6e0-467a-a679-a73daaab9227 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:55.600611 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b4a35-d6e0-467a-a679-a73daaab9227 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:55.613279 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309826f9-6545-4af7-8c4d-b5e0d677caf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:55.613971 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309826f9-6545-4af7-8c4d-b5e0d677caf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:55.614253 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309826f9-6545-4af7-8c4d-b5e0d677caf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:55.614585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309826f9-6545-4af7-8c4d-b5e0d677caf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:55.615243 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309826f9-6545-4af7-8c4d-b5e0d677caf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:55.622521 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309826f9-6545-4af7-8c4d-b5e0d677caf1 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:55.627737 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1101/2181] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:55.632355 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0574a-63bc-4e71-bf34-cf120ca0175a admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:55.642608 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0574a-63bc-4e71-bf34-cf120ca0175a admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:55.656051 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104d9cf-8ccc-40a6-8aec-01186e26be05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:55.656699 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104d9cf-8ccc-40a6-8aec-01186e26be05 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:55.656979 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104d9cf-8ccc-40a6-8aec-01186e26be05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:55.657250 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104d9cf-8ccc-40a6-8aec-01186e26be05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:55.657893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104d9cf-8ccc-40a6-8aec-01186e26be05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:55.665713 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104d9cf-8ccc-40a6-8aec-01186e26be05 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:55.676714 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1081/2182] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:18:55.680852 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309826f9-6545-4af7-8c4d-b5e0d677caf1 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:55.691385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309826f9-6545-4af7-8c4d-b5e0d677caf1 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:55.696386 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbeafa-4cca-4652-8020-aaad9b22e341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:55.697125 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbeafa-4cca-4652-8020-aaad9b22e341 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:55.697660 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbeafa-4cca-4652-8020-aaad9b22e341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:55.697776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbeafa-4cca-4652-8020-aaad9b22e341 admin admin] PATH_INFO: `/v3/projects/a3c058bd9c104d7dab422bed507395c6/users/6715aaba3433448cb11c6340f36fcc41/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:55.713720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbeafa-4cca-4652-8020-aaad9b22e341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3c058bd9c104d7dab422bed507395c6, user_id=6715aaba3433448cb11c6340f36fcc41, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:55.716463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbeafa-4cca-4652-8020-aaad9b22e341 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:55.866449 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1102/2183] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:55 2022] PUT /identity/v3/projects/a3c058bd9c104d7dab422bed507395c6/users/6715aaba3433448cb11c6340f36fcc41/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:18:55.871827 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dedc9e-0faa-4e47-b978-8d46da6c96a9 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:55.872117 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dedc9e-0faa-4e47-b978-8d46da6c96a9 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:55.872395 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dedc9e-0faa-4e47-b978-8d46da6c96a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:55.891934 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-d7dedc9e-0faa-4e47-b978-8d46da6c96a9 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:55.893208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-d7dedc9e-0faa-4e47-b978-8d46da6c96a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:55.952679 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbeafa-4cca-4652-8020-aaad9b22e341 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:55.952836 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1082/2184] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:18:55.955164 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-0bbbeafa-4cca-4652-8020-aaad9b22e341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:55.970709 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbeafa-4cca-4652-8020-aaad9b22e341 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:55.971575 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dedc9e-0faa-4e47-b978-8d46da6c96a9 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:55.976697 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc41129-26e1-4fff-8b2c-6d8fd7b130fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:55.977456 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc41129-26e1-4fff-8b2c-6d8fd7b130fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:55.977932 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc41129-26e1-4fff-8b2c-6d8fd7b130fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:55.978208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc41129-26e1-4fff-8b2c-6d8fd7b130fb admin admin] PATH_INFO: `/v3/projects/3f7b2f59cd2d4afc9f44a631b97b8fb7` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:55.981315 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc41129-26e1-4fff-8b2c-6d8fd7b130fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f7b2f59cd2d4afc9f44a631b97b8fb7)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:55.983789 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc41129-26e1-4fff-8b2c-6d8fd7b130fb admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:56.040703 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dedc9e-0faa-4e47-b978-8d46da6c96a9 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:56.044266 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d44233-5289-4d7b-ba60-1625ecaa231f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:56.044887 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d44233-5289-4d7b-ba60-1625ecaa231f service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:56.045183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d44233-5289-4d7b-ba60-1625ecaa231f service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:56.045437 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d44233-5289-4d7b-ba60-1625ecaa231f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:56.058602 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d44233-5289-4d7b-ba60-1625ecaa231f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:56.060106 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d44233-5289-4d7b-ba60-1625ecaa231f service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:56.071251 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1083/2185] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:18:56.120441 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-3fc41129-26e1-4fff-8b2c-6d8fd7b130fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f7b2f59cd2d4afc9f44a631b97b8fb7', 'request_id': 'req-3fc41129-26e1-4fff-8b2c-6d8fd7b130fb'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:56.125663 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-3fc41129-26e1-4fff-8b2c-6d8fd7b130fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f7b2f59cd2d4afc9f44a631b97b8fb7', 'request_id': 'req-3fc41129-26e1-4fff-8b2c-6d8fd7b130fb'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:56.132434 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-3fc41129-26e1-4fff-8b2c-6d8fd7b130fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f7b2f59cd2d4afc9f44a631b97b8fb7', 'request_id': 'req-3fc41129-26e1-4fff-8b2c-6d8fd7b130fb'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:56.245596 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-3fc41129-26e1-4fff-8b2c-6d8fd7b130fb admin admin] The token cache is being invalidate because project 3f7b2f59cd2d4afc9f44a631b97b8fb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:56.245922 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-3fc41129-26e1-4fff-8b2c-6d8fd7b130fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:56.246621 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-3fc41129-26e1-4fff-8b2c-6d8fd7b130fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:56.248129 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1103/2186] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:55 2022] DELETE /identity/v3/projects/3f7b2f59cd2d4afc9f44a631b97b8fb7 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:56.253263 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe2945-a9be-416a-baef-4be196c9632d None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:56.253618 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe2945-a9be-416a-baef-4be196c9632d None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:56.253900 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe2945-a9be-416a-baef-4be196c9632d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:56.273546 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-edbe2945-a9be-416a-baef-4be196c9632d None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:56.274970 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-edbe2945-a9be-416a-baef-4be196c9632d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:56.339059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1084/2187] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:56.349120 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67200bfd-ca07-4b2d-95d0-f30ac765957d None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:56.353388 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67200bfd-ca07-4b2d-95d0-f30ac765957d None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:56.353388 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67200bfd-ca07-4b2d-95d0-f30ac765957d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:56.380740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-67200bfd-ca07-4b2d-95d0-f30ac765957d None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:56.380740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-67200bfd-ca07-4b2d-95d0-f30ac765957d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:56.388536 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1104/2188] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:56.402508 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe2945-a9be-416a-baef-4be196c9632d None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:56.403630 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe2945-a9be-416a-baef-4be196c9632d None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:56.408154 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ff4e0-1cbf-4a46-aac7-33dbc0160765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:56.409292 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ff4e0-1cbf-4a46-aac7-33dbc0160765 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:56.409561 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ff4e0-1cbf-4a46-aac7-33dbc0160765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:56.409877 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ff4e0-1cbf-4a46-aac7-33dbc0160765 admin admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:56.410544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ff4e0-1cbf-4a46-aac7-33dbc0160765 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:18:56.410844 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ff4e0-1cbf-4a46-aac7-33dbc0160765 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:56.412463 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ff4e0-1cbf-4a46-aac7-33dbc0160765 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:56.424424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1085/2189] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:18:56.428976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67200bfd-ca07-4b2d-95d0-f30ac765957d None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:56.439137 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67200bfd-ca07-4b2d-95d0-f30ac765957d None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:56.444500 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998de48-a4e9-4021-a7d4-05a025dfebe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:56.445568 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998de48-a4e9-4021-a7d4-05a025dfebe4 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:56.446056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998de48-a4e9-4021-a7d4-05a025dfebe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:56.446524 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998de48-a4e9-4021-a7d4-05a025dfebe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:56.447159 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998de48-a4e9-4021-a7d4-05a025dfebe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:56.449090 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998de48-a4e9-4021-a7d4-05a025dfebe4 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:56.616414 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1105/2190] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:18:56 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:56.618538 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ff4e0-1cbf-4a46-aac7-33dbc0160765 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:56.630149 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ff4e0-1cbf-4a46-aac7-33dbc0160765 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:56.644647 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998de48-a4e9-4021-a7d4-05a025dfebe4 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:56.649492 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-f998de48-a4e9-4021-a7d4-05a025dfebe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:56.701692 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176ca2f-8eb5-4f6d-b184-bec33556612c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:56.701692 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176ca2f-8eb5-4f6d-b184-bec33556612c admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:56.701692 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176ca2f-8eb5-4f6d-b184-bec33556612c admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:56.701692 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176ca2f-8eb5-4f6d-b184-bec33556612c admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:56.702235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176ca2f-8eb5-4f6d-b184-bec33556612c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:56.702359 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176ca2f-8eb5-4f6d-b184-bec33556612c admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:56.724535 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998de48-a4e9-4021-a7d4-05a025dfebe4 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:56.730721 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cb5eb-15c3-4e4c-8e69-9771cadd9d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:56.736150 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cb5eb-15c3-4e4c-8e69-9771cadd9d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:56.736150 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cb5eb-15c3-4e4c-8e69-9771cadd9d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:56.736150 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cb5eb-15c3-4e4c-8e69-9771cadd9d57 admin admin] PATH_INFO: `/v3/users/2de2759f117142ff81155794a45c370d` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:56.736150 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40cb5eb-15c3-4e4c-8e69-9771cadd9d57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2de2759f117142ff81155794a45c370d)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:56.736150 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40cb5eb-15c3-4e4c-8e69-9771cadd9d57 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:56.805025 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1086/2191] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:18:56 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:18:56.806176 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176ca2f-8eb5-4f6d-b184-bec33556612c admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:56.816385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176ca2f-8eb5-4f6d-b184-bec33556612c admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:56.821128 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ec846-50ef-47bb-bc85-535b179d32db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:56.821712 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ec846-50ef-47bb-bc85-535b179d32db admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:56.821990 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ec846-50ef-47bb-bc85-535b179d32db admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:56.822262 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ec846-50ef-47bb-bc85-535b179d32db admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:56.822927 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ec846-50ef-47bb-bc85-535b179d32db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:56.824522 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ec846-50ef-47bb-bc85-535b179d32db admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:56.838174 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1087/2192] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:18:56.841592 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ec846-50ef-47bb-bc85-535b179d32db admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:56.852422 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ec846-50ef-47bb-bc85-535b179d32db admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:56.857463 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729013e-8ea0-46e6-9462-78a9760fda05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:56.858085 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729013e-8ea0-46e6-9462-78a9760fda05 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:56.858397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729013e-8ea0-46e6-9462-78a9760fda05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:56.858669 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729013e-8ea0-46e6-9462-78a9760fda05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:56.859297 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729013e-8ea0-46e6-9462-78a9760fda05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:56.860929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729013e-8ea0-46e6-9462-78a9760fda05 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:56.865031 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:56.877232 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1088/2193] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:18:56.878362 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729013e-8ea0-46e6-9462-78a9760fda05 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:56.888324 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729013e-8ea0-46e6-9462-78a9760fda05 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:56.893525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32d422-b0f6-46f4-833e-8d45de7d5be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:56.894176 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32d422-b0f6-46f4-833e-8d45de7d5be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:56.894476 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32d422-b0f6-46f4-833e-8d45de7d5be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:56.894750 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32d422-b0f6-46f4-833e-8d45de7d5be9 admin admin] PATH_INFO: `/v3/projects/5ab41820e64e4f64ac6c2edd65c1bd3a/users/d8bc49fab1ac49098383f8bab8fa6c67/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:56.911599 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32d422-b0f6-46f4-833e-8d45de7d5be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ab41820e64e4f64ac6c2edd65c1bd3a, user_id=d8bc49fab1ac49098383f8bab8fa6c67, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:56.914272 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32d422-b0f6-46f4-833e-8d45de7d5be9 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:57.015079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f40cb5eb-15c3-4e4c-8e69-9771cadd9d57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2de2759f117142ff81155794a45c370d'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:57.015703 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f40cb5eb-15c3-4e4c-8e69-9771cadd9d57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2de2759f117142ff81155794a45c370d'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:57.016319 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f40cb5eb-15c3-4e4c-8e69-9771cadd9d57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2de2759f117142ff81155794a45c370d'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:57.017113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1089/2194] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:18:56 2022] PUT /identity/v3/projects/5ab41820e64e4f64ac6c2edd65c1bd3a/users/d8bc49fab1ac49098383f8bab8fa6c67/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:18:57.027888 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98892d4e-7e36-47ed-a0ef-c39aa5c5bd7e None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:57.028217 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98892d4e-7e36-47ed-a0ef-c39aa5c5bd7e None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:57.028498 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98892d4e-7e36-47ed-a0ef-c39aa5c5bd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:57.056179 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-98892d4e-7e36-47ed-a0ef-c39aa5c5bd7e None None] MFA Rules not processed for user `d8bc49fab1ac49098383f8bab8fa6c67`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:57.057449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-98892d4e-7e36-47ed-a0ef-c39aa5c5bd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:57.099243 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f40cb5eb-15c3-4e4c-8e69-9771cadd9d57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2de2759f117142ff81155794a45c370d'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:57.114104 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f40cb5eb-15c3-4e4c-8e69-9771cadd9d57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2de2759f117142ff81155794a45c370d'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:57.129279 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1106/2195] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:18:56 2022] DELETE /identity/v3/users/2de2759f117142ff81155794a45c370d => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:57.134026 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501b2e1-7dd2-4710-9815-e5f9c01e8453 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:57.134407 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501b2e1-7dd2-4710-9815-e5f9c01e8453 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:57.134902 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1090/2196] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:18:57.137949 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501b2e1-7dd2-4710-9815-e5f9c01e8453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:57.147480 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98892d4e-7e36-47ed-a0ef-c39aa5c5bd7e None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:57.148983 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-98892d4e-7e36-47ed-a0ef-c39aa5c5bd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:57.161585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-d501b2e1-7dd2-4710-9815-e5f9c01e8453 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:57.166451 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-d501b2e1-7dd2-4710-9815-e5f9c01e8453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:57.218657 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98892d4e-7e36-47ed-a0ef-c39aa5c5bd7e None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:57.227523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1107/2197] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:18:57.240447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501b2e1-7dd2-4710-9815-e5f9c01e8453 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:57.241989 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-d501b2e1-7dd2-4710-9815-e5f9c01e8453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:57.313093 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501b2e1-7dd2-4710-9815-e5f9c01e8453 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:57.319574 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924a8d9-7333-4234-9412-79cc001355d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:57.320746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924a8d9-7333-4234-9412-79cc001355d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:57.321396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924a8d9-7333-4234-9412-79cc001355d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:57.321845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924a8d9-7333-4234-9412-79cc001355d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:57.333945 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924a8d9-7333-4234-9412-79cc001355d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:57.336409 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924a8d9-7333-4234-9412-79cc001355d1 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:57.349379 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:57.362409 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1108/2198] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:18:57.405365 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de34e4e-a7a3-4c6e-a46d-e9b70343e409 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:57.405986 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de34e4e-a7a3-4c6e-a46d-e9b70343e409 service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:57.406262 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de34e4e-a7a3-4c6e-a46d-e9b70343e409 service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:57.406921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de34e4e-a7a3-4c6e-a46d-e9b70343e409 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:57.466620 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de34e4e-a7a3-4c6e-a46d-e9b70343e409 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:57.468337 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de34e4e-a7a3-4c6e-a46d-e9b70343e409 service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:57.477495 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1091/2199] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:18:57.665092 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:57.827449 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924a8d9-7333-4234-9412-79cc001355d1 service neutron] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:57.828958 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-3924a8d9-7333-4234-9412-79cc001355d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:57.843332 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924a8d9-7333-4234-9412-79cc001355d1 service neutron] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:57.848633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e36c6b-5aef-49db-a5d8-617a95f8e259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:57.849319 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e36c6b-5aef-49db-a5d8-617a95f8e259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:57.849629 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e36c6b-5aef-49db-a5d8-617a95f8e259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:57.849904 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e36c6b-5aef-49db-a5d8-617a95f8e259 admin admin] PATH_INFO: `/v3/projects/a8593f4bbca84a358d8fb9d1ad2bfde8` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:57.851163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e36c6b-5aef-49db-a5d8-617a95f8e259 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8593f4bbca84a358d8fb9d1ad2bfde8)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:57.853128 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e36c6b-5aef-49db-a5d8-617a95f8e259 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:58.015933 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-15e36c6b-5aef-49db-a5d8-617a95f8e259 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8593f4bbca84a358d8fb9d1ad2bfde8', 'request_id': 'req-15e36c6b-5aef-49db-a5d8-617a95f8e259'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:58.022625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-15e36c6b-5aef-49db-a5d8-617a95f8e259 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8593f4bbca84a358d8fb9d1ad2bfde8', 'request_id': 'req-15e36c6b-5aef-49db-a5d8-617a95f8e259'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:58.030445 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-15e36c6b-5aef-49db-a5d8-617a95f8e259 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8593f4bbca84a358d8fb9d1ad2bfde8', 'request_id': 'req-15e36c6b-5aef-49db-a5d8-617a95f8e259'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:58.094576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb978a3-2803-44e8-9a2e-be9bf0dc51ed None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:58.096300 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb978a3-2803-44e8-9a2e-be9bf0dc51ed None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:58.096300 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb978a3-2803-44e8-9a2e-be9bf0dc51ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:58.115096 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:58.122678 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-15e36c6b-5aef-49db-a5d8-617a95f8e259 admin admin] The token cache is being invalidate because project a8593f4bbca84a358d8fb9d1ad2bfde8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:18:58.122981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-15e36c6b-5aef-49db-a5d8-617a95f8e259 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:58.123790 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-15e36c6b-5aef-49db-a5d8-617a95f8e259 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:18:58.125722 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1109/2200] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:18:57 2022] DELETE /identity/v3/projects/a8593f4bbca84a358d8fb9d1ad2bfde8 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:18:58.138408 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-5eb978a3-2803-44e8-9a2e-be9bf0dc51ed None None] MFA Rules not processed for user `6715aaba3433448cb11c6340f36fcc41`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:18:58.138408 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-5eb978a3-2803-44e8-9a2e-be9bf0dc51ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:58.213003 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1092/2201] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:18:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:18:58.225045 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e36c6b-5aef-49db-a5d8-617a95f8e259 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:18:58.227840 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-15e36c6b-5aef-49db-a5d8-617a95f8e259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:18:58.336423 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e36c6b-5aef-49db-a5d8-617a95f8e259 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:18:58.336423 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad2f45-9932-488d-900b-254d10812902 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:18:58.336423 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad2f45-9932-488d-900b-254d10812902 service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:18:58.336423 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad2f45-9932-488d-900b-254d10812902 service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:18:58.337608 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad2f45-9932-488d-900b-254d10812902 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:18:58.344246 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad2f45-9932-488d-900b-254d10812902 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:18:58.346477 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad2f45-9932-488d-900b-254d10812902 service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:18:58.359380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1110/2202] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:18:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:18:58.681111 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:00.507950 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:01.186328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89c86a-8d27-4d61-8e60-d55aeed25761 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:19:01.186648 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89c86a-8d27-4d61-8e60-d55aeed25761 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:19:01.186956 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89c86a-8d27-4d61-8e60-d55aeed25761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:19:01.206508 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-7d89c86a-8d27-4d61-8e60-d55aeed25761 None None] MFA Rules not processed for user `6715aaba3433448cb11c6340f36fcc41`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:19:01.207721 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-7d89c86a-8d27-4d61-8e60-d55aeed25761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:19:01.215558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1093/2203] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:19:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:19:01.350427 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:03.452344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:04.202140 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:05.435414 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:05.612596 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:06.589936 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:06.923333 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:07.614217 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:07.900217 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:08.625550 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:08.664872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:09.199289 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:09.308010 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:09.689709 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:09.780935 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:10.665531 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:10.752563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:11.217355 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:11.482978 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:11.839640 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:12.273600 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad2f45-9932-488d-900b-254d10812902 service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:19:12.276080 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-89ad2f45-9932-488d-900b-254d10812902 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:19:12.339251 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:12.346866 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad2f45-9932-488d-900b-254d10812902 service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:19:12.354655 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca406127-48ed-4a13-a65b-19d7b1684a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:19:12.355691 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca406127-48ed-4a13-a65b-19d7b1684a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:19:12.356030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca406127-48ed-4a13-a65b-19d7b1684a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:19:12.356508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca406127-48ed-4a13-a65b-19d7b1684a68 admin admin] PATH_INFO: `/v3/users/d8bc49fab1ac49098383f8bab8fa6c67` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:19:12.357846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca406127-48ed-4a13-a65b-19d7b1684a68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8bc49fab1ac49098383f8bab8fa6c67)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:19:12.360444 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca406127-48ed-4a13-a65b-19d7b1684a68 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:19:12.652214 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-ca406127-48ed-4a13-a65b-19d7b1684a68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8bc49fab1ac49098383f8bab8fa6c67'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:19:12.653067 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-ca406127-48ed-4a13-a65b-19d7b1684a68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8bc49fab1ac49098383f8bab8fa6c67'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:19:12.653684 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-ca406127-48ed-4a13-a65b-19d7b1684a68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8bc49fab1ac49098383f8bab8fa6c67'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:19:12.715936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-ca406127-48ed-4a13-a65b-19d7b1684a68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8bc49fab1ac49098383f8bab8fa6c67'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:19:12.732308 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-ca406127-48ed-4a13-a65b-19d7b1684a68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8bc49fab1ac49098383f8bab8fa6c67'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:19:12.747661 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1111/2204] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:19:12 2022] DELETE /identity/v3/users/d8bc49fab1ac49098383f8bab8fa6c67 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:19:12.752247 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82bc46-21b2-4238-85d4-dd92b4b81b16 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:19:12.752745 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82bc46-21b2-4238-85d4-dd92b4b81b16 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:19:12.752860 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82bc46-21b2-4238-85d4-dd92b4b81b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:19:12.771611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-6a82bc46-21b2-4238-85d4-dd92b4b81b16 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:19:12.773472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-6a82bc46-21b2-4238-85d4-dd92b4b81b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:19:12.832817 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1094/2205] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:19:12.843142 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca406127-48ed-4a13-a65b-19d7b1684a68 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:19:12.844538 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-ca406127-48ed-4a13-a65b-19d7b1684a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:19:12.896422 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:12.901495 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca406127-48ed-4a13-a65b-19d7b1684a68 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:19:12.905117 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2e20e-f618-49b7-accd-a29f63cc3c95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:19:12.905714 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2e20e-f618-49b7-accd-a29f63cc3c95 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:19:12.906011 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2e20e-f618-49b7-accd-a29f63cc3c95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:19:12.906266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2e20e-f618-49b7-accd-a29f63cc3c95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:19:12.915502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2e20e-f618-49b7-accd-a29f63cc3c95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:19:12.916935 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2e20e-f618-49b7-accd-a29f63cc3c95 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:19:12.926245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1112/2206] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:19:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:19:13.118968 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:13.386206 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82bc46-21b2-4238-85d4-dd92b4b81b16 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:19:13.387713 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-6a82bc46-21b2-4238-85d4-dd92b4b81b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:19:13.401017 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82bc46-21b2-4238-85d4-dd92b4b81b16 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:19:13.406256 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d051bf-f3e3-48c8-a973-1667cb0151ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:19:13.406969 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d051bf-f3e3-48c8-a973-1667cb0151ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:19:13.407253 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d051bf-f3e3-48c8-a973-1667cb0151ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:19:13.407523 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d051bf-f3e3-48c8-a973-1667cb0151ed admin admin] PATH_INFO: `/v3/projects/5ab41820e64e4f64ac6c2edd65c1bd3a` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:19:13.408678 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d051bf-f3e3-48c8-a973-1667cb0151ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ab41820e64e4f64ac6c2edd65c1bd3a)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:19:13.410628 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d051bf-f3e3-48c8-a973-1667cb0151ed admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:19:13.525516 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-03d051bf-f3e3-48c8-a973-1667cb0151ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ab41820e64e4f64ac6c2edd65c1bd3a', 'request_id': 'req-03d051bf-f3e3-48c8-a973-1667cb0151ed'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:19:13.531319 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-03d051bf-f3e3-48c8-a973-1667cb0151ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ab41820e64e4f64ac6c2edd65c1bd3a', 'request_id': 'req-03d051bf-f3e3-48c8-a973-1667cb0151ed'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:19:13.538266 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-03d051bf-f3e3-48c8-a973-1667cb0151ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ab41820e64e4f64ac6c2edd65c1bd3a', 'request_id': 'req-03d051bf-f3e3-48c8-a973-1667cb0151ed'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:19:13.616486 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:13.643469 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-03d051bf-f3e3-48c8-a973-1667cb0151ed admin admin] The token cache is being invalidate because project 5ab41820e64e4f64ac6c2edd65c1bd3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:19:13.643861 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-03d051bf-f3e3-48c8-a973-1667cb0151ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:19:13.644558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-03d051bf-f3e3-48c8-a973-1667cb0151ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:19:13.650638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1095/2207] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:19:13 2022] DELETE /identity/v3/projects/5ab41820e64e4f64ac6c2edd65c1bd3a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:19:14.515163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:14.875043 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:15.118270 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:15.174932 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:15.472606 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:15.571935 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:15.944674 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:16.000061 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:16.159856 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:16.245707 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:16.345792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:16.374265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:16.456999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:16.556838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:16.586041 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:16.707993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:16.730780 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:16.848274 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:16.919489 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:16.993469 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:17.019307 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:17.179612 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:17.351653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:17.407887 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:17.507567 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:17.704867 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:17.733159 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:17.970150 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:18.010116 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:18.384128 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:18.426864 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:18.458682 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:18.585252 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:18.615501 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:18.758522 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:18.787998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:19.175116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:19.229518 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:19.446632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:19.830082 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:24.405729 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215b5c2-1f5d-406e-98c7-17b05dd3c7e4 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:19:24.406311 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215b5c2-1f5d-406e-98c7-17b05dd3c7e4 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:19:24.406406 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215b5c2-1f5d-406e-98c7-17b05dd3c7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:19:24.424877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-b215b5c2-1f5d-406e-98c7-17b05dd3c7e4 None None] MFA Rules not processed for user `8926315ca58e466ba6ce873f4833f06b`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:19:24.426064 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-b215b5c2-1f5d-406e-98c7-17b05dd3c7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:19:24.479231 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1113/2208] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:19:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:19:28.420207 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d381a-20d8-4bea-a1b2-efce9ef14745 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:19:28.421277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d381a-20d8-4bea-a1b2-efce9ef14745 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:19:28.422611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d381a-20d8-4bea-a1b2-efce9ef14745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:19:28.445198 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-d25d381a-20d8-4bea-a1b2-efce9ef14745 None None] MFA Rules not processed for user `6715aaba3433448cb11c6340f36fcc41`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:19:28.446451 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-d25d381a-20d8-4bea-a1b2-efce9ef14745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:19:28.506919 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1096/2209] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:19:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:19:34.472858 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:DELETE=1,keystone:SELECT=57 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:38.499172 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:56.784031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96a523-c417-4056-81f0-2742dd932110 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:19:56.784573 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96a523-c417-4056-81f0-2742dd932110 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:19:56.784573 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96a523-c417-4056-81f0-2742dd932110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:19:56.803844 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-3f96a523-c417-4056-81f0-2742dd932110 None None] MFA Rules not processed for user `174ebadbeec64175bd09beb3e270c573`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:19:56.805082 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-3f96a523-c417-4056-81f0-2742dd932110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:19:56.861687 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1114/2210] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:19:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:19:57.613609 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a5396-4d89-46bc-abde-2b0407803ef1 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:19:57.614109 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a5396-4d89-46bc-abde-2b0407803ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:19:57.614243 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a5396-4d89-46bc-abde-2b0407803ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:19:57.633929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-837a5396-4d89-46bc-abde-2b0407803ef1 None None] MFA Rules not processed for user `970300b51d504a2bbc48158855f02f34`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:19:57.636105 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-837a5396-4d89-46bc-abde-2b0407803ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:19:57.708224 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1097/2211] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 23 08:19:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:19:57.855898 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96a523-c417-4056-81f0-2742dd932110 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:19:57.858180 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-3f96a523-c417-4056-81f0-2742dd932110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:19:57.940415 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96a523-c417-4056-81f0-2742dd932110 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:19:57.946167 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d60f2-3390-4bc9-979d-54a97ca7ebba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4718cad0c0b9461d9c4152d7ea4b385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:19:57.946778 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d60f2-3390-4bc9-979d-54a97ca7ebba service swift] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:19:57.947064 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d60f2-3390-4bc9-979d-54a97ca7ebba service swift] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:19:57.947340 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d60f2-3390-4bc9-979d-54a97ca7ebba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:19:57.955476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d60f2-3390-4bc9-979d-54a97ca7ebba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:19:57.957721 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d60f2-3390-4bc9-979d-54a97ca7ebba service swift] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:19:57.965669 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1115/2212] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 23 08:19:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 08:20:07.701200 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=25 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:20:07.962535 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=57 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:20:14.085982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d516db3-9761-42b5-ab29-ad4bfd992f8b None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:20:14.086590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d516db3-9761-42b5-ab29-ad4bfd992f8b None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:20:14.086590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d516db3-9761-42b5-ab29-ad4bfd992f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:20:14.106329 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-4d516db3-9761-42b5-ab29-ad4bfd992f8b None None] MFA Rules not processed for user `970300b51d504a2bbc48158855f02f34`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:20:14.107570 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-4d516db3-9761-42b5-ab29-ad4bfd992f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:20:14.115091 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1098/2213] 10.222.0.57 () {58 vars in 967 bytes} [Tue Aug 23 08:20:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:20:14.130315 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d60f2-3390-4bc9-979d-54a97ca7ebba service swift] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:20:14.141591 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d60f2-3390-4bc9-979d-54a97ca7ebba service swift] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:20:14.147207 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269008b-86fe-4fc6-be9c-50c05d56a67b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4718cad0c0b9461d9c4152d7ea4b385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:20:14.150971 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269008b-86fe-4fc6-be9c-50c05d56a67b service swift] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:20:14.151263 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269008b-86fe-4fc6-be9c-50c05d56a67b service swift] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:20:14.151544 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269008b-86fe-4fc6-be9c-50c05d56a67b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:20:14.160897 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269008b-86fe-4fc6-be9c-50c05d56a67b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:20:14.162622 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269008b-86fe-4fc6-be9c-50c05d56a67b service swift] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:20:14.172016 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1116/2214] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 23 08:20:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 08:20:17.450092 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d516db3-9761-42b5-ab29-ad4bfd992f8b None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:20:17.452700 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-4d516db3-9761-42b5-ab29-ad4bfd992f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:20:17.523947 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d516db3-9761-42b5-ab29-ad4bfd992f8b None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:20:17.528538 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b58aac-250d-4325-ada6-4db6007935d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:20:17.529167 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b58aac-250d-4325-ada6-4db6007935d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:20:17.529449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b58aac-250d-4325-ada6-4db6007935d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:20:17.529752 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b58aac-250d-4325-ada6-4db6007935d2 admin admin] PATH_INFO: `/v3/users/6715aaba3433448cb11c6340f36fcc41` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:20:17.530916 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b58aac-250d-4325-ada6-4db6007935d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6715aaba3433448cb11c6340f36fcc41)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:20:17.532853 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b58aac-250d-4325-ada6-4db6007935d2 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:20:17.744557 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-42b58aac-250d-4325-ada6-4db6007935d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6715aaba3433448cb11c6340f36fcc41'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:20:17.745392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-42b58aac-250d-4325-ada6-4db6007935d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6715aaba3433448cb11c6340f36fcc41'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:20:17.746111 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-42b58aac-250d-4325-ada6-4db6007935d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6715aaba3433448cb11c6340f36fcc41'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:20:17.823588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-42b58aac-250d-4325-ada6-4db6007935d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6715aaba3433448cb11c6340f36fcc41'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:20:17.832658 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-42b58aac-250d-4325-ada6-4db6007935d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6715aaba3433448cb11c6340f36fcc41'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:20:17.872112 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1099/2215] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:20:17 2022] DELETE /identity/v3/users/6715aaba3433448cb11c6340f36fcc41 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:20:18.209653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269008b-86fe-4fc6-be9c-50c05d56a67b service swift] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:20:18.231431 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269008b-86fe-4fc6-be9c-50c05d56a67b service swift] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:20:18.320348 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498724b-1c4b-4be0-884e-e6a0aa128aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:20:18.321042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498724b-1c4b-4be0-884e-e6a0aa128aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:20:18.321364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498724b-1c4b-4be0-884e-e6a0aa128aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:20:18.321608 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498724b-1c4b-4be0-884e-e6a0aa128aad admin admin] PATH_INFO: `/v3/projects/a3c058bd9c104d7dab422bed507395c6` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:20:18.322839 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498724b-1c4b-4be0-884e-e6a0aa128aad admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3c058bd9c104d7dab422bed507395c6)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:20:18.324805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498724b-1c4b-4be0-884e-e6a0aa128aad admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:20:18.342320 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714c958-6702-4ee6-9f58-a6c2f7b17675 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:20:18.342694 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714c958-6702-4ee6-9f58-a6c2f7b17675 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:20:18.342986 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714c958-6702-4ee6-9f58-a6c2f7b17675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:20:18.372598 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-0714c958-6702-4ee6-9f58-a6c2f7b17675 None None] MFA Rules not processed for user `970300b51d504a2bbc48158855f02f34`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:20:18.377314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-0714c958-6702-4ee6-9f58-a6c2f7b17675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:20:18.461709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1100/2216] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 23 08:20:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:20:18.480064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714c958-6702-4ee6-9f58-a6c2f7b17675 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:20:18.485520 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-0714c958-6702-4ee6-9f58-a6c2f7b17675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:20:18.507139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9498724b-1c4b-4be0-884e-e6a0aa128aad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3c058bd9c104d7dab422bed507395c6', 'request_id': 'req-9498724b-1c4b-4be0-884e-e6a0aa128aad'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:20:18.513920 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9498724b-1c4b-4be0-884e-e6a0aa128aad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3c058bd9c104d7dab422bed507395c6', 'request_id': 'req-9498724b-1c4b-4be0-884e-e6a0aa128aad'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:20:18.521445 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9498724b-1c4b-4be0-884e-e6a0aa128aad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3c058bd9c104d7dab422bed507395c6', 'request_id': 'req-9498724b-1c4b-4be0-884e-e6a0aa128aad'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:20:18.529893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:20:18.598114 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714c958-6702-4ee6-9f58-a6c2f7b17675 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:20:18.652807 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9498724b-1c4b-4be0-884e-e6a0aa128aad admin admin] The token cache is being invalidate because project a3c058bd9c104d7dab422bed507395c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:20:18.653222 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9498724b-1c4b-4be0-884e-e6a0aa128aad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:20:18.654417 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9498724b-1c4b-4be0-884e-e6a0aa128aad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:20:18.656467 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1117/2217] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:20:18 2022] DELETE /identity/v3/projects/a3c058bd9c104d7dab422bed507395c6 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:20:18.667804 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63619a-f8c5-4702-a81f-49dd4021d921 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:20:18.668175 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63619a-f8c5-4702-a81f-49dd4021d921 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:20:18.668528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63619a-f8c5-4702-a81f-49dd4021d921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:20:18.690705 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef01f47-2d7b-4531-a42d-39b05a9e7f91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4718cad0c0b9461d9c4152d7ea4b385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:20:18.691391 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef01f47-2d7b-4531-a42d-39b05a9e7f91 service swift] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:20:18.691731 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef01f47-2d7b-4531-a42d-39b05a9e7f91 service swift] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:20:18.692055 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef01f47-2d7b-4531-a42d-39b05a9e7f91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:20:18.693711 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-bf63619a-f8c5-4702-a81f-49dd4021d921 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:20:18.693840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-eef01f47-2d7b-4531-a42d-39b05a9e7f91 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:20:18.695064 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-bf63619a-f8c5-4702-a81f-49dd4021d921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:20:18.763415 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef01f47-2d7b-4531-a42d-39b05a9e7f91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:20:18.766820 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef01f47-2d7b-4531-a42d-39b05a9e7f91 service swift] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:20:18.784188 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1118/2218] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:20:18.785094 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1101/2219] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 23 08:20:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 08:20:18.792379 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb762d-1721-473f-98d1-48a354b88c3e None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:20:18.792971 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb762d-1721-473f-98d1-48a354b88c3e None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:20:18.795261 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb762d-1721-473f-98d1-48a354b88c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:20:18.818778 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-7fbb762d-1721-473f-98d1-48a354b88c3e None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:20:18.820083 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-7fbb762d-1721-473f-98d1-48a354b88c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:20:18.830131 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1119/2220] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:20:18.834865 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef01f47-2d7b-4531-a42d-39b05a9e7f91 service swift] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:20:18.847442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef01f47-2d7b-4531-a42d-39b05a9e7f91 service swift] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:20:18.853977 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058907c-1c2b-40dc-a452-9be8145406fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:20:18.854558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058907c-1c2b-40dc-a452-9be8145406fa admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:20:18.854836 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058907c-1c2b-40dc-a452-9be8145406fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:20:18.855113 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058907c-1c2b-40dc-a452-9be8145406fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:20:18.855753 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058907c-1c2b-40dc-a452-9be8145406fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:20:18.856547 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058907c-1c2b-40dc-a452-9be8145406fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:20:18.858359 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058907c-1c2b-40dc-a452-9be8145406fa admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:20:18.871810 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1102/2221] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:20:18.876392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb762d-1721-473f-98d1-48a354b88c3e None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:20:18.885996 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb762d-1721-473f-98d1-48a354b88c3e None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:20:18.893325 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9953f53-2e35-4be5-8785-92f13d89dc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:20:18.894044 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9953f53-2e35-4be5-8785-92f13d89dc30 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:20:18.894487 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9953f53-2e35-4be5-8785-92f13d89dc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:20:18.894838 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9953f53-2e35-4be5-8785-92f13d89dc30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:20:18.895552 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9953f53-2e35-4be5-8785-92f13d89dc30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:20:18.897588 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9953f53-2e35-4be5-8785-92f13d89dc30 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:20:18.908862 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:20:19.025375 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1120/2222] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:20:18 2022] POST /identity/v3/projects => generated 365 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:20:19.026587 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058907c-1c2b-40dc-a452-9be8145406fa admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:20:19.041728 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058907c-1c2b-40dc-a452-9be8145406fa admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:20:19.130748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:20:19.151596 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c94764-a011-417e-99e4-b15d80333f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:20:19.152690 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c94764-a011-417e-99e4-b15d80333f15 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:20:19.153346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c94764-a011-417e-99e4-b15d80333f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:20:19.153966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c94764-a011-417e-99e4-b15d80333f15 admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:20:19.155459 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c94764-a011-417e-99e4-b15d80333f15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:20:19.164719 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c94764-a011-417e-99e4-b15d80333f15 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:20:19.319501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1103/2223] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:20:19 2022] POST /identity/v3/users => generated 283 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:20:19.320207 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9953f53-2e35-4be5-8785-92f13d89dc30 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:20:19.340036 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9953f53-2e35-4be5-8785-92f13d89dc30 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:20:19.347948 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1fe5d-7e15-47b2-840a-d0fb1da31fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:20:19.348585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1fe5d-7e15-47b2-840a-d0fb1da31fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:20:19.348869 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1fe5d-7e15-47b2-840a-d0fb1da31fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:20:19.349149 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1fe5d-7e15-47b2-840a-d0fb1da31fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:20:19.349809 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1fe5d-7e15-47b2-840a-d0fb1da31fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:20:19.351548 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1fe5d-7e15-47b2-840a-d0fb1da31fe5 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:20:19.375689 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1121/2224] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:20:19.375792 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c94764-a011-417e-99e4-b15d80333f15 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:20:19.384386 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c94764-a011-417e-99e4-b15d80333f15 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:20:19.396529 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989de62e-0469-49d3-8f36-a642e6483078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:20:19.398146 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989de62e-0469-49d3-8f36-a642e6483078 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:20:19.399590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989de62e-0469-49d3-8f36-a642e6483078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:20:19.399973 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989de62e-0469-49d3-8f36-a642e6483078 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:20:19.400772 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989de62e-0469-49d3-8f36-a642e6483078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:20:19.403108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989de62e-0469-49d3-8f36-a642e6483078 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:20:19.429484 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1104/2225] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:20:19.430954 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1fe5d-7e15-47b2-840a-d0fb1da31fe5 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:20:19.448206 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1fe5d-7e15-47b2-840a-d0fb1da31fe5 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:20:19.467676 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae3742-ddd2-48e4-a8da-8624db21db94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:20:19.468378 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae3742-ddd2-48e4-a8da-8624db21db94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:20:19.468655 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae3742-ddd2-48e4-a8da-8624db21db94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:20:19.468934 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae3742-ddd2-48e4-a8da-8624db21db94 admin admin] PATH_INFO: `/v3/projects/e0a9a24b9b6c4e12bd323395a54bda69/users/f87db894182d4775827a847bad464d36/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:20:19.500807 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae3742-ddd2-48e4-a8da-8624db21db94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a9a24b9b6c4e12bd323395a54bda69, user_id=f87db894182d4775827a847bad464d36, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:20:19.504170 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae3742-ddd2-48e4-a8da-8624db21db94 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:20:19.622343 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1122/2226] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:20:19 2022] PUT /identity/v3/projects/e0a9a24b9b6c4e12bd323395a54bda69/users/f87db894182d4775827a847bad464d36/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:20:19.635552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dff460-424e-4810-9940-ce9ed24308f7 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:20:19.636037 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dff460-424e-4810-9940-ce9ed24308f7 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:20:19.636037 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dff460-424e-4810-9940-ce9ed24308f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:20:19.689920 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-56dff460-424e-4810-9940-ce9ed24308f7 None None] MFA Rules not processed for user `f87db894182d4775827a847bad464d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:20:19.691232 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-56dff460-424e-4810-9940-ce9ed24308f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:20:19.773819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1105/2227] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:20:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:20:19.785926 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae3742-ddd2-48e4-a8da-8624db21db94 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:20:19.787676 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-e3ae3742-ddd2-48e4-a8da-8624db21db94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:20:19.863522 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae3742-ddd2-48e4-a8da-8624db21db94 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:20:19.867295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2e1cd-951f-4352-81b4-d4656489c2d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:20:19.867915 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2e1cd-951f-4352-81b4-d4656489c2d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:20:19.868199 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2e1cd-951f-4352-81b4-d4656489c2d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:20:19.868610 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2e1cd-951f-4352-81b4-d4656489c2d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:20:19.879921 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2e1cd-951f-4352-81b4-d4656489c2d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:20:19.881393 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2e1cd-951f-4352-81b4-d4656489c2d9 service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:20:19.893039 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1123/2228] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:20:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:20:29.768756 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=44,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:20:29.887786 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=45,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:20:34.190556 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dff460-424e-4810-9940-ce9ed24308f7 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:20:34.195415 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-56dff460-424e-4810-9940-ce9ed24308f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:20:34.274532 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dff460-424e-4810-9940-ce9ed24308f7 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:20:34.281856 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e949f38-f0ef-417f-bcb6-343b1d6985f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e92560dd9da4c7cbcac5a84bcaca483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:20:34.282691 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e949f38-f0ef-417f-bcb6-343b1d6985f5 service placement] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:20:34.283088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e949f38-f0ef-417f-bcb6-343b1d6985f5 service placement] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:20:34.283388 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e949f38-f0ef-417f-bcb6-343b1d6985f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:20:34.285491 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-2e949f38-f0ef-417f-bcb6-343b1d6985f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:20:34.300696 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e949f38-f0ef-417f-bcb6-343b1d6985f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:20:34.302382 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e949f38-f0ef-417f-bcb6-343b1d6985f5 service placement] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:20:34.313406 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1106/2229] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:20:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:20:37.226438 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c72e9-c5cb-488f-bde7-8761bc383c11 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:20:37.227511 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c72e9-c5cb-488f-bde7-8761bc383c11 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:20:37.227990 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c72e9-c5cb-488f-bde7-8761bc383c11 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:20:37.229647 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1124/2230] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 23 08:20:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:20:37.236861 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789cf5a-ab4a-43d0-86ce-c4c6be034856 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:20:37.237347 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789cf5a-ab4a-43d0-86ce-c4c6be034856 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:20:37.237433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789cf5a-ab4a-43d0-86ce-c4c6be034856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:20:37.259721 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-4789cf5a-ab4a-43d0-86ce-c4c6be034856 None None] MFA Rules not processed for user `b5c55e5c1cea47f29d378ea457384a31`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:20:37.261044 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-4789cf5a-ab4a-43d0-86ce-c4c6be034856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:20:37.331845 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1107/2231] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 23 08:20:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:20:37.343995 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c72e9-c5cb-488f-bde7-8761bc383c11 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:20:37.345745 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-d27c72e9-c5cb-488f-bde7-8761bc383c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:20:37.424995 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c72e9-c5cb-488f-bde7-8761bc383c11 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:20:37.428450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312b272-c606-4e30-a841-264470b195af service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f4ee9c3c5be48699a24dfce9b30bda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:20:37.429044 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312b272-c606-4e30-a841-264470b195af service glance] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:20:37.429321 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312b272-c606-4e30-a841-264470b195af service glance] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:20:37.429594 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312b272-c606-4e30-a841-264470b195af service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:20:37.440205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312b272-c606-4e30-a841-264470b195af service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:20:37.441632 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312b272-c606-4e30-a841-264470b195af service glance] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:20:37.452487 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1125/2232] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:20:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:20:37.662455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8705b69-5e7b-43af-ac85-6c0ca4ab89d6 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:20:37.664606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8705b69-5e7b-43af-ac85-6c0ca4ab89d6 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:20:37.664606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8705b69-5e7b-43af-ac85-6c0ca4ab89d6 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:20:37.664606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1108/2233] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 23 08:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:20:37.669083 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e3062-bff7-41e7-995c-c66957414df1 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:20:37.669376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e3062-bff7-41e7-995c-c66957414df1 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:20:37.669670 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e3062-bff7-41e7-995c-c66957414df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:20:37.690673 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-bd2e3062-bff7-41e7-995c-c66957414df1 None None] MFA Rules not processed for user `4239cee14f954e95b4a6b0af2e8799b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:20:37.691801 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-bd2e3062-bff7-41e7-995c-c66957414df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:20:37.743555 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1126/2234] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 23 08:20:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:20:37.755881 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8705b69-5e7b-43af-ac85-6c0ca4ab89d6 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:20:37.758557 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a8705b69-5e7b-43af-ac85-6c0ca4ab89d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:20:37.772796 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8705b69-5e7b-43af-ac85-6c0ca4ab89d6 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:20:37.776315 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b14a79-5b1e-47a2-8afc-100971bbcace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:20:37.776902 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b14a79-5b1e-47a2-8afc-100971bbcace service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:20:37.777179 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b14a79-5b1e-47a2-8afc-100971bbcace service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:20:37.777450 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b14a79-5b1e-47a2-8afc-100971bbcace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:20:37.784872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b14a79-5b1e-47a2-8afc-100971bbcace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:20:37.786303 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b14a79-5b1e-47a2-8afc-100971bbcace service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:20:37.793941 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1109/2235] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:20:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:20:37.880876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16d2b7-61c6-4082-a2d5-cfb85b82e355 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:20:37.881197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16d2b7-61c6-4082-a2d5-cfb85b82e355 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:20:37.881493 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16d2b7-61c6-4082-a2d5-cfb85b82e355 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:20:37.882944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1127/2236] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 23 08:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:20:37.888543 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b14fe5-8b37-4bfc-bfd0-b28f0fe55a0c None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:20:37.888868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b14fe5-8b37-4bfc-bfd0-b28f0fe55a0c None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:20:37.889148 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b14fe5-8b37-4bfc-bfd0-b28f0fe55a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:20:37.909344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-b0b14fe5-8b37-4bfc-bfd0-b28f0fe55a0c None None] MFA Rules not processed for user `b5c55e5c1cea47f29d378ea457384a31`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:20:37.910631 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-b0b14fe5-8b37-4bfc-bfd0-b28f0fe55a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:20:37.919967 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1110/2237] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 23 08:20:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:20:37.931253 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16d2b7-61c6-4082-a2d5-cfb85b82e355 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:20:37.942658 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16d2b7-61c6-4082-a2d5-cfb85b82e355 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:20:37.946192 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be5ed0-4944-49c1-ad2c-967c57076f5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:20:37.946849 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be5ed0-4944-49c1-ad2c-967c57076f5a service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:20:37.947121 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be5ed0-4944-49c1-ad2c-967c57076f5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:20:37.947390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be5ed0-4944-49c1-ad2c-967c57076f5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:20:37.957455 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be5ed0-4944-49c1-ad2c-967c57076f5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:20:37.958910 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be5ed0-4944-49c1-ad2c-967c57076f5a service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:20:37.969961 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1128/2238] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:20:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:20:41.842784 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeed37a-2873-4a64-bc30-f7bc75cc16a6 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:20:41.843485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeed37a-2873-4a64-bc30-f7bc75cc16a6 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:20:41.843485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeed37a-2873-4a64-bc30-f7bc75cc16a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:20:41.863653 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-eeeed37a-2873-4a64-bc30-f7bc75cc16a6 None None] MFA Rules not processed for user `970300b51d504a2bbc48158855f02f34`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:20:41.864873 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-eeeed37a-2873-4a64-bc30-f7bc75cc16a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:20:41.922915 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1111/2239] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 23 08:20:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:20:41.934982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be5ed0-4944-49c1-ad2c-967c57076f5a service neutron] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:20:41.937255 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-f4be5ed0-4944-49c1-ad2c-967c57076f5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:20:42.009273 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be5ed0-4944-49c1-ad2c-967c57076f5a service neutron] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:20:42.014857 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3779e-497d-4ece-9a75-55a3c39ce640 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4718cad0c0b9461d9c4152d7ea4b385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:20:42.015553 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3779e-497d-4ece-9a75-55a3c39ce640 service swift] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:20:42.015911 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3779e-497d-4ece-9a75-55a3c39ce640 service swift] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:20:42.016262 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3779e-497d-4ece-9a75-55a3c39ce640 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:20:42.025367 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3779e-497d-4ece-9a75-55a3c39ce640 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:20:42.026997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3779e-497d-4ece-9a75-55a3c39ce640 service swift] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:20:42.036042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1129/2240] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 23 08:20:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 08:20:51.915329 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=97 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:20:52.032422 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=96 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:21:13.010755 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeed37a-2873-4a64-bc30-f7bc75cc16a6 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:21:13.075333 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeed37a-2873-4a64-bc30-f7bc75cc16a6 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:21:13.081080 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7fa85-dad2-40ef-bc89-0934cd7ca8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:21:13.081593 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7fa85-dad2-40ef-bc89-0934cd7ca8fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:21:13.081879 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7fa85-dad2-40ef-bc89-0934cd7ca8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:21:13.082157 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7fa85-dad2-40ef-bc89-0934cd7ca8fb admin admin] PATH_INFO: `/v3/users/f87db894182d4775827a847bad464d36` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:21:13.083318 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7fa85-dad2-40ef-bc89-0934cd7ca8fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f87db894182d4775827a847bad464d36)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:21:13.085436 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7fa85-dad2-40ef-bc89-0934cd7ca8fb admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:21:13.279873 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-4df7fa85-dad2-40ef-bc89-0934cd7ca8fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f87db894182d4775827a847bad464d36'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:21:13.280538 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-4df7fa85-dad2-40ef-bc89-0934cd7ca8fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f87db894182d4775827a847bad464d36'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:21:13.281150 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-4df7fa85-dad2-40ef-bc89-0934cd7ca8fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f87db894182d4775827a847bad464d36'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:21:13.408903 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-4df7fa85-dad2-40ef-bc89-0934cd7ca8fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f87db894182d4775827a847bad464d36'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:21:13.416207 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-4df7fa85-dad2-40ef-bc89-0934cd7ca8fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f87db894182d4775827a847bad464d36'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:21:13.437510 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1112/2241] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:21:13 2022] DELETE /identity/v3/users/f87db894182d4775827a847bad464d36 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:21:13.442055 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200770b-6b29-4046-b562-a510415e57a4 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:21:13.448118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200770b-6b29-4046-b562-a510415e57a4 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:21:13.448118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200770b-6b29-4046-b562-a510415e57a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:21:13.461720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-8200770b-6b29-4046-b562-a510415e57a4 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:21:13.462991 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-8200770b-6b29-4046-b562-a510415e57a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:21:13.533403 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1130/2242] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:21:13.553288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7fa85-dad2-40ef-bc89-0934cd7ca8fb admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:21:13.554779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-4df7fa85-dad2-40ef-bc89-0934cd7ca8fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:21:13.620373 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7fa85-dad2-40ef-bc89-0934cd7ca8fb admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:21:13.625078 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ca562-68cd-495c-8cfa-4e04ebf30e71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:21:13.626354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ca562-68cd-495c-8cfa-4e04ebf30e71 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:21:13.626644 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ca562-68cd-495c-8cfa-4e04ebf30e71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:21:13.626922 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ca562-68cd-495c-8cfa-4e04ebf30e71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:21:13.636293 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ca562-68cd-495c-8cfa-4e04ebf30e71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:21:13.641102 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ca562-68cd-495c-8cfa-4e04ebf30e71 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:21:13.651196 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1113/2243] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:21:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:21:14.215889 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200770b-6b29-4046-b562-a510415e57a4 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:21:14.217957 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-8200770b-6b29-4046-b562-a510415e57a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:21:14.229742 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200770b-6b29-4046-b562-a510415e57a4 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:21:14.234577 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5aed1e-b39b-4112-a301-20bf85410713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:21:14.235202 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5aed1e-b39b-4112-a301-20bf85410713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:21:14.235487 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5aed1e-b39b-4112-a301-20bf85410713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:21:14.235753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5aed1e-b39b-4112-a301-20bf85410713 admin admin] PATH_INFO: `/v3/projects/e0a9a24b9b6c4e12bd323395a54bda69` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:21:14.236879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5aed1e-b39b-4112-a301-20bf85410713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0a9a24b9b6c4e12bd323395a54bda69)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:21:14.238961 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5aed1e-b39b-4112-a301-20bf85410713 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:21:14.380148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-3c5aed1e-b39b-4112-a301-20bf85410713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0a9a24b9b6c4e12bd323395a54bda69', 'request_id': 'req-3c5aed1e-b39b-4112-a301-20bf85410713'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:21:14.385822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-3c5aed1e-b39b-4112-a301-20bf85410713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0a9a24b9b6c4e12bd323395a54bda69', 'request_id': 'req-3c5aed1e-b39b-4112-a301-20bf85410713'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:21:14.392616 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-3c5aed1e-b39b-4112-a301-20bf85410713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0a9a24b9b6c4e12bd323395a54bda69', 'request_id': 'req-3c5aed1e-b39b-4112-a301-20bf85410713'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:21:14.500352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-3c5aed1e-b39b-4112-a301-20bf85410713 admin admin] The token cache is being invalidate because project e0a9a24b9b6c4e12bd323395a54bda69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:21:14.500968 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-3c5aed1e-b39b-4112-a301-20bf85410713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:21:14.501294 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-3c5aed1e-b39b-4112-a301-20bf85410713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:21:14.502845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1131/2244] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:21:14 2022] DELETE /identity/v3/projects/e0a9a24b9b6c4e12bd323395a54bda69 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:21:14.508067 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642c256-3f9b-4b14-9ca0-1b8f86221701 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:21:14.508508 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642c256-3f9b-4b14-9ca0-1b8f86221701 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:21:14.508603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642c256-3f9b-4b14-9ca0-1b8f86221701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:21:14.528315 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-7642c256-3f9b-4b14-9ca0-1b8f86221701 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:21:14.529858 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-7642c256-3f9b-4b14-9ca0-1b8f86221701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:21:14.546411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:21:14.587875 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1114/2245] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:21:14.595507 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986ad1d-c4f2-40b1-bd60-4f9eeb2b61ff None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:21:14.595794 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986ad1d-c4f2-40b1-bd60-4f9eeb2b61ff None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:21:14.596068 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986ad1d-c4f2-40b1-bd60-4f9eeb2b61ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:21:14.616642 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-2986ad1d-c4f2-40b1-bd60-4f9eeb2b61ff None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:21:14.617835 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-2986ad1d-c4f2-40b1-bd60-4f9eeb2b61ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:21:14.626200 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1132/2246] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:21:14.636016 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642c256-3f9b-4b14-9ca0-1b8f86221701 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:21:14.646337 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642c256-3f9b-4b14-9ca0-1b8f86221701 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:21:14.651100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b89f1-f03f-4ced-af5e-30df22f8c3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:21:14.651912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b89f1-f03f-4ced-af5e-30df22f8c3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:21:14.652381 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b89f1-f03f-4ced-af5e-30df22f8c3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:21:14.653016 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b89f1-f03f-4ced-af5e-30df22f8c3e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:21:14.653709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b89f1-f03f-4ced-af5e-30df22f8c3e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:21:14.654039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b89f1-f03f-4ced-af5e-30df22f8c3e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:21:14.656037 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b89f1-f03f-4ced-af5e-30df22f8c3e4 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:21:14.668002 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1115/2247] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:21:14.672698 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986ad1d-c4f2-40b1-bd60-4f9eeb2b61ff None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:21:14.682188 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986ad1d-c4f2-40b1-bd60-4f9eeb2b61ff None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:21:14.688644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53c111-42b9-47e4-a3b4-eb0a3cd5f65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:21:14.689248 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53c111-42b9-47e4-a3b4-eb0a3cd5f65f admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:21:14.689529 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53c111-42b9-47e4-a3b4-eb0a3cd5f65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:21:14.689805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53c111-42b9-47e4-a3b4-eb0a3cd5f65f admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:21:14.690509 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53c111-42b9-47e4-a3b4-eb0a3cd5f65f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:21:14.692345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53c111-42b9-47e4-a3b4-eb0a3cd5f65f admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:21:14.783107 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1133/2248] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:21:14 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:21:14.787452 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b89f1-f03f-4ced-af5e-30df22f8c3e4 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:21:14.798069 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b89f1-f03f-4ced-af5e-30df22f8c3e4 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:21:14.865017 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a590ea-ff65-43bf-9c2a-224b5d2135a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:21:14.865628 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a590ea-ff65-43bf-9c2a-224b5d2135a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:21:14.865906 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a590ea-ff65-43bf-9c2a-224b5d2135a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:21:14.866193 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a590ea-ff65-43bf-9c2a-224b5d2135a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:21:14.866833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a590ea-ff65-43bf-9c2a-224b5d2135a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:21:14.868749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a590ea-ff65-43bf-9c2a-224b5d2135a3 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:21:14.961525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1116/2249] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:21:14 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:21:14.965579 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53c111-42b9-47e4-a3b4-eb0a3cd5f65f admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:21:14.976000 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53c111-42b9-47e4-a3b4-eb0a3cd5f65f admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:21:14.980659 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bbb0a-eb3a-4912-8381-329aee3fed63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:21:14.981250 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bbb0a-eb3a-4912-8381-329aee3fed63 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:21:14.981533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bbb0a-eb3a-4912-8381-329aee3fed63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:21:14.981927 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bbb0a-eb3a-4912-8381-329aee3fed63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:21:14.983125 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1bbb0a-eb3a-4912-8381-329aee3fed63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:21:14.984717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1bbb0a-eb3a-4912-8381-329aee3fed63 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:21:14.995542 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1134/2250] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:21:15.000043 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a590ea-ff65-43bf-9c2a-224b5d2135a3 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:21:15.010041 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a590ea-ff65-43bf-9c2a-224b5d2135a3 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:21:15.015190 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdec2e-df2c-4cf6-8bd9-7ae2f6ea23c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:21:15.015893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdec2e-df2c-4cf6-8bd9-7ae2f6ea23c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:21:15.016177 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdec2e-df2c-4cf6-8bd9-7ae2f6ea23c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:21:15.016449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdec2e-df2c-4cf6-8bd9-7ae2f6ea23c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:21:15.017083 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacdec2e-df2c-4cf6-8bd9-7ae2f6ea23c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:21:15.018790 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacdec2e-df2c-4cf6-8bd9-7ae2f6ea23c3 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:21:15.029373 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1117/2251] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:21:15.033736 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bbb0a-eb3a-4912-8381-329aee3fed63 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:21:15.043715 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bbb0a-eb3a-4912-8381-329aee3fed63 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:21:15.049370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ceeb5-5198-4781-996f-a0d56f39e4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:21:15.050011 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ceeb5-5198-4781-996f-a0d56f39e4ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:21:15.050313 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ceeb5-5198-4781-996f-a0d56f39e4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:21:15.050607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ceeb5-5198-4781-996f-a0d56f39e4ce admin admin] PATH_INFO: `/v3/projects/1d5c6ac98d7848cd9ad36530e88ed716/users/ff5b35df95de4ffcbb2e9a17e8b7844a/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:21:15.066228 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ceeb5-5198-4781-996f-a0d56f39e4ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5c6ac98d7848cd9ad36530e88ed716, user_id=ff5b35df95de4ffcbb2e9a17e8b7844a, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:21:15.068984 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ceeb5-5198-4781-996f-a0d56f39e4ce admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:21:15.137406 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1135/2252] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:21:15 2022] PUT /identity/v3/projects/1d5c6ac98d7848cd9ad36530e88ed716/users/ff5b35df95de4ffcbb2e9a17e8b7844a/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:21:15.145137 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eeffd4-d697-48ca-98e9-13bd5910da88 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:21:15.145422 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eeffd4-d697-48ca-98e9-13bd5910da88 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:21:15.145697 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eeffd4-d697-48ca-98e9-13bd5910da88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:21:15.164619 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-d3eeffd4-d697-48ca-98e9-13bd5910da88 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:21:15.165804 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-d3eeffd4-d697-48ca-98e9-13bd5910da88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:21:15.227542 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1118/2253] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:21:15.238170 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ceeb5-5198-4781-996f-a0d56f39e4ce admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:21:15.240377 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-115ceeb5-5198-4781-996f-a0d56f39e4ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:21:15.265471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:21:15.303137 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ceeb5-5198-4781-996f-a0d56f39e4ce admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:21:15.307110 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294ef68-0ed0-4f73-a13d-2f1a69b86b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:21:15.307867 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294ef68-0ed0-4f73-a13d-2f1a69b86b57 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:21:15.308150 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294ef68-0ed0-4f73-a13d-2f1a69b86b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:21:15.308462 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294ef68-0ed0-4f73-a13d-2f1a69b86b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:21:15.318572 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294ef68-0ed0-4f73-a13d-2f1a69b86b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:21:15.320175 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294ef68-0ed0-4f73-a13d-2f1a69b86b57 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:21:15.330077 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1136/2254] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:21:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:21:15.746765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547ff02-1b0f-4958-b2a1-a15c450a9d14 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:21:15.747236 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547ff02-1b0f-4958-b2a1-a15c450a9d14 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:21:15.747334 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547ff02-1b0f-4958-b2a1-a15c450a9d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:21:15.767566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-2547ff02-1b0f-4958-b2a1-a15c450a9d14 None None] MFA Rules not processed for user `970300b51d504a2bbc48158855f02f34`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:21:15.768784 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-2547ff02-1b0f-4958-b2a1-a15c450a9d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:21:15.793815 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:21:15.824306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1119/2255] 10.222.0.57 () {58 vars in 967 bytes} [Tue Aug 23 08:21:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:21:15.848543 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294ef68-0ed0-4f73-a13d-2f1a69b86b57 service neutron] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:21:15.849998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-7294ef68-0ed0-4f73-a13d-2f1a69b86b57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:21:15.934368 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294ef68-0ed0-4f73-a13d-2f1a69b86b57 service neutron] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:21:15.940201 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da412e-58eb-4b9a-83ef-ac4405e0fdb4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4718cad0c0b9461d9c4152d7ea4b385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:21:15.940827 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da412e-58eb-4b9a-83ef-ac4405e0fdb4 service swift] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:21:15.941107 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da412e-58eb-4b9a-83ef-ac4405e0fdb4 service swift] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:21:15.941381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da412e-58eb-4b9a-83ef-ac4405e0fdb4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:21:15.953345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da412e-58eb-4b9a-83ef-ac4405e0fdb4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:21:15.955132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da412e-58eb-4b9a-83ef-ac4405e0fdb4 service swift] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:21:15.968737 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1137/2256] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 23 08:21:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 08:21:21.219489 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be757dcd-74d4-4944-aaf2-2ff16820353a None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:21:21.220608 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be757dcd-74d4-4944-aaf2-2ff16820353a None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:21:21.220891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be757dcd-74d4-4944-aaf2-2ff16820353a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:21:21.258948 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-be757dcd-74d4-4944-aaf2-2ff16820353a None None] MFA Rules not processed for user `ff5b35df95de4ffcbb2e9a17e8b7844a`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:21:21.260453 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-be757dcd-74d4-4944-aaf2-2ff16820353a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:21:21.354937 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1120/2257] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:21:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:21:21.360178 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da412e-58eb-4b9a-83ef-ac4405e0fdb4 service swift] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:21:21.371356 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da412e-58eb-4b9a-83ef-ac4405e0fdb4 service swift] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:21:21.379364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36feafad-5f10-4f3d-97da-23245f4adb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:21:21.380064 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36feafad-5f10-4f3d-97da-23245f4adb80 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:21:21.380286 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36feafad-5f10-4f3d-97da-23245f4adb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:21:21.380563 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36feafad-5f10-4f3d-97da-23245f4adb80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:21:21.381195 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36feafad-5f10-4f3d-97da-23245f4adb80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:21:21.383195 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36feafad-5f10-4f3d-97da-23245f4adb80 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:21:21.544870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1138/2258] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:21:21 2022] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:21:21.546624 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be757dcd-74d4-4944-aaf2-2ff16820353a None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:21:21.557800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be757dcd-74d4-4944-aaf2-2ff16820353a None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:21:21.620523 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e32ca2-183d-4a65-9173-7e81488d79da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:21:21.621154 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e32ca2-183d-4a65-9173-7e81488d79da admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:21:21.621419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e32ca2-183d-4a65-9173-7e81488d79da admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:21:21.621694 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e32ca2-183d-4a65-9173-7e81488d79da admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:21:21.622403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e32ca2-183d-4a65-9173-7e81488d79da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:21:21.624698 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e32ca2-183d-4a65-9173-7e81488d79da admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:21:21.743781 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1121/2259] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:21:21 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:21:21.748062 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36feafad-5f10-4f3d-97da-23245f4adb80 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:21:21.758924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36feafad-5f10-4f3d-97da-23245f4adb80 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:21:21.764358 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5bc46-386d-4b83-91ce-630dad4898ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:21:21.765023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5bc46-386d-4b83-91ce-630dad4898ee admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:21:21.765300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5bc46-386d-4b83-91ce-630dad4898ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:21:21.765631 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5bc46-386d-4b83-91ce-630dad4898ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:21:21.766274 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5bc46-386d-4b83-91ce-630dad4898ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:21:21.768187 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5bc46-386d-4b83-91ce-630dad4898ee admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:21:21.780284 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1139/2260] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:21:21.784845 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e32ca2-183d-4a65-9173-7e81488d79da admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:21:21.796509 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e32ca2-183d-4a65-9173-7e81488d79da admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:21:21.801190 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c1ff6-c9b2-4823-b680-bbf1453bda09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:21:21.801873 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c1ff6-c9b2-4823-b680-bbf1453bda09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:21:21.802157 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c1ff6-c9b2-4823-b680-bbf1453bda09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:21:21.802494 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c1ff6-c9b2-4823-b680-bbf1453bda09 admin admin] PATH_INFO: `/v3/projects/b874dfccdd68402cad95d303a9ccf7cd/users/7c2d7329818445b981f620706ca4a7f6/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:21:21.819073 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c1ff6-c9b2-4823-b680-bbf1453bda09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b874dfccdd68402cad95d303a9ccf7cd, user_id=7c2d7329818445b981f620706ca4a7f6, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:21:21.821783 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c1ff6-c9b2-4823-b680-bbf1453bda09 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:21:21.920860 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1122/2261] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:21:21 2022] PUT /identity/v3/projects/b874dfccdd68402cad95d303a9ccf7cd/users/7c2d7329818445b981f620706ca4a7f6/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:21:21.924824 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5bc46-386d-4b83-91ce-630dad4898ee admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:21:21.936404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5bc46-386d-4b83-91ce-630dad4898ee admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:21:21.993358 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64435dbb-457c-4fe0-8043-ade4976f9722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:21:21.993966 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64435dbb-457c-4fe0-8043-ade4976f9722 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:21:21.994249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64435dbb-457c-4fe0-8043-ade4976f9722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:21:21.994563 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64435dbb-457c-4fe0-8043-ade4976f9722 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:21:21.995232 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64435dbb-457c-4fe0-8043-ade4976f9722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:21:21.996896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64435dbb-457c-4fe0-8043-ade4976f9722 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:21:22.009042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1140/2262] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:21:22.013236 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c1ff6-c9b2-4823-b680-bbf1453bda09 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:21:22.024613 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c1ff6-c9b2-4823-b680-bbf1453bda09 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:21:22.029222 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fa8fc-ec6b-4502-ba32-b3dc1d7fd1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:21:22.029987 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fa8fc-ec6b-4502-ba32-b3dc1d7fd1cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:21:22.030265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fa8fc-ec6b-4502-ba32-b3dc1d7fd1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:21:22.030571 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fa8fc-ec6b-4502-ba32-b3dc1d7fd1cc admin admin] PATH_INFO: `/v3/projects/b874dfccdd68402cad95d303a9ccf7cd/users/7c2d7329818445b981f620706ca4a7f6/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:21:22.032456 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170fa8fc-ec6b-4502-ba32-b3dc1d7fd1cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b874dfccdd68402cad95d303a9ccf7cd, user_id=7c2d7329818445b981f620706ca4a7f6, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:21:22.035105 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170fa8fc-ec6b-4502-ba32-b3dc1d7fd1cc admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:21:22.045147 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1123/2263] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:21:22 2022] PUT /identity/v3/projects/b874dfccdd68402cad95d303a9ccf7cd/users/7c2d7329818445b981f620706ca4a7f6/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:21:28.476497 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20f7b4-0dfd-4bae-b96b-6b8cd0e83bae None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:21:28.477075 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20f7b4-0dfd-4bae-b96b-6b8cd0e83bae None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:21:28.477180 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20f7b4-0dfd-4bae-b96b-6b8cd0e83bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:21:28.511020 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-8e20f7b4-0dfd-4bae-b96b-6b8cd0e83bae None None] MFA Rules not processed for user `7c2d7329818445b981f620706ca4a7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:21:28.512441 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-8e20f7b4-0dfd-4bae-b96b-6b8cd0e83bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:21:28.520205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:21:28.595753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1141/2264] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:21:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:21:28.609277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fa8fc-ec6b-4502-ba32-b3dc1d7fd1cc admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:21:28.611346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-170fa8fc-ec6b-4502-ba32-b3dc1d7fd1cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:21:28.631847 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:21:28.689683 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fa8fc-ec6b-4502-ba32-b3dc1d7fd1cc admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:21:28.695735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2449c77-b8f8-469f-9dcc-5094403d65c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:21:28.696386 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2449c77-b8f8-469f-9dcc-5094403d65c0 service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:21:28.696668 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2449c77-b8f8-469f-9dcc-5094403d65c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:21:28.696943 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2449c77-b8f8-469f-9dcc-5094403d65c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:21:28.766771 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2449c77-b8f8-469f-9dcc-5094403d65c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:21:28.766771 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2449c77-b8f8-469f-9dcc-5094403d65c0 service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:21:28.775130 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1124/2265] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:21:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:21:32.639718 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448005fd-14b1-4d0a-bcbf-ae1e5cb4421c None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:21:32.640196 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448005fd-14b1-4d0a-bcbf-ae1e5cb4421c None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:21:32.640294 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448005fd-14b1-4d0a-bcbf-ae1e5cb4421c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:21:32.661138 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-448005fd-14b1-4d0a-bcbf-ae1e5cb4421c None None] MFA Rules not processed for user `ff5b35df95de4ffcbb2e9a17e8b7844a`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:21:32.662724 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-448005fd-14b1-4d0a-bcbf-ae1e5cb4421c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:21:32.670266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1142/2266] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:21:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:21:38.945690 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=49 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:21:42.654857 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=30 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:21:55.230974 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427e982-af93-42b3-95bb-b01450a2f08a None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:21:55.231725 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427e982-af93-42b3-95bb-b01450a2f08a None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:21:55.231725 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427e982-af93-42b3-95bb-b01450a2f08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:21:55.251248 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-a427e982-af93-42b3-95bb-b01450a2f08a None None] MFA Rules not processed for user `8926315ca58e466ba6ce873f4833f06b`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:21:55.252109 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a427e982-af93-42b3-95bb-b01450a2f08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:21:55.307445 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1125/2267] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:21:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:22:05.300399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=25 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:22:14.907284 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448005fd-14b1-4d0a-bcbf-ae1e5cb4421c None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:22:14.962831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448005fd-14b1-4d0a-bcbf-ae1e5cb4421c None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:22:14.966907 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a13e6d-47b9-49fa-a890-e9fc963d1103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:22:14.967631 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a13e6d-47b9-49fa-a890-e9fc963d1103 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:22:14.967949 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a13e6d-47b9-49fa-a890-e9fc963d1103 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:22:14.968227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a13e6d-47b9-49fa-a890-e9fc963d1103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:22:14.970477 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c3a13e6d-47b9-49fa-a890-e9fc963d1103 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:22:14.985159 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a13e6d-47b9-49fa-a890-e9fc963d1103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:22:14.986665 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a13e6d-47b9-49fa-a890-e9fc963d1103 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:22:14.998327 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1143/2268] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:22:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:22:15.446430 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427e982-af93-42b3-95bb-b01450a2f08a None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:22:15.459870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427e982-af93-42b3-95bb-b01450a2f08a None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:22:15.463488 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b7a39-f653-475b-90fe-52d94d12c9a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:22:15.464093 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b7a39-f653-475b-90fe-52d94d12c9a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:22:15.464374 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b7a39-f653-475b-90fe-52d94d12c9a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:22:15.464647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b7a39-f653-475b-90fe-52d94d12c9a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:22:15.475108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b7a39-f653-475b-90fe-52d94d12c9a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:22:15.476610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b7a39-f653-475b-90fe-52d94d12c9a5 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:22:15.486018 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1126/2269] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:22:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:22:17.777201 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a13e6d-47b9-49fa-a890-e9fc963d1103 service neutron] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:22:17.786924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a13e6d-47b9-49fa-a890-e9fc963d1103 service neutron] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:22:17.790703 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927f280-0760-4d70-a49b-28c9e3ffbae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:22:17.791314 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927f280-0760-4d70-a49b-28c9e3ffbae9 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:22:17.798056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927f280-0760-4d70-a49b-28c9e3ffbae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:22:17.798056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927f280-0760-4d70-a49b-28c9e3ffbae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:22:17.798056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-0927f280-0760-4d70-a49b-28c9e3ffbae9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:22:17.808879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927f280-0760-4d70-a49b-28c9e3ffbae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:22:17.810403 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927f280-0760-4d70-a49b-28c9e3ffbae9 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:22:17.822930 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1144/2270] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:22:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:22:24.543339 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af28340-8108-467d-afc3-70a802d16215 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:22:24.543836 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af28340-8108-467d-afc3-70a802d16215 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:22:24.543939 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af28340-8108-467d-afc3-70a802d16215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:22:24.562708 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-1af28340-8108-467d-afc3-70a802d16215 None None] MFA Rules not processed for user `174ebadbeec64175bd09beb3e270c573`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:22:24.563906 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-1af28340-8108-467d-afc3-70a802d16215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:22:24.617761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1127/2271] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:22:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:22:24.629823 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927f280-0760-4d70-a49b-28c9e3ffbae9 service neutron] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:22:24.631414 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-0927f280-0760-4d70-a49b-28c9e3ffbae9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:22:24.646070 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927f280-0760-4d70-a49b-28c9e3ffbae9 service neutron] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:22:24.651918 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833b678-bfbe-4d31-853e-491c38a1184d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:22:24.652584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833b678-bfbe-4d31-853e-491c38a1184d service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:22:24.652871 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833b678-bfbe-4d31-853e-491c38a1184d service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:22:24.653146 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833b678-bfbe-4d31-853e-491c38a1184d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:22:24.654909 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-0833b678-bfbe-4d31-853e-491c38a1184d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:22:24.666235 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833b678-bfbe-4d31-853e-491c38a1184d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:22:24.667850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833b678-bfbe-4d31-853e-491c38a1184d service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:22:24.677242 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1145/2272] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:22:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:22:30.755500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af28340-8108-467d-afc3-70a802d16215 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:22:30.765100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af28340-8108-467d-afc3-70a802d16215 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:22:30.768874 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77f8e3-0521-4ca1-af6b-35bef484fcfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:22:30.769474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77f8e3-0521-4ca1-af6b-35bef484fcfc service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:22:30.769756 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77f8e3-0521-4ca1-af6b-35bef484fcfc service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:22:30.770033 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77f8e3-0521-4ca1-af6b-35bef484fcfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:22:30.771808 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-aa77f8e3-0521-4ca1-af6b-35bef484fcfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:22:30.830787 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833b678-bfbe-4d31-853e-491c38a1184d service nova] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:22:30.832380 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77f8e3-0521-4ca1-af6b-35bef484fcfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:22:30.834868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77f8e3-0521-4ca1-af6b-35bef484fcfc service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:22:30.843523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833b678-bfbe-4d31-853e-491c38a1184d service nova] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:22:30.847202 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1128/2273] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:22:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:22:30.874475 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206787e3-6af5-477e-a874-952feb7f57bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:22:30.874475 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206787e3-6af5-477e-a874-952feb7f57bf service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:22:30.874475 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206787e3-6af5-477e-a874-952feb7f57bf service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:22:30.874475 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206787e3-6af5-477e-a874-952feb7f57bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:22:30.882842 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206787e3-6af5-477e-a874-952feb7f57bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:22:30.884817 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206787e3-6af5-477e-a874-952feb7f57bf service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:22:30.896567 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1146/2274] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:22:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:22:38.953562 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d1478-98ca-4547-9589-618db7e58d5a None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:22:38.954056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d1478-98ca-4547-9589-618db7e58d5a None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:22:38.954160 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d1478-98ca-4547-9589-618db7e58d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:22:38.973202 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-a45d1478-98ca-4547-9589-618db7e58d5a None None] MFA Rules not processed for user `6c5865eae95b490b8e421153873457bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:22:38.974526 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a45d1478-98ca-4547-9589-618db7e58d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:22:38.981310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1129/2275] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:22:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:22:39.297084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206787e3-6af5-477e-a874-952feb7f57bf service nova] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:22:39.306473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206787e3-6af5-477e-a874-952feb7f57bf service nova] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:22:39.310307 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc78ca1-efa2-448c-9553-8a51849d28d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:22:39.310951 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc78ca1-efa2-448c-9553-8a51849d28d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:22:39.311298 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc78ca1-efa2-448c-9553-8a51849d28d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:22:39.311579 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc78ca1-efa2-448c-9553-8a51849d28d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:22:39.313262 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-dcc78ca1-efa2-448c-9553-8a51849d28d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:22:39.322806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc78ca1-efa2-448c-9553-8a51849d28d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:22:39.324233 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc78ca1-efa2-448c-9553-8a51849d28d9 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:22:39.333691 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1147/2276] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:22:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:22:39.791890 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d1478-98ca-4547-9589-618db7e58d5a None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:22:39.793353 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a45d1478-98ca-4547-9589-618db7e58d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:22:39.863802 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d1478-98ca-4547-9589-618db7e58d5a None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:22:39.868795 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6df135-c9a2-4758-9066-831ab4b42970 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e92560dd9da4c7cbcac5a84bcaca483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:22:39.869405 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6df135-c9a2-4758-9066-831ab4b42970 service placement] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:22:39.869689 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6df135-c9a2-4758-9066-831ab4b42970 service placement] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:22:39.869964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6df135-c9a2-4758-9066-831ab4b42970 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:22:39.871716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-8d6df135-c9a2-4758-9066-831ab4b42970 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:22:39.883388 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6df135-c9a2-4758-9066-831ab4b42970 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:22:39.884973 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6df135-c9a2-4758-9066-831ab4b42970 service placement] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:22:39.895293 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1130/2277] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:22:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:22:42.358312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc78ca1-efa2-448c-9553-8a51849d28d9 service neutron] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:22:42.360273 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-dcc78ca1-efa2-448c-9553-8a51849d28d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:22:42.372267 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc78ca1-efa2-448c-9553-8a51849d28d9 service neutron] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:22:42.376675 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdbcbd5-23c2-4f29-9cda-587aea94c258 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:22:42.377603 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbcbd5-23c2-4f29-9cda-587aea94c258 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:22:42.378105 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbcbd5-23c2-4f29-9cda-587aea94c258 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:22:42.378629 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbcbd5-23c2-4f29-9cda-587aea94c258 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:22:42.380688 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-5fdbcbd5-23c2-4f29-9cda-587aea94c258 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:22:42.395056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdbcbd5-23c2-4f29-9cda-587aea94c258 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:22:42.397958 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdbcbd5-23c2-4f29-9cda-587aea94c258 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:22:42.416509 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1148/2278] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:22:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:22:49.890708 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=94 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:22:52.407286 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=56 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:22:55.595463 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6df135-c9a2-4758-9066-831ab4b42970 service placement] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:22:55.608339 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6df135-c9a2-4758-9066-831ab4b42970 service placement] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:22:55.614805 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8228a-5769-4767-aa7b-63382198f95d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:22:55.615650 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8228a-5769-4767-aa7b-63382198f95d service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:22:55.616089 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8228a-5769-4767-aa7b-63382198f95d service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:22:55.616375 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8228a-5769-4767-aa7b-63382198f95d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:22:55.618372 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-f1a8228a-5769-4767-aa7b-63382198f95d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:22:55.632445 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8228a-5769-4767-aa7b-63382198f95d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:22:55.634107 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8228a-5769-4767-aa7b-63382198f95d service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:22:55.646322 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1131/2279] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:22:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:22:59.976405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdbcbd5-23c2-4f29-9cda-587aea94c258 service neutron] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:22:59.977838 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-5fdbcbd5-23c2-4f29-9cda-587aea94c258 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:00.034881 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdbcbd5-23c2-4f29-9cda-587aea94c258 service neutron] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:00.038517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870cc24-73b0-4dd3-b818-d7b702abee20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:00.039126 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870cc24-73b0-4dd3-b818-d7b702abee20 service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:00.039403 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870cc24-73b0-4dd3-b818-d7b702abee20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:00.039675 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870cc24-73b0-4dd3-b818-d7b702abee20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:00.041359 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-d870cc24-73b0-4dd3-b818-d7b702abee20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:00.052827 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870cc24-73b0-4dd3-b818-d7b702abee20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:00.054325 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870cc24-73b0-4dd3-b818-d7b702abee20 service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:00.063624 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1149/2280] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:22:59 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:23:05.640809 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=6 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:10.059554 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=26 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:16.539793 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8228a-5769-4767-aa7b-63382198f95d service nova] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:16.551983 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8228a-5769-4767-aa7b-63382198f95d service nova] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:16.558249 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd12e04-b5d7-4275-b695-555890cce37c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:16.558893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd12e04-b5d7-4275-b695-555890cce37c service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:16.559178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd12e04-b5d7-4275-b695-555890cce37c service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:16.559454 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd12e04-b5d7-4275-b695-555890cce37c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:16.561244 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-dfd12e04-b5d7-4275-b695-555890cce37c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:16.574667 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd12e04-b5d7-4275-b695-555890cce37c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:16.576608 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd12e04-b5d7-4275-b695-555890cce37c service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:16.587157 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1132/2281] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:23:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:23:22.761764 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870cc24-73b0-4dd3-b818-d7b702abee20 service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:22.771962 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870cc24-73b0-4dd3-b818-d7b702abee20 service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:22.775607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee3fe6-d9cd-4046-8872-fe5ff76fc74a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:22.776201 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee3fe6-d9cd-4046-8872-fe5ff76fc74a service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:22.776478 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee3fe6-d9cd-4046-8872-fe5ff76fc74a service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:22.776750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee3fe6-d9cd-4046-8872-fe5ff76fc74a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:22.778509 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-9cee3fe6-d9cd-4046-8872-fe5ff76fc74a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:22.847574 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee3fe6-d9cd-4046-8872-fe5ff76fc74a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:22.849042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee3fe6-d9cd-4046-8872-fe5ff76fc74a service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:22.858743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1150/2282] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:23:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:23:26.582709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=6 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:26.681793 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc212b9-c1c8-40b8-91e2-1d10dc8e34f7 None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:26.682156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc212b9-c1c8-40b8-91e2-1d10dc8e34f7 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:26.682525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc212b9-c1c8-40b8-91e2-1d10dc8e34f7 None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:26.684246 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1133/2283] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 23 08:23:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:23:26.689197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45bcdd-d8dd-4ab5-9974-8e1da84f4049 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:26.690271 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45bcdd-d8dd-4ab5-9974-8e1da84f4049 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:26.690408 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45bcdd-d8dd-4ab5-9974-8e1da84f4049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:26.710854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-ca45bcdd-d8dd-4ab5-9974-8e1da84f4049 None None] MFA Rules not processed for user `8e92560dd9da4c7cbcac5a84bcaca483`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:23:26.712059 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-ca45bcdd-d8dd-4ab5-9974-8e1da84f4049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:26.720612 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1151/2284] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 23 08:23:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:23:26.736068 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc212b9-c1c8-40b8-91e2-1d10dc8e34f7 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:26.750069 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc212b9-c1c8-40b8-91e2-1d10dc8e34f7 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:26.755709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b4427-460b-42b0-8f20-86d17e3f368f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e92560dd9da4c7cbcac5a84bcaca483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:26.756296 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b4427-460b-42b0-8f20-86d17e3f368f service placement] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:26.756598 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b4427-460b-42b0-8f20-86d17e3f368f service placement] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:26.756870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b4427-460b-42b0-8f20-86d17e3f368f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:26.765050 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b4427-460b-42b0-8f20-86d17e3f368f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:26.766653 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b4427-460b-42b0-8f20-86d17e3f368f service placement] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:26.776673 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1134/2285] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:23:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:23:26.825293 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45bcdd-d8dd-4ab5-9974-8e1da84f4049 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:26.826828 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-ca45bcdd-d8dd-4ab5-9974-8e1da84f4049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:26.842813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45bcdd-d8dd-4ab5-9974-8e1da84f4049 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:26.847606 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f51bd-fc6d-44f4-9a90-22326e9a6bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:26.848228 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f51bd-fc6d-44f4-9a90-22326e9a6bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:26.848511 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f51bd-fc6d-44f4-9a90-22326e9a6bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:26.848783 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f51bd-fc6d-44f4-9a90-22326e9a6bfd admin admin] PATH_INFO: `/v3/users/8926315ca58e466ba6ce873f4833f06b` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:26.849910 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f51bd-fc6d-44f4-9a90-22326e9a6bfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8926315ca58e466ba6ce873f4833f06b)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:26.851865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f51bd-fc6d-44f4-9a90-22326e9a6bfd admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:27.030844 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-239f51bd-fc6d-44f4-9a90-22326e9a6bfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8926315ca58e466ba6ce873f4833f06b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:27.031513 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-239f51bd-fc6d-44f4-9a90-22326e9a6bfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8926315ca58e466ba6ce873f4833f06b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:27.032128 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-239f51bd-fc6d-44f4-9a90-22326e9a6bfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8926315ca58e466ba6ce873f4833f06b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:27.125944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-239f51bd-fc6d-44f4-9a90-22326e9a6bfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8926315ca58e466ba6ce873f4833f06b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:27.139564 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-239f51bd-fc6d-44f4-9a90-22326e9a6bfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8926315ca58e466ba6ce873f4833f06b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:27.151678 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1152/2286] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:23:26 2022] DELETE /identity/v3/users/8926315ca58e466ba6ce873f4833f06b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:23:27.373196 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b4427-460b-42b0-8f20-86d17e3f368f service placement] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:27.385469 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b4427-460b-42b0-8f20-86d17e3f368f service placement] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:27.443925 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f3a06-c34a-4b54-8c4f-8b64c803e19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:27.444549 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f3a06-c34a-4b54-8c4f-8b64c803e19a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:27.444828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f3a06-c34a-4b54-8c4f-8b64c803e19a admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:27.445105 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f3a06-c34a-4b54-8c4f-8b64c803e19a admin admin] PATH_INFO: `/v3/projects/06caa62599e941d98d4c08605d50e6fe` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:27.446220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f3a06-c34a-4b54-8c4f-8b64c803e19a admin admin] RBAC: Authorizing `identity:delete_project(project_id=06caa62599e941d98d4c08605d50e6fe)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:27.448168 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f3a06-c34a-4b54-8c4f-8b64c803e19a admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:27.569293 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-d87f3a06-c34a-4b54-8c4f-8b64c803e19a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06caa62599e941d98d4c08605d50e6fe', 'request_id': 'req-d87f3a06-c34a-4b54-8c4f-8b64c803e19a'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:27.575040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-d87f3a06-c34a-4b54-8c4f-8b64c803e19a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06caa62599e941d98d4c08605d50e6fe', 'request_id': 'req-d87f3a06-c34a-4b54-8c4f-8b64c803e19a'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:27.581586 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-d87f3a06-c34a-4b54-8c4f-8b64c803e19a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06caa62599e941d98d4c08605d50e6fe', 'request_id': 'req-d87f3a06-c34a-4b54-8c4f-8b64c803e19a'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:27.691311 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-d87f3a06-c34a-4b54-8c4f-8b64c803e19a admin admin] The token cache is being invalidate because project 06caa62599e941d98d4c08605d50e6fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:23:27.691919 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-d87f3a06-c34a-4b54-8c4f-8b64c803e19a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:27.692225 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-d87f3a06-c34a-4b54-8c4f-8b64c803e19a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:27.693736 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1135/2287] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:23:27 2022] DELETE /identity/v3/projects/06caa62599e941d98d4c08605d50e6fe => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:23:27.699096 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df0b73-2f4f-4e17-899b-edffbfff0840 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:27.699545 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df0b73-2f4f-4e17-899b-edffbfff0840 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:27.699655 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df0b73-2f4f-4e17-899b-edffbfff0840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:27.720352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-06df0b73-2f4f-4e17-899b-edffbfff0840 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:23:27.722219 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-06df0b73-2f4f-4e17-899b-edffbfff0840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:27.771934 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:27.780099 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1153/2288] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:23:27.788968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9689beb-f693-41d7-89d0-3d8c434977d6 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:27.789256 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9689beb-f693-41d7-89d0-3d8c434977d6 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:27.789534 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9689beb-f693-41d7-89d0-3d8c434977d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:27.808800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-a9689beb-f693-41d7-89d0-3d8c434977d6 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:23:27.810017 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a9689beb-f693-41d7-89d0-3d8c434977d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:27.819271 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1136/2289] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:23:27.823790 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df0b73-2f4f-4e17-899b-edffbfff0840 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:27.833966 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df0b73-2f4f-4e17-899b-edffbfff0840 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:27.838501 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9355f-8a23-4750-aa54-6036dc68798f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:27.839094 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9355f-8a23-4750-aa54-6036dc68798f admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:27.839374 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9355f-8a23-4750-aa54-6036dc68798f admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:27.839646 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9355f-8a23-4750-aa54-6036dc68798f admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:27.840287 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9355f-8a23-4750-aa54-6036dc68798f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:23:27.840591 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9355f-8a23-4750-aa54-6036dc68798f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:27.842185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9355f-8a23-4750-aa54-6036dc68798f admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:27.854326 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1154/2290] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:23:27.858749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9689beb-f693-41d7-89d0-3d8c434977d6 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:27.867996 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9689beb-f693-41d7-89d0-3d8c434977d6 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:27.872679 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba57d1-5fb6-43e1-86c0-69edea68598e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:27.873271 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba57d1-5fb6-43e1-86c0-69edea68598e admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:27.873556 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba57d1-5fb6-43e1-86c0-69edea68598e admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:27.873827 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba57d1-5fb6-43e1-86c0-69edea68598e admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:27.874472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba57d1-5fb6-43e1-86c0-69edea68598e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:27.876403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba57d1-5fb6-43e1-86c0-69edea68598e admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:27.979262 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1137/2291] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:23:27 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:23:27.983514 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9355f-8a23-4750-aa54-6036dc68798f admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:27.993413 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9355f-8a23-4750-aa54-6036dc68798f admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:28.048595 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df554abb-462c-4930-a873-ee417ebe1f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:28.049444 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df554abb-462c-4930-a873-ee417ebe1f38 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:28.049739 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df554abb-462c-4930-a873-ee417ebe1f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:28.049990 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df554abb-462c-4930-a873-ee417ebe1f38 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:28.050696 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df554abb-462c-4930-a873-ee417ebe1f38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:28.052611 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df554abb-462c-4930-a873-ee417ebe1f38 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:28.139254 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1155/2292] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:23:27 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:23:28.143923 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba57d1-5fb6-43e1-86c0-69edea68598e admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:28.154496 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba57d1-5fb6-43e1-86c0-69edea68598e admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:28.159287 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735475e-cdb8-43c1-9578-e268f0320b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:28.159878 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735475e-cdb8-43c1-9578-e268f0320b5d admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:28.160207 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735475e-cdb8-43c1-9578-e268f0320b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:28.160483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735475e-cdb8-43c1-9578-e268f0320b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:28.161170 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735475e-cdb8-43c1-9578-e268f0320b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:28.162790 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735475e-cdb8-43c1-9578-e268f0320b5d admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:28.172643 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1138/2293] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:23:28.176811 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df554abb-462c-4930-a873-ee417ebe1f38 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:28.187105 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df554abb-462c-4930-a873-ee417ebe1f38 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:28.192190 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432608eb-34b1-4484-a70e-783be8524391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:28.192786 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432608eb-34b1-4484-a70e-783be8524391 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:28.193068 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432608eb-34b1-4484-a70e-783be8524391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:28.193345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432608eb-34b1-4484-a70e-783be8524391 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:28.193981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432608eb-34b1-4484-a70e-783be8524391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:28.195654 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432608eb-34b1-4484-a70e-783be8524391 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:28.206925 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1156/2294] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:23:28.211181 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735475e-cdb8-43c1-9578-e268f0320b5d admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:28.221285 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735475e-cdb8-43c1-9578-e268f0320b5d admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:28.225865 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da969a1-55f1-4dc7-a078-c0351a0df275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:28.226536 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da969a1-55f1-4dc7-a078-c0351a0df275 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:28.226821 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da969a1-55f1-4dc7-a078-c0351a0df275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:28.227098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da969a1-55f1-4dc7-a078-c0351a0df275 admin admin] PATH_INFO: `/v3/projects/1bf9df93445e4604b26834cb404de5ab/users/b91e4063443746bb94bea9c1a3f827c9/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:28.241240 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da969a1-55f1-4dc7-a078-c0351a0df275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bf9df93445e4604b26834cb404de5ab, user_id=b91e4063443746bb94bea9c1a3f827c9, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:28.243988 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da969a1-55f1-4dc7-a078-c0351a0df275 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:28.308490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1139/2295] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:23:28 2022] PUT /identity/v3/projects/1bf9df93445e4604b26834cb404de5ab/users/b91e4063443746bb94bea9c1a3f827c9/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:23:28.318977 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fadb9-c5ed-4f09-b6e9-61cff95701db None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:28.319266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fadb9-c5ed-4f09-b6e9-61cff95701db None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:28.319541 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fadb9-c5ed-4f09-b6e9-61cff95701db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:28.347346 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-9e6fadb9-c5ed-4f09-b6e9-61cff95701db None None] MFA Rules not processed for user `b91e4063443746bb94bea9c1a3f827c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:23:28.348559 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-9e6fadb9-c5ed-4f09-b6e9-61cff95701db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:28.411189 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1157/2296] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:23:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:23:28.422420 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da969a1-55f1-4dc7-a078-c0351a0df275 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:28.424177 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-0da969a1-55f1-4dc7-a078-c0351a0df275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:28.438624 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:28.496672 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da969a1-55f1-4dc7-a078-c0351a0df275 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:28.503361 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cccc9a-cc87-4880-ade9-8ec9da625df6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:28.503962 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cccc9a-cc87-4880-ade9-8ec9da625df6 service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:28.504243 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cccc9a-cc87-4880-ade9-8ec9da625df6 service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:28.504517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cccc9a-cc87-4880-ade9-8ec9da625df6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:28.512048 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cccc9a-cc87-4880-ade9-8ec9da625df6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:28.514195 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cccc9a-cc87-4880-ade9-8ec9da625df6 service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:28.522187 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1140/2297] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:23:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:23:31.700204 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fadb9-c5ed-4f09-b6e9-61cff95701db None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:31.756020 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:31.804768 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fadb9-c5ed-4f09-b6e9-61cff95701db None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:31.809823 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce2c02-b024-42e0-872c-04f50c7a3bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:31.810491 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce2c02-b024-42e0-872c-04f50c7a3bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:31.810776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce2c02-b024-42e0-872c-04f50c7a3bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:31.811055 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce2c02-b024-42e0-872c-04f50c7a3bbd admin admin] PATH_INFO: `/v3/users/b91e4063443746bb94bea9c1a3f827c9` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:31.812259 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce2c02-b024-42e0-872c-04f50c7a3bbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b91e4063443746bb94bea9c1a3f827c9)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:31.814218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce2c02-b024-42e0-872c-04f50c7a3bbd admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:32.043406 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-fcce2c02-b024-42e0-872c-04f50c7a3bbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b91e4063443746bb94bea9c1a3f827c9'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:32.044056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-fcce2c02-b024-42e0-872c-04f50c7a3bbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b91e4063443746bb94bea9c1a3f827c9'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:32.044671 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-fcce2c02-b024-42e0-872c-04f50c7a3bbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b91e4063443746bb94bea9c1a3f827c9'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:32.133285 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-fcce2c02-b024-42e0-872c-04f50c7a3bbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b91e4063443746bb94bea9c1a3f827c9'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:32.146182 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-fcce2c02-b024-42e0-872c-04f50c7a3bbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b91e4063443746bb94bea9c1a3f827c9'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:32.158766 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1158/2298] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:23:31 2022] DELETE /identity/v3/users/b91e4063443746bb94bea9c1a3f827c9 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:23:32.163331 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031617a-903d-4122-94c7-b06cfc4f1098 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:32.163828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031617a-903d-4122-94c7-b06cfc4f1098 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:32.164037 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031617a-903d-4122-94c7-b06cfc4f1098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:32.212833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-2031617a-903d-4122-94c7-b06cfc4f1098 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:23:32.214052 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-2031617a-903d-4122-94c7-b06cfc4f1098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:32.270919 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1141/2299] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:23:32.280598 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce2c02-b024-42e0-872c-04f50c7a3bbd admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:32.281998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-fcce2c02-b024-42e0-872c-04f50c7a3bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:32.376402 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce2c02-b024-42e0-872c-04f50c7a3bbd admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:32.380727 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5b37b-ce91-45dc-b535-09b4eb3336cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:32.381329 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5b37b-ce91-45dc-b535-09b4eb3336cd service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:32.381607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5b37b-ce91-45dc-b535-09b4eb3336cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:32.381878 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5b37b-ce91-45dc-b535-09b4eb3336cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:32.391113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5b37b-ce91-45dc-b535-09b4eb3336cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:32.392804 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5b37b-ce91-45dc-b535-09b4eb3336cd service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:32.397966 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:32.402599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1159/2300] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:23:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:23:32.795602 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031617a-903d-4122-94c7-b06cfc4f1098 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:32.797075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-2031617a-903d-4122-94c7-b06cfc4f1098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:32.809784 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031617a-903d-4122-94c7-b06cfc4f1098 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:32.814309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf884d3-7a62-4744-accc-8be4c087d053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:32.815173 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf884d3-7a62-4744-accc-8be4c087d053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:32.815454 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf884d3-7a62-4744-accc-8be4c087d053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:32.815724 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf884d3-7a62-4744-accc-8be4c087d053 admin admin] PATH_INFO: `/v3/projects/1bf9df93445e4604b26834cb404de5ab` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:32.816834 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf884d3-7a62-4744-accc-8be4c087d053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bf9df93445e4604b26834cb404de5ab)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:32.819036 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf884d3-7a62-4744-accc-8be4c087d053 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:32.911632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-eaf884d3-7a62-4744-accc-8be4c087d053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bf9df93445e4604b26834cb404de5ab', 'request_id': 'req-eaf884d3-7a62-4744-accc-8be4c087d053'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:32.917108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-eaf884d3-7a62-4744-accc-8be4c087d053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bf9df93445e4604b26834cb404de5ab', 'request_id': 'req-eaf884d3-7a62-4744-accc-8be4c087d053'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:32.923216 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-eaf884d3-7a62-4744-accc-8be4c087d053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bf9df93445e4604b26834cb404de5ab', 'request_id': 'req-eaf884d3-7a62-4744-accc-8be4c087d053'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:32.927992 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:32.981385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-eaf884d3-7a62-4744-accc-8be4c087d053 admin admin] The token cache is being invalidate because project 1bf9df93445e4604b26834cb404de5ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:23:32.981677 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-eaf884d3-7a62-4744-accc-8be4c087d053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:32.982431 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-eaf884d3-7a62-4744-accc-8be4c087d053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:32.985861 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1142/2301] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:23:32 2022] DELETE /identity/v3/projects/1bf9df93445e4604b26834cb404de5ab => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:23:32.989005 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee503bea-fa7a-4b68-ac63-df23f9063f88 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:32.989450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee503bea-fa7a-4b68-ac63-df23f9063f88 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:32.989559 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee503bea-fa7a-4b68-ac63-df23f9063f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:33.038686 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-ee503bea-fa7a-4b68-ac63-df23f9063f88 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:23:33.039887 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-ee503bea-fa7a-4b68-ac63-df23f9063f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:33.098895 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1160/2302] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:23:33.108001 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fbb1a-47ca-4f24-90bd-00d933540868 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:33.108284 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fbb1a-47ca-4f24-90bd-00d933540868 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:33.108554 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fbb1a-47ca-4f24-90bd-00d933540868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:33.127978 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-694fbb1a-47ca-4f24-90bd-00d933540868 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:23:33.129283 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-694fbb1a-47ca-4f24-90bd-00d933540868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:33.137064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1143/2303] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:23:33.141247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee503bea-fa7a-4b68-ac63-df23f9063f88 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:33.151590 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee503bea-fa7a-4b68-ac63-df23f9063f88 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:33.156083 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c5a98-b5b1-453d-b124-339acc1ab3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:33.156670 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c5a98-b5b1-453d-b124-339acc1ab3ed admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:33.156948 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c5a98-b5b1-453d-b124-339acc1ab3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:33.157217 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c5a98-b5b1-453d-b124-339acc1ab3ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:33.157850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c5a98-b5b1-453d-b124-339acc1ab3ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:23:33.158148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c5a98-b5b1-453d-b124-339acc1ab3ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:33.160382 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c5a98-b5b1-453d-b124-339acc1ab3ed admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:33.171907 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1161/2304] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:23:33.176069 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fbb1a-47ca-4f24-90bd-00d933540868 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:33.185294 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fbb1a-47ca-4f24-90bd-00d933540868 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:33.189894 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac061a7-85e6-47af-a603-3af3d3b69aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:33.190513 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac061a7-85e6-47af-a603-3af3d3b69aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:33.190792 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac061a7-85e6-47af-a603-3af3d3b69aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:33.191089 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac061a7-85e6-47af-a603-3af3d3b69aa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:33.191700 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac061a7-85e6-47af-a603-3af3d3b69aa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:33.193580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac061a7-85e6-47af-a603-3af3d3b69aa6 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:33.287758 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1144/2305] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:23:33 2022] POST /identity/v3/projects => generated 405 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:23:33.291258 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c5a98-b5b1-453d-b124-339acc1ab3ed admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:33.301377 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c5a98-b5b1-453d-b124-339acc1ab3ed admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:33.357752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc37fa2-0176-41b5-95e7-36c5e057a46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:33.358382 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc37fa2-0176-41b5-95e7-36c5e057a46f admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:33.358665 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc37fa2-0176-41b5-95e7-36c5e057a46f admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:33.358939 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc37fa2-0176-41b5-95e7-36c5e057a46f admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:33.359550 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc37fa2-0176-41b5-95e7-36c5e057a46f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:33.361470 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc37fa2-0176-41b5-95e7-36c5e057a46f admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:33.434533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1162/2306] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:23:33 2022] POST /identity/v3/users => generated 303 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:23:33.438362 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac061a7-85e6-47af-a603-3af3d3b69aa6 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:33.449334 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac061a7-85e6-47af-a603-3af3d3b69aa6 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:33.453953 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbb85b-fbe1-4c41-bf9d-3b44a88a0fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:33.454584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbb85b-fbe1-4c41-bf9d-3b44a88a0fff admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:33.454866 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbb85b-fbe1-4c41-bf9d-3b44a88a0fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:33.455138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbb85b-fbe1-4c41-bf9d-3b44a88a0fff admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:33.455776 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbb85b-fbe1-4c41-bf9d-3b44a88a0fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:33.458079 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbb85b-fbe1-4c41-bf9d-3b44a88a0fff admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:33.467997 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1145/2307] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:23:33.471869 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc37fa2-0176-41b5-95e7-36c5e057a46f admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:33.481867 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc37fa2-0176-41b5-95e7-36c5e057a46f admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:33.486546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af38d9-abde-4262-88a1-12acab01a87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:33.487196 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af38d9-abde-4262-88a1-12acab01a87f admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:33.487490 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af38d9-abde-4262-88a1-12acab01a87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:33.487774 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af38d9-abde-4262-88a1-12acab01a87f admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:33.488428 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af38d9-abde-4262-88a1-12acab01a87f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:33.490135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af38d9-abde-4262-88a1-12acab01a87f admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:33.501057 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1163/2308] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:23:33.506216 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbb85b-fbe1-4c41-bf9d-3b44a88a0fff admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:33.516143 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbb85b-fbe1-4c41-bf9d-3b44a88a0fff admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:33.521295 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121f7e7-1038-4a6e-963e-b909a247111b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:33.521936 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121f7e7-1038-4a6e-963e-b909a247111b admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:33.522216 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121f7e7-1038-4a6e-963e-b909a247111b admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:33.522522 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121f7e7-1038-4a6e-963e-b909a247111b admin admin] PATH_INFO: `/v3/projects/9bdb1c770ba54713adb85d3a1c1588d5/users/43248c7e58c84c129fb57eb8e0b33fec/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:33.537781 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121f7e7-1038-4a6e-963e-b909a247111b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bdb1c770ba54713adb85d3a1c1588d5, user_id=43248c7e58c84c129fb57eb8e0b33fec, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:33.540439 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121f7e7-1038-4a6e-963e-b909a247111b admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:33.602075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1146/2309] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:23:33 2022] PUT /identity/v3/projects/9bdb1c770ba54713adb85d3a1c1588d5/users/43248c7e58c84c129fb57eb8e0b33fec/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:23:33.607194 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c17a24-6e00-49a2-b2c7-04afa6c8f5bd None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:33.607481 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c17a24-6e00-49a2-b2c7-04afa6c8f5bd None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:33.607754 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c17a24-6e00-49a2-b2c7-04afa6c8f5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:33.626350 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-99c17a24-6e00-49a2-b2c7-04afa6c8f5bd None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:23:33.627550 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-99c17a24-6e00-49a2-b2c7-04afa6c8f5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:33.666403 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:33.690489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1164/2310] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:23:33.699527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121f7e7-1038-4a6e-963e-b909a247111b admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:33.701242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-8121f7e7-1038-4a6e-963e-b909a247111b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:33.757863 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121f7e7-1038-4a6e-963e-b909a247111b admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:33.761497 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540b49d-a777-451b-b6f5-f198247a3668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:33.762095 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540b49d-a777-451b-b6f5-f198247a3668 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:33.762403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540b49d-a777-451b-b6f5-f198247a3668 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:33.762680 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540b49d-a777-451b-b6f5-f198247a3668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:33.771432 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540b49d-a777-451b-b6f5-f198247a3668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:33.772886 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540b49d-a777-451b-b6f5-f198247a3668 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:33.782258 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1147/2311] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:23:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:23:34.967302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a74a6-7c47-426c-9dfe-6f24f655c873 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:34.967838 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a74a6-7c47-426c-9dfe-6f24f655c873 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:34.968681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a74a6-7c47-426c-9dfe-6f24f655c873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:34.997750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-586a74a6-7c47-426c-9dfe-6f24f655c873 None None] MFA Rules not processed for user `43248c7e58c84c129fb57eb8e0b33fec`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:23:34.999000 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-586a74a6-7c47-426c-9dfe-6f24f655c873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:35.071308 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1165/2312] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:23:34 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:23:35.075882 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540b49d-a777-451b-b6f5-f198247a3668 service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:35.086850 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540b49d-a777-451b-b6f5-f198247a3668 service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:35.091431 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de797afe-cd4f-48df-a64b-6c4ba1648006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:35.092026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de797afe-cd4f-48df-a64b-6c4ba1648006 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:35.092303 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de797afe-cd4f-48df-a64b-6c4ba1648006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:35.092625 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de797afe-cd4f-48df-a64b-6c4ba1648006 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:35.093365 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de797afe-cd4f-48df-a64b-6c4ba1648006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:35.095388 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de797afe-cd4f-48df-a64b-6c4ba1648006 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:35.184402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1148/2313] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:23:35 2022] POST /identity/v3/projects => generated 405 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:23:35.188469 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a74a6-7c47-426c-9dfe-6f24f655c873 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:35.200324 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a74a6-7c47-426c-9dfe-6f24f655c873 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:35.256260 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59cd3a-80f8-4aae-8274-00b15466e867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:35.256871 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59cd3a-80f8-4aae-8274-00b15466e867 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:35.257157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59cd3a-80f8-4aae-8274-00b15466e867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:35.257436 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59cd3a-80f8-4aae-8274-00b15466e867 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:35.258060 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59cd3a-80f8-4aae-8274-00b15466e867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:35.260021 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59cd3a-80f8-4aae-8274-00b15466e867 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:35.342047 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1166/2314] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:23:35 2022] POST /identity/v3/users => generated 309 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:23:35.346039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de797afe-cd4f-48df-a64b-6c4ba1648006 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:35.356299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de797afe-cd4f-48df-a64b-6c4ba1648006 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:35.360748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f10ca1-11a5-4ae7-b733-b875f1712542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:35.361338 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f10ca1-11a5-4ae7-b733-b875f1712542 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:35.361615 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f10ca1-11a5-4ae7-b733-b875f1712542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:35.361884 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f10ca1-11a5-4ae7-b733-b875f1712542 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:35.362547 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f10ca1-11a5-4ae7-b733-b875f1712542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:35.364697 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f10ca1-11a5-4ae7-b733-b875f1712542 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:35.375052 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1149/2315] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:23:35.379707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59cd3a-80f8-4aae-8274-00b15466e867 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:35.389839 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59cd3a-80f8-4aae-8274-00b15466e867 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:35.394615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310df9e-9bdf-4494-ba8c-17411f7d4691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:35.395267 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310df9e-9bdf-4494-ba8c-17411f7d4691 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:35.395556 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310df9e-9bdf-4494-ba8c-17411f7d4691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:35.395844 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310df9e-9bdf-4494-ba8c-17411f7d4691 admin admin] PATH_INFO: `/v3/projects/7fb1ee73e8f04ebf8c00ec70733df0fb/users/6230f40e4dcb4a5db2b676096f4696e4/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:35.410624 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310df9e-9bdf-4494-ba8c-17411f7d4691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb1ee73e8f04ebf8c00ec70733df0fb, user_id=6230f40e4dcb4a5db2b676096f4696e4, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:35.413308 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310df9e-9bdf-4494-ba8c-17411f7d4691 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:35.531713 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1167/2316] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:23:35 2022] PUT /identity/v3/projects/7fb1ee73e8f04ebf8c00ec70733df0fb/users/6230f40e4dcb4a5db2b676096f4696e4/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:23:35.536116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f10ca1-11a5-4ae7-b733-b875f1712542 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:35.546041 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f10ca1-11a5-4ae7-b733-b875f1712542 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:35.594017 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:35.603356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0746772-dbdb-450b-b832-ce725f591672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:35.603957 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0746772-dbdb-450b-b832-ce725f591672 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:35.604230 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0746772-dbdb-450b-b832-ce725f591672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:35.604495 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0746772-dbdb-450b-b832-ce725f591672 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:35.605117 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0746772-dbdb-450b-b832-ce725f591672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:35.606737 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0746772-dbdb-450b-b832-ce725f591672 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:35.616807 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1150/2317] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:23:35.620991 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310df9e-9bdf-4494-ba8c-17411f7d4691 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:35.631294 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310df9e-9bdf-4494-ba8c-17411f7d4691 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:35.635898 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bd307-2d99-4d9b-b7a2-a042c28af4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:35.636534 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bd307-2d99-4d9b-b7a2-a042c28af4f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:35.636811 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bd307-2d99-4d9b-b7a2-a042c28af4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:35.637082 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bd307-2d99-4d9b-b7a2-a042c28af4f7 admin admin] PATH_INFO: `/v3/projects/7fb1ee73e8f04ebf8c00ec70733df0fb/users/6230f40e4dcb4a5db2b676096f4696e4/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:35.638966 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0bd307-2d99-4d9b-b7a2-a042c28af4f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb1ee73e8f04ebf8c00ec70733df0fb, user_id=6230f40e4dcb4a5db2b676096f4696e4, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:35.641631 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0bd307-2d99-4d9b-b7a2-a042c28af4f7 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:35.652675 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1168/2318] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:23:35 2022] PUT /identity/v3/projects/7fb1ee73e8f04ebf8c00ec70733df0fb/users/6230f40e4dcb4a5db2b676096f4696e4/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:23:36.823395 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb3d15-61ae-4381-9dce-8cbfd462acba None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:36.823839 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb3d15-61ae-4381-9dce-8cbfd462acba None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:36.823943 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb3d15-61ae-4381-9dce-8cbfd462acba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:36.852478 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-35eb3d15-61ae-4381-9dce-8cbfd462acba None None] MFA Rules not processed for user `6230f40e4dcb4a5db2b676096f4696e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:23:36.853729 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-35eb3d15-61ae-4381-9dce-8cbfd462acba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:36.930344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1151/2319] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:23:36 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:23:37.701543 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bd307-2d99-4d9b-b7a2-a042c28af4f7 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:37.709844 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-ff0bd307-2d99-4d9b-b7a2-a042c28af4f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:37.735723 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:37.778653 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bd307-2d99-4d9b-b7a2-a042c28af4f7 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:37.783855 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe6490-150e-4696-9110-74722e512161 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e92560dd9da4c7cbcac5a84bcaca483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:37.785146 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe6490-150e-4696-9110-74722e512161 service placement] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:37.785422 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe6490-150e-4696-9110-74722e512161 service placement] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:37.785693 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe6490-150e-4696-9110-74722e512161 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:37.787442 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-abbe6490-150e-4696-9110-74722e512161 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:37.798363 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe6490-150e-4696-9110-74722e512161 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:37.799950 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe6490-150e-4696-9110-74722e512161 service placement] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:37.809671 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1169/2320] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:23:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:23:38.577323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb3d15-61ae-4381-9dce-8cbfd462acba None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:38.639379 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb3d15-61ae-4381-9dce-8cbfd462acba None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:38.643842 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7a31b-cacc-41f8-a2dc-bf6657747df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:38.644466 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7a31b-cacc-41f8-a2dc-bf6657747df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:38.644743 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7a31b-cacc-41f8-a2dc-bf6657747df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:38.645013 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7a31b-cacc-41f8-a2dc-bf6657747df0 admin admin] PATH_INFO: `/v3/users/43248c7e58c84c129fb57eb8e0b33fec` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:38.646135 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7a31b-cacc-41f8-a2dc-bf6657747df0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43248c7e58c84c129fb57eb8e0b33fec)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:38.648082 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7a31b-cacc-41f8-a2dc-bf6657747df0 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:38.964837 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-4cc7a31b-cacc-41f8-a2dc-bf6657747df0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43248c7e58c84c129fb57eb8e0b33fec'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:38.966008 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-4cc7a31b-cacc-41f8-a2dc-bf6657747df0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43248c7e58c84c129fb57eb8e0b33fec'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:38.967083 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-4cc7a31b-cacc-41f8-a2dc-bf6657747df0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43248c7e58c84c129fb57eb8e0b33fec'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:39.052827 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-4cc7a31b-cacc-41f8-a2dc-bf6657747df0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43248c7e58c84c129fb57eb8e0b33fec'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:39.060788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-4cc7a31b-cacc-41f8-a2dc-bf6657747df0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43248c7e58c84c129fb57eb8e0b33fec'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:39.071042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:39.078460 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1152/2321] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:23:38 2022] DELETE /identity/v3/users/43248c7e58c84c129fb57eb8e0b33fec => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:23:39.339452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe6490-150e-4696-9110-74722e512161 service placement] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:39.354267 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe6490-150e-4696-9110-74722e512161 service placement] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:39.407271 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a057d0-4966-4240-bf55-48c835ff71bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:39.407892 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a057d0-4966-4240-bf55-48c835ff71bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:39.408169 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a057d0-4966-4240-bf55-48c835ff71bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:39.408438 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a057d0-4966-4240-bf55-48c835ff71bd admin admin] PATH_INFO: `/v3/projects/9bdb1c770ba54713adb85d3a1c1588d5` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:39.409553 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a057d0-4966-4240-bf55-48c835ff71bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bdb1c770ba54713adb85d3a1c1588d5)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:39.411496 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a057d0-4966-4240-bf55-48c835ff71bd admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:39.515778 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-42a057d0-4966-4240-bf55-48c835ff71bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bdb1c770ba54713adb85d3a1c1588d5', 'request_id': 'req-42a057d0-4966-4240-bf55-48c835ff71bd'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:39.522220 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-42a057d0-4966-4240-bf55-48c835ff71bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bdb1c770ba54713adb85d3a1c1588d5', 'request_id': 'req-42a057d0-4966-4240-bf55-48c835ff71bd'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:39.532238 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-42a057d0-4966-4240-bf55-48c835ff71bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bdb1c770ba54713adb85d3a1c1588d5', 'request_id': 'req-42a057d0-4966-4240-bf55-48c835ff71bd'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:39.619529 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-42a057d0-4966-4240-bf55-48c835ff71bd admin admin] The token cache is being invalidate because project 9bdb1c770ba54713adb85d3a1c1588d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:23:39.619980 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-42a057d0-4966-4240-bf55-48c835ff71bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:39.620723 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-42a057d0-4966-4240-bf55-48c835ff71bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:39.622227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1170/2322] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:23:39 2022] DELETE /identity/v3/projects/9bdb1c770ba54713adb85d3a1c1588d5 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:23:39.626416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7a31b-cacc-41f8-a2dc-bf6657747df0 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:39.631467 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-4cc7a31b-cacc-41f8-a2dc-bf6657747df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:39.641808 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7a31b-cacc-41f8-a2dc-bf6657747df0 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:39.698986 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba9cb8-b644-4d25-8d7e-1cab2ed55214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:39.699628 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba9cb8-b644-4d25-8d7e-1cab2ed55214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:39.699910 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba9cb8-b644-4d25-8d7e-1cab2ed55214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:39.700184 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba9cb8-b644-4d25-8d7e-1cab2ed55214 admin admin] PATH_INFO: `/v3/users/6230f40e4dcb4a5db2b676096f4696e4` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:39.701291 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba9cb8-b644-4d25-8d7e-1cab2ed55214 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6230f40e4dcb4a5db2b676096f4696e4)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:39.703322 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba9cb8-b644-4d25-8d7e-1cab2ed55214 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:39.899299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-21ba9cb8-b644-4d25-8d7e-1cab2ed55214 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6230f40e4dcb4a5db2b676096f4696e4'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:39.899953 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-21ba9cb8-b644-4d25-8d7e-1cab2ed55214 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6230f40e4dcb4a5db2b676096f4696e4'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:39.900562 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-21ba9cb8-b644-4d25-8d7e-1cab2ed55214 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6230f40e4dcb4a5db2b676096f4696e4'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:39.995885 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-21ba9cb8-b644-4d25-8d7e-1cab2ed55214 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6230f40e4dcb4a5db2b676096f4696e4'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:40.003935 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-21ba9cb8-b644-4d25-8d7e-1cab2ed55214 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6230f40e4dcb4a5db2b676096f4696e4'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:40.021241 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1153/2323] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:23:39 2022] DELETE /identity/v3/users/6230f40e4dcb4a5db2b676096f4696e4 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:23:40.237248 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a057d0-4966-4240-bf55-48c835ff71bd admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:40.239532 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-42a057d0-4966-4240-bf55-48c835ff71bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:40.252843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a057d0-4966-4240-bf55-48c835ff71bd admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:40.295686 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:40.311541 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b96c2-dcea-4aab-b95c-1ef960e61894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:40.317854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b96c2-dcea-4aab-b95c-1ef960e61894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:40.317854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b96c2-dcea-4aab-b95c-1ef960e61894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:40.317854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b96c2-dcea-4aab-b95c-1ef960e61894 admin admin] PATH_INFO: `/v3/projects/7fb1ee73e8f04ebf8c00ec70733df0fb` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:40.317854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b96c2-dcea-4aab-b95c-1ef960e61894 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fb1ee73e8f04ebf8c00ec70733df0fb)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:40.317854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b96c2-dcea-4aab-b95c-1ef960e61894 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:40.417712 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-5d3b96c2-dcea-4aab-b95c-1ef960e61894 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb1ee73e8f04ebf8c00ec70733df0fb', 'request_id': 'req-5d3b96c2-dcea-4aab-b95c-1ef960e61894'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:40.423804 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-5d3b96c2-dcea-4aab-b95c-1ef960e61894 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb1ee73e8f04ebf8c00ec70733df0fb', 'request_id': 'req-5d3b96c2-dcea-4aab-b95c-1ef960e61894'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:40.430466 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-5d3b96c2-dcea-4aab-b95c-1ef960e61894 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb1ee73e8f04ebf8c00ec70733df0fb', 'request_id': 'req-5d3b96c2-dcea-4aab-b95c-1ef960e61894'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:40.521072 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-5d3b96c2-dcea-4aab-b95c-1ef960e61894 admin admin] The token cache is being invalidate because project 7fb1ee73e8f04ebf8c00ec70733df0fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:23:40.521360 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-5d3b96c2-dcea-4aab-b95c-1ef960e61894 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:40.521976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-5d3b96c2-dcea-4aab-b95c-1ef960e61894 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:23:40.523521 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1171/2324] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:23:40 2022] DELETE /identity/v3/projects/7fb1ee73e8f04ebf8c00ec70733df0fb => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:23:40.528542 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629f535-de22-4676-99b8-963e09a0fc8a None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:40.528828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629f535-de22-4676-99b8-963e09a0fc8a None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:40.529969 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629f535-de22-4676-99b8-963e09a0fc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:40.549253 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-7629f535-de22-4676-99b8-963e09a0fc8a None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:23:40.550503 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-7629f535-de22-4676-99b8-963e09a0fc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:40.608475 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1154/2325] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:23:40.617374 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684f242-b289-4f99-8afc-856504360af5 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:40.617692 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684f242-b289-4f99-8afc-856504360af5 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:40.617959 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684f242-b289-4f99-8afc-856504360af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:40.637108 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-8684f242-b289-4f99-8afc-856504360af5 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:23:40.638311 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-8684f242-b289-4f99-8afc-856504360af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:40.647058 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1172/2326] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:23:40.653237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629f535-de22-4676-99b8-963e09a0fc8a None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:40.664404 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629f535-de22-4676-99b8-963e09a0fc8a None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:40.668991 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ce55f-f6e9-4366-b8ca-0b8d34d15789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:40.669525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ce55f-f6e9-4366-b8ca-0b8d34d15789 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:40.669804 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ce55f-f6e9-4366-b8ca-0b8d34d15789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:40.670105 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ce55f-f6e9-4366-b8ca-0b8d34d15789 admin admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:40.670776 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ce55f-f6e9-4366-b8ca-0b8d34d15789 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:23:40.671075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ce55f-f6e9-4366-b8ca-0b8d34d15789 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:40.672673 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ce55f-f6e9-4366-b8ca-0b8d34d15789 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:40.681607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:40.685083 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1155/2327] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:23:40.689402 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684f242-b289-4f99-8afc-856504360af5 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:40.698799 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684f242-b289-4f99-8afc-856504360af5 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:40.703678 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90329d-ccb1-4649-bd68-6aab1f59f563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:40.704270 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90329d-ccb1-4649-bd68-6aab1f59f563 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:40.704551 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90329d-ccb1-4649-bd68-6aab1f59f563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:40.704823 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90329d-ccb1-4649-bd68-6aab1f59f563 admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:40.705448 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90329d-ccb1-4649-bd68-6aab1f59f563 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:40.707945 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90329d-ccb1-4649-bd68-6aab1f59f563 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:40.820582 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1173/2328] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:23:40 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:23:40.824576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ce55f-f6e9-4366-b8ca-0b8d34d15789 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:40.835554 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ce55f-f6e9-4366-b8ca-0b8d34d15789 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:40.892847 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562667a0-bfe3-471e-b7f7-09a1e8b4539d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:40.893451 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562667a0-bfe3-471e-b7f7-09a1e8b4539d admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:40.894817 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562667a0-bfe3-471e-b7f7-09a1e8b4539d admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:40.895102 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562667a0-bfe3-471e-b7f7-09a1e8b4539d admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:40.895717 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562667a0-bfe3-471e-b7f7-09a1e8b4539d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:40.897636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562667a0-bfe3-471e-b7f7-09a1e8b4539d admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:41.008723 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1156/2329] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:23:40 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:23:41.013278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90329d-ccb1-4649-bd68-6aab1f59f563 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:41.024274 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90329d-ccb1-4649-bd68-6aab1f59f563 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:41.028869 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846b100-1157-4542-bc4c-ea173c0e47fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:41.029458 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846b100-1157-4542-bc4c-ea173c0e47fe admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:41.029737 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846b100-1157-4542-bc4c-ea173c0e47fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:41.030012 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846b100-1157-4542-bc4c-ea173c0e47fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:41.030673 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846b100-1157-4542-bc4c-ea173c0e47fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:41.032269 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846b100-1157-4542-bc4c-ea173c0e47fe admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:41.042366 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1174/2330] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:23:41.046150 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562667a0-bfe3-471e-b7f7-09a1e8b4539d admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:41.056067 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562667a0-bfe3-471e-b7f7-09a1e8b4539d admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:41.060961 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7867f4-f0b2-4402-9f92-dda2b373b873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:41.061547 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7867f4-f0b2-4402-9f92-dda2b373b873 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:41.061824 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7867f4-f0b2-4402-9f92-dda2b373b873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:41.062093 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7867f4-f0b2-4402-9f92-dda2b373b873 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:41.062796 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7867f4-f0b2-4402-9f92-dda2b373b873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:41.064387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7867f4-f0b2-4402-9f92-dda2b373b873 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:41.074754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1157/2331] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:23:41.078813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846b100-1157-4542-bc4c-ea173c0e47fe admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:41.089566 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846b100-1157-4542-bc4c-ea173c0e47fe admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:41.094074 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a46f15-da21-4fc2-b836-37c07c7b96cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:41.094742 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a46f15-da21-4fc2-b836-37c07c7b96cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:41.095025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a46f15-da21-4fc2-b836-37c07c7b96cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:41.095299 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a46f15-da21-4fc2-b836-37c07c7b96cb admin admin] PATH_INFO: `/v3/projects/5172b1938344487c839e2c87f6ba558b/users/0ea14e9cfa724383bf57fbf5577f6fa0/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:41.110452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a46f15-da21-4fc2-b836-37c07c7b96cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5172b1938344487c839e2c87f6ba558b, user_id=0ea14e9cfa724383bf57fbf5577f6fa0, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:41.114547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a46f15-da21-4fc2-b836-37c07c7b96cb admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:41.212922 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1175/2332] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:23:41 2022] PUT /identity/v3/projects/5172b1938344487c839e2c87f6ba558b/users/0ea14e9cfa724383bf57fbf5577f6fa0/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:23:41.223519 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd8ac8-cf4d-4f3c-826a-57242a4de2a5 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:41.223808 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd8ac8-cf4d-4f3c-826a-57242a4de2a5 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:41.224084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd8ac8-cf4d-4f3c-826a-57242a4de2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:41.252225 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-15cd8ac8-cf4d-4f3c-826a-57242a4de2a5 None None] MFA Rules not processed for user `0ea14e9cfa724383bf57fbf5577f6fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:23:41.254095 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-15cd8ac8-cf4d-4f3c-826a-57242a4de2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:41.323458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1158/2333] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:23:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:23:41.328143 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a46f15-da21-4fc2-b836-37c07c7b96cb admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:41.398820 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a46f15-da21-4fc2-b836-37c07c7b96cb admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:41.404534 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48a227-5dbd-4d58-bc0e-4b30aef09aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:41.405148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48a227-5dbd-4d58-bc0e-4b30aef09aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:41.405442 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48a227-5dbd-4d58-bc0e-4b30aef09aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:41.405817 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48a227-5dbd-4d58-bc0e-4b30aef09aa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:41.406492 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48a227-5dbd-4d58-bc0e-4b30aef09aa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:41.408662 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48a227-5dbd-4d58-bc0e-4b30aef09aa2 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:41.426009 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:41.506053 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1176/2334] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:23:41 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:23:41.509963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd8ac8-cf4d-4f3c-826a-57242a4de2a5 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:41.520758 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd8ac8-cf4d-4f3c-826a-57242a4de2a5 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:41.585280 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edd215-357f-4306-a5d5-61fe8192c58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:41.585804 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edd215-357f-4306-a5d5-61fe8192c58c admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:41.586080 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edd215-357f-4306-a5d5-61fe8192c58c admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:41.586380 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edd215-357f-4306-a5d5-61fe8192c58c admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:41.587005 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edd215-357f-4306-a5d5-61fe8192c58c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:41.594716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edd215-357f-4306-a5d5-61fe8192c58c admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:41.674006 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:41.680501 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1159/2335] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:23:41 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:23:41.684892 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48a227-5dbd-4d58-bc0e-4b30aef09aa2 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:41.695947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48a227-5dbd-4d58-bc0e-4b30aef09aa2 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:41.700589 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e9009-5c79-455f-97fd-5816f705cebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:41.701185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e9009-5c79-455f-97fd-5816f705cebf admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:41.701461 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e9009-5c79-455f-97fd-5816f705cebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:41.701730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e9009-5c79-455f-97fd-5816f705cebf admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:41.702392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e9009-5c79-455f-97fd-5816f705cebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:41.703992 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e9009-5c79-455f-97fd-5816f705cebf admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:41.714531 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1177/2336] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:23:41.718589 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edd215-357f-4306-a5d5-61fe8192c58c admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:41.728980 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edd215-357f-4306-a5d5-61fe8192c58c admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:41.734132 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bd6c7-045a-4fc8-988b-2c9be8f1bce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:41.734807 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bd6c7-045a-4fc8-988b-2c9be8f1bce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:41.735084 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bd6c7-045a-4fc8-988b-2c9be8f1bce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:41.735353 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bd6c7-045a-4fc8-988b-2c9be8f1bce7 admin admin] PATH_INFO: `/v3/projects/8790065aaf2c4a9fb2522f4bbb72342e/users/1918c0b7bc3f4b26a9e1bd40a7bb0175/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:41.750073 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bd6c7-045a-4fc8-988b-2c9be8f1bce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8790065aaf2c4a9fb2522f4bbb72342e, user_id=1918c0b7bc3f4b26a9e1bd40a7bb0175, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:41.752881 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bd6c7-045a-4fc8-988b-2c9be8f1bce7 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:41.805528 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1160/2337] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:23:41 2022] PUT /identity/v3/projects/8790065aaf2c4a9fb2522f4bbb72342e/users/1918c0b7bc3f4b26a9e1bd40a7bb0175/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:23:41.809851 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e9009-5c79-455f-97fd-5816f705cebf admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:41.819695 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e9009-5c79-455f-97fd-5816f705cebf admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:41.876582 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7902282-9f27-48e9-b15d-54a8cf2a3d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:41.877113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7902282-9f27-48e9-b15d-54a8cf2a3d98 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:41.877395 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7902282-9f27-48e9-b15d-54a8cf2a3d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:41.877672 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7902282-9f27-48e9-b15d-54a8cf2a3d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:41.878338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7902282-9f27-48e9-b15d-54a8cf2a3d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:41.880129 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7902282-9f27-48e9-b15d-54a8cf2a3d98 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:41.890391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1178/2338] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:23:41.894749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bd6c7-045a-4fc8-988b-2c9be8f1bce7 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:41.905060 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bd6c7-045a-4fc8-988b-2c9be8f1bce7 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:41.910484 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9082b-0f7d-43be-bc6c-2de2b5fe4b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:41.911138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9082b-0f7d-43be-bc6c-2de2b5fe4b26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:41.911407 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9082b-0f7d-43be-bc6c-2de2b5fe4b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:41.911682 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9082b-0f7d-43be-bc6c-2de2b5fe4b26 admin admin] PATH_INFO: `/v3/projects/8790065aaf2c4a9fb2522f4bbb72342e/users/1918c0b7bc3f4b26a9e1bd40a7bb0175/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:41.913593 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9082b-0f7d-43be-bc6c-2de2b5fe4b26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8790065aaf2c4a9fb2522f4bbb72342e, user_id=1918c0b7bc3f4b26a9e1bd40a7bb0175, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:41.916358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9082b-0f7d-43be-bc6c-2de2b5fe4b26 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:41.926724 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1161/2339] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:23:41 2022] PUT /identity/v3/projects/8790065aaf2c4a9fb2522f4bbb72342e/users/1918c0b7bc3f4b26a9e1bd40a7bb0175/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:23:41.937052 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c99923-d7c4-42da-a6a3-d00f81dc1c11 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:41.937340 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c99923-d7c4-42da-a6a3-d00f81dc1c11 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:41.937615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c99923-d7c4-42da-a6a3-d00f81dc1c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:41.965862 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-f1c99923-d7c4-42da-a6a3-d00f81dc1c11 None None] MFA Rules not processed for user `1918c0b7bc3f4b26a9e1bd40a7bb0175`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:23:41.967154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-f1c99923-d7c4-42da-a6a3-d00f81dc1c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:42.033622 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1179/2340] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:23:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:23:42.045598 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9082b-0f7d-43be-bc6c-2de2b5fe4b26 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:42.047291 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-b9f9082b-0f7d-43be-bc6c-2de2b5fe4b26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:42.124601 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9082b-0f7d-43be-bc6c-2de2b5fe4b26 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:42.128522 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d67c6-07a2-4f2f-8918-2989b405cfb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:42.129054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d67c6-07a2-4f2f-8918-2989b405cfb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:42.129333 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d67c6-07a2-4f2f-8918-2989b405cfb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:42.129602 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d67c6-07a2-4f2f-8918-2989b405cfb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:42.138443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d67c6-07a2-4f2f-8918-2989b405cfb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:42.139870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d67c6-07a2-4f2f-8918-2989b405cfb3 service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:42.149698 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1162/2341] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:23:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:23:42.372699 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c99923-d7c4-42da-a6a3-d00f81dc1c11 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:42.383245 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c99923-d7c4-42da-a6a3-d00f81dc1c11 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:42.386795 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabac9b2-8c09-4c40-92c4-16726a3b8e0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:42.387393 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabac9b2-8c09-4c40-92c4-16726a3b8e0a service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:42.387674 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabac9b2-8c09-4c40-92c4-16726a3b8e0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:42.387948 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabac9b2-8c09-4c40-92c4-16726a3b8e0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:42.443897 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabac9b2-8c09-4c40-92c4-16726a3b8e0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:42.445343 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabac9b2-8c09-4c40-92c4-16726a3b8e0a service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:42.454196 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1180/2342] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:23:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:23:52.145523 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=51,keystone:INSERT=2 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:52.450260 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=98 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:57.158556 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d67c6-07a2-4f2f-8918-2989b405cfb3 service cinder] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:23:57.167150 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d67c6-07a2-4f2f-8918-2989b405cfb3 service cinder] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:23:57.170952 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdaac3-0315-4bc2-bfe3-6649f0fa33f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:23:57.171544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdaac3-0315-4bc2-bfe3-6649f0fa33f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:23:57.171826 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdaac3-0315-4bc2-bfe3-6649f0fa33f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:23:57.172101 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdaac3-0315-4bc2-bfe3-6649f0fa33f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:23:57.173806 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-49bdaac3-0315-4bc2-bfe3-6649f0fa33f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:23:57.233210 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bdaac3-0315-4bc2-bfe3-6649f0fa33f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:23:57.234750 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bdaac3-0315-4bc2-bfe3-6649f0fa33f2 service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:23:57.243646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1163/2343] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:23:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:24:05.711224 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf2a2d-cd08-4f00-b5c1-92ef594736de None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:05.711739 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf2a2d-cd08-4f00-b5c1-92ef594736de None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:05.711845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf2a2d-cd08-4f00-b5c1-92ef594736de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:05.731575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-c5bf2a2d-cd08-4f00-b5c1-92ef594736de None None] MFA Rules not processed for user `a7d7c99fd9e842bdaf539186f7aa0492`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:24:05.732756 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c5bf2a2d-cd08-4f00-b5c1-92ef594736de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:05.739721 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1181/2344] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:24:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:24:06.043623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdaac3-0315-4bc2-bfe3-6649f0fa33f2 service cinder] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:06.045011 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-49bdaac3-0315-4bc2-bfe3-6649f0fa33f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:06.102403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdaac3-0315-4bc2-bfe3-6649f0fa33f2 service cinder] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:06.107039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088d158-d26b-470d-b287-3b1e158fcd5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:06.107618 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088d158-d26b-470d-b287-3b1e158fcd5c service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:06.107966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088d158-d26b-470d-b287-3b1e158fcd5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:06.108239 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088d158-d26b-470d-b287-3b1e158fcd5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:06.109926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-7088d158-d26b-470d-b287-3b1e158fcd5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:06.119738 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088d158-d26b-470d-b287-3b1e158fcd5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:06.121869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088d158-d26b-470d-b287-3b1e158fcd5c service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:06.130229 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1164/2345] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:24:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:24:15.726205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:24:16.126719 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=54 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:24:18.446139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf2a2d-cd08-4f00-b5c1-92ef594736de None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:18.447900 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c5bf2a2d-cd08-4f00-b5c1-92ef594736de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:18.544514 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf2a2d-cd08-4f00-b5c1-92ef594736de None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:18.552655 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8a72b-3935-4009-88d1-96250109bfac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:18.553333 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8a72b-3935-4009-88d1-96250109bfac service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:18.553752 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8a72b-3935-4009-88d1-96250109bfac service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:18.554084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8a72b-3935-4009-88d1-96250109bfac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:18.556079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-5ab8a72b-3935-4009-88d1-96250109bfac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:18.569191 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8a72b-3935-4009-88d1-96250109bfac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:18.572207 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8a72b-3935-4009-88d1-96250109bfac service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:18.583822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1182/2346] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:24:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:24:22.295351 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088d158-d26b-470d-b287-3b1e158fcd5c service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:22.360656 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088d158-d26b-470d-b287-3b1e158fcd5c service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:22.365145 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b284f-84c0-47b0-b663-a96fa086a108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:22.365777 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b284f-84c0-47b0-b663-a96fa086a108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:22.366057 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b284f-84c0-47b0-b663-a96fa086a108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:22.366351 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b284f-84c0-47b0-b663-a96fa086a108 admin admin] PATH_INFO: `/v3/users/0ea14e9cfa724383bf57fbf5577f6fa0` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:22.367481 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b284f-84c0-47b0-b663-a96fa086a108 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ea14e9cfa724383bf57fbf5577f6fa0)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:22.369401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b284f-84c0-47b0-b663-a96fa086a108 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:22.588633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-9d2b284f-84c0-47b0-b663-a96fa086a108 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ea14e9cfa724383bf57fbf5577f6fa0'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:22.589293 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-9d2b284f-84c0-47b0-b663-a96fa086a108 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ea14e9cfa724383bf57fbf5577f6fa0'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:22.589896 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-9d2b284f-84c0-47b0-b663-a96fa086a108 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ea14e9cfa724383bf57fbf5577f6fa0'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:22.655752 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-9d2b284f-84c0-47b0-b663-a96fa086a108 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ea14e9cfa724383bf57fbf5577f6fa0'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:22.663974 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-9d2b284f-84c0-47b0-b663-a96fa086a108 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ea14e9cfa724383bf57fbf5577f6fa0'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:22.682131 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1165/2347] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:24:22 2022] DELETE /identity/v3/users/0ea14e9cfa724383bf57fbf5577f6fa0 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:24:22.686887 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccee799-f41b-4478-8e24-ceac88f0668d None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:22.688080 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccee799-f41b-4478-8e24-ceac88f0668d None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:22.688324 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccee799-f41b-4478-8e24-ceac88f0668d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:22.708689 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-bccee799-f41b-4478-8e24-ceac88f0668d None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:24:22.710029 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-bccee799-f41b-4478-8e24-ceac88f0668d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:22.769888 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1183/2348] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:24:22.779505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b284f-84c0-47b0-b663-a96fa086a108 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:22.781644 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-9d2b284f-84c0-47b0-b663-a96fa086a108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:22.839458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b284f-84c0-47b0-b663-a96fa086a108 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:22.843170 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01425b36-43c3-44ae-a6dc-89f997b6068a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:22.844402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01425b36-43c3-44ae-a6dc-89f997b6068a service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:22.844737 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01425b36-43c3-44ae-a6dc-89f997b6068a service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:22.845006 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01425b36-43c3-44ae-a6dc-89f997b6068a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:22.854040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01425b36-43c3-44ae-a6dc-89f997b6068a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:22.855525 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01425b36-43c3-44ae-a6dc-89f997b6068a service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:22.865202 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1166/2349] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:24:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:24:23.294035 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccee799-f41b-4478-8e24-ceac88f0668d None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:23.295508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-bccee799-f41b-4478-8e24-ceac88f0668d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:23.309638 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccee799-f41b-4478-8e24-ceac88f0668d None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:23.315598 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236d556-cb64-40fa-a237-7b6d0bbc2c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:23.316231 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236d556-cb64-40fa-a237-7b6d0bbc2c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:23.316508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236d556-cb64-40fa-a237-7b6d0bbc2c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:23.316779 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236d556-cb64-40fa-a237-7b6d0bbc2c7d admin admin] PATH_INFO: `/v3/projects/5172b1938344487c839e2c87f6ba558b` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:23.318697 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236d556-cb64-40fa-a237-7b6d0bbc2c7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5172b1938344487c839e2c87f6ba558b)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:23.320827 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236d556-cb64-40fa-a237-7b6d0bbc2c7d admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:23.489710 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2236d556-cb64-40fa-a237-7b6d0bbc2c7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5172b1938344487c839e2c87f6ba558b', 'request_id': 'req-2236d556-cb64-40fa-a237-7b6d0bbc2c7d'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:23.497402 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2236d556-cb64-40fa-a237-7b6d0bbc2c7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5172b1938344487c839e2c87f6ba558b', 'request_id': 'req-2236d556-cb64-40fa-a237-7b6d0bbc2c7d'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:23.506606 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2236d556-cb64-40fa-a237-7b6d0bbc2c7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5172b1938344487c839e2c87f6ba558b', 'request_id': 'req-2236d556-cb64-40fa-a237-7b6d0bbc2c7d'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:23.606424 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2236d556-cb64-40fa-a237-7b6d0bbc2c7d admin admin] The token cache is being invalidate because project 5172b1938344487c839e2c87f6ba558b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:24:23.606748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2236d556-cb64-40fa-a237-7b6d0bbc2c7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:23.607504 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2236d556-cb64-40fa-a237-7b6d0bbc2c7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:23.610177 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1184/2350] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:24:23 2022] DELETE /identity/v3/projects/5172b1938344487c839e2c87f6ba558b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:24:23.614477 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01425b36-43c3-44ae-a6dc-89f997b6068a service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:23.624916 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01425b36-43c3-44ae-a6dc-89f997b6068a service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:23.670715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:24:23.717958 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3461cf-0c52-4dd6-a965-59a01520ea32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:23.720366 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3461cf-0c52-4dd6-a965-59a01520ea32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:23.720366 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3461cf-0c52-4dd6-a965-59a01520ea32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:23.720366 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3461cf-0c52-4dd6-a965-59a01520ea32 admin admin] PATH_INFO: `/v3/users/1918c0b7bc3f4b26a9e1bd40a7bb0175` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:23.721585 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3461cf-0c52-4dd6-a965-59a01520ea32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1918c0b7bc3f4b26a9e1bd40a7bb0175)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:23.723636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3461cf-0c52-4dd6-a965-59a01520ea32 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:23.958966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-9d3461cf-0c52-4dd6-a965-59a01520ea32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1918c0b7bc3f4b26a9e1bd40a7bb0175'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:23.959619 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-9d3461cf-0c52-4dd6-a965-59a01520ea32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1918c0b7bc3f4b26a9e1bd40a7bb0175'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:23.960225 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-9d3461cf-0c52-4dd6-a965-59a01520ea32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1918c0b7bc3f4b26a9e1bd40a7bb0175'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:24.160217 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-9d3461cf-0c52-4dd6-a965-59a01520ea32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1918c0b7bc3f4b26a9e1bd40a7bb0175'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:24.170818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-9d3461cf-0c52-4dd6-a965-59a01520ea32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1918c0b7bc3f4b26a9e1bd40a7bb0175'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:24.189099 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1167/2351] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:24:23 2022] DELETE /identity/v3/users/1918c0b7bc3f4b26a9e1bd40a7bb0175 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:24:25.180397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236d556-cb64-40fa-a237-7b6d0bbc2c7d admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:25.183270 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-2236d556-cb64-40fa-a237-7b6d0bbc2c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:25.206900 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236d556-cb64-40fa-a237-7b6d0bbc2c7d admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:25.227596 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:24:25.305661 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf0630-0324-469b-9ec4-791626c47846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:25.306513 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf0630-0324-469b-9ec4-791626c47846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:25.306901 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf0630-0324-469b-9ec4-791626c47846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:25.307407 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf0630-0324-469b-9ec4-791626c47846 admin admin] PATH_INFO: `/v3/projects/8790065aaf2c4a9fb2522f4bbb72342e` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:25.308859 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf0630-0324-469b-9ec4-791626c47846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8790065aaf2c4a9fb2522f4bbb72342e)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:25.311002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf0630-0324-469b-9ec4-791626c47846 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:25.454232 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-91cf0630-0324-469b-9ec4-791626c47846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8790065aaf2c4a9fb2522f4bbb72342e', 'request_id': 'req-91cf0630-0324-469b-9ec4-791626c47846'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:25.459979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-91cf0630-0324-469b-9ec4-791626c47846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8790065aaf2c4a9fb2522f4bbb72342e', 'request_id': 'req-91cf0630-0324-469b-9ec4-791626c47846'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:25.470991 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-91cf0630-0324-469b-9ec4-791626c47846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8790065aaf2c4a9fb2522f4bbb72342e', 'request_id': 'req-91cf0630-0324-469b-9ec4-791626c47846'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:25.572680 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-91cf0630-0324-469b-9ec4-791626c47846 admin admin] The token cache is being invalidate because project 8790065aaf2c4a9fb2522f4bbb72342e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:24:25.573224 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-91cf0630-0324-469b-9ec4-791626c47846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:25.575294 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-91cf0630-0324-469b-9ec4-791626c47846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:25.577244 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1185/2352] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:24:25 2022] DELETE /identity/v3/projects/8790065aaf2c4a9fb2522f4bbb72342e => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:24:25.582833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a4111-a361-449c-aa69-6dd7f9147938 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:25.583318 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a4111-a361-449c-aa69-6dd7f9147938 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:25.583555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a4111-a361-449c-aa69-6dd7f9147938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:25.612919 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-b58a4111-a361-449c-aa69-6dd7f9147938 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:24:25.614559 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-b58a4111-a361-449c-aa69-6dd7f9147938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:25.721347 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1168/2353] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:24:25.729341 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf46d5-f9b3-4279-9a39-98f30c858869 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:25.729788 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf46d5-f9b3-4279-9a39-98f30c858869 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:25.730072 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf46d5-f9b3-4279-9a39-98f30c858869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:25.762324 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-e6cf46d5-f9b3-4279-9a39-98f30c858869 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:24:25.763594 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-e6cf46d5-f9b3-4279-9a39-98f30c858869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:25.775847 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1186/2354] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:24:25.777953 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a4111-a361-449c-aa69-6dd7f9147938 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:25.792074 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a4111-a361-449c-aa69-6dd7f9147938 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:25.799716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ebb9d-b83e-4c52-a59a-63e4f0c1908c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:25.801466 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ebb9d-b83e-4c52-a59a-63e4f0c1908c admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:25.802059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ebb9d-b83e-4c52-a59a-63e4f0c1908c admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:25.802524 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ebb9d-b83e-4c52-a59a-63e4f0c1908c admin admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:25.803979 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ebb9d-b83e-4c52-a59a-63e4f0c1908c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:24:25.804446 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ebb9d-b83e-4c52-a59a-63e4f0c1908c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:25.806584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ebb9d-b83e-4c52-a59a-63e4f0c1908c admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:25.824060 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1169/2355] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 08:24:25.829579 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf46d5-f9b3-4279-9a39-98f30c858869 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:25.850276 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf46d5-f9b3-4279-9a39-98f30c858869 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:25.869973 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fce5e-b62c-410d-b51d-4e282a82b921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:25.870970 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fce5e-b62c-410d-b51d-4e282a82b921 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:25.871403 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fce5e-b62c-410d-b51d-4e282a82b921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:25.872613 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fce5e-b62c-410d-b51d-4e282a82b921 admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:25.874351 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34fce5e-b62c-410d-b51d-4e282a82b921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:25.880396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34fce5e-b62c-410d-b51d-4e282a82b921 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:26.020485 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1187/2356] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:24:25 2022] POST /identity/v3/projects => generated 381 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:24:26.025278 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ebb9d-b83e-4c52-a59a-63e4f0c1908c admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:26.042235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ebb9d-b83e-4c52-a59a-63e4f0c1908c admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:26.123822 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:24:26.166672 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11b2cd-9705-403d-b01e-fbc041c0ed95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:26.167831 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11b2cd-9705-403d-b01e-fbc041c0ed95 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:26.168268 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11b2cd-9705-403d-b01e-fbc041c0ed95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:26.168904 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11b2cd-9705-403d-b01e-fbc041c0ed95 admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:26.169550 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11b2cd-9705-403d-b01e-fbc041c0ed95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:26.171609 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11b2cd-9705-403d-b01e-fbc041c0ed95 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:26.319126 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1170/2357] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:24:26 2022] POST /identity/v3/users => generated 291 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:24:26.320315 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fce5e-b62c-410d-b51d-4e282a82b921 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:26.331564 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fce5e-b62c-410d-b51d-4e282a82b921 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:26.336333 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b6c43-ec8f-4d47-92ee-d5254d3780c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:26.336933 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b6c43-ec8f-4d47-92ee-d5254d3780c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:26.337213 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b6c43-ec8f-4d47-92ee-d5254d3780c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:26.337486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b6c43-ec8f-4d47-92ee-d5254d3780c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:26.338129 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b6c43-ec8f-4d47-92ee-d5254d3780c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:26.339770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b6c43-ec8f-4d47-92ee-d5254d3780c7 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:26.350317 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1188/2358] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:24:26.354149 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11b2cd-9705-403d-b01e-fbc041c0ed95 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:26.365718 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11b2cd-9705-403d-b01e-fbc041c0ed95 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:26.370548 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b378c-9757-4346-bf32-c670173d042a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:26.371265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b378c-9757-4346-bf32-c670173d042a admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:26.371548 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b378c-9757-4346-bf32-c670173d042a admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:26.371845 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b378c-9757-4346-bf32-c670173d042a admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:26.372487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b378c-9757-4346-bf32-c670173d042a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:26.374129 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b378c-9757-4346-bf32-c670173d042a admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:26.385422 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1171/2359] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:24:26.389906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b6c43-ec8f-4d47-92ee-d5254d3780c7 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:26.400014 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b6c43-ec8f-4d47-92ee-d5254d3780c7 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:26.404579 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ad795-d5f5-4986-98de-5065d6ae21ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:26.405234 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ad795-d5f5-4986-98de-5065d6ae21ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:26.405514 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ad795-d5f5-4986-98de-5065d6ae21ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:26.405910 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ad795-d5f5-4986-98de-5065d6ae21ce admin admin] PATH_INFO: `/v3/projects/54ec686bcf6541708f3676387615c4c2/users/3a7a6766829b49f387ff75dee73e70da/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:26.422806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ad795-d5f5-4986-98de-5065d6ae21ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ec686bcf6541708f3676387615c4c2, user_id=3a7a6766829b49f387ff75dee73e70da, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:26.425499 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ad795-d5f5-4986-98de-5065d6ae21ce admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:26.528441 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1189/2360] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:24:26 2022] PUT /identity/v3/projects/54ec686bcf6541708f3676387615c4c2/users/3a7a6766829b49f387ff75dee73e70da/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:24:26.540112 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e46ca-3e8f-4f24-a637-c8e86334e583 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:26.540322 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e46ca-3e8f-4f24-a637-c8e86334e583 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:26.540600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e46ca-3e8f-4f24-a637-c8e86334e583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:26.569476 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-c65e46ca-3e8f-4f24-a637-c8e86334e583 None None] MFA Rules not processed for user `3a7a6766829b49f387ff75dee73e70da`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:24:26.570749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-c65e46ca-3e8f-4f24-a637-c8e86334e583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:26.633128 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1172/2361] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:24:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:24:26.637517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ad795-d5f5-4986-98de-5065d6ae21ce admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:26.678377 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:24:26.700404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ad795-d5f5-4986-98de-5065d6ae21ce admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:26.705365 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1400872-b6d1-4524-aedf-c11dffeeb18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:26.705988 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1400872-b6d1-4524-aedf-c11dffeeb18a admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:26.706269 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1400872-b6d1-4524-aedf-c11dffeeb18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:26.706642 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1400872-b6d1-4524-aedf-c11dffeeb18a admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:26.707254 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1400872-b6d1-4524-aedf-c11dffeeb18a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:26.709269 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1400872-b6d1-4524-aedf-c11dffeeb18a admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:26.807266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1190/2362] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:24:26 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:24:26.811775 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e46ca-3e8f-4f24-a637-c8e86334e583 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:26.822712 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e46ca-3e8f-4f24-a637-c8e86334e583 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:26.877506 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d728e-3c93-41bb-8246-bc3a96dc475c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:26.878103 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d728e-3c93-41bb-8246-bc3a96dc475c admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:26.878417 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d728e-3c93-41bb-8246-bc3a96dc475c admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:26.878691 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d728e-3c93-41bb-8246-bc3a96dc475c admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:26.879311 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d728e-3c93-41bb-8246-bc3a96dc475c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:26.881222 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d728e-3c93-41bb-8246-bc3a96dc475c admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:27.059469 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1173/2363] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:24:26 2022] POST /identity/v3/users => generated 298 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:24:27.063676 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1400872-b6d1-4524-aedf-c11dffeeb18a admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:27.074016 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1400872-b6d1-4524-aedf-c11dffeeb18a admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:27.079555 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8982a61-74e7-46d6-b831-c111c7ffa9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:27.080156 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8982a61-74e7-46d6-b831-c111c7ffa9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:27.080437 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8982a61-74e7-46d6-b831-c111c7ffa9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:27.080712 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8982a61-74e7-46d6-b831-c111c7ffa9b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:27.081825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8982a61-74e7-46d6-b831-c111c7ffa9b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:27.083016 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8982a61-74e7-46d6-b831-c111c7ffa9b7 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:27.094967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1191/2364] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:24:27.098517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d728e-3c93-41bb-8246-bc3a96dc475c admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:27.109004 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d728e-3c93-41bb-8246-bc3a96dc475c admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:27.113681 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba4cdf-679e-46eb-b8a8-61cf57373066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:27.114358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba4cdf-679e-46eb-b8a8-61cf57373066 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:27.114640 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba4cdf-679e-46eb-b8a8-61cf57373066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:27.114914 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba4cdf-679e-46eb-b8a8-61cf57373066 admin admin] PATH_INFO: `/v3/projects/380fdfda7e63404fbbc9132232d0a26d/users/eea3187b93e7473891467a6bcc02d97c/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:27.130200 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba4cdf-679e-46eb-b8a8-61cf57373066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=380fdfda7e63404fbbc9132232d0a26d, user_id=eea3187b93e7473891467a6bcc02d97c, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:27.132904 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba4cdf-679e-46eb-b8a8-61cf57373066 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:27.216067 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1174/2365] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:24:27 2022] PUT /identity/v3/projects/380fdfda7e63404fbbc9132232d0a26d/users/eea3187b93e7473891467a6bcc02d97c/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:24:27.220769 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8982a61-74e7-46d6-b831-c111c7ffa9b7 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:27.230854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8982a61-74e7-46d6-b831-c111c7ffa9b7 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:27.297610 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ed8d7-5fbb-4604-ab9e-d9aead37e2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:27.302646 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ed8d7-5fbb-4604-ab9e-d9aead37e2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:27.302646 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ed8d7-5fbb-4604-ab9e-d9aead37e2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:27.302646 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ed8d7-5fbb-4604-ab9e-d9aead37e2a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:27.302646 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ed8d7-5fbb-4604-ab9e-d9aead37e2a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:27.302646 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ed8d7-5fbb-4604-ab9e-d9aead37e2a0 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:27.313548 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1192/2366] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:24:27.316831 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba4cdf-679e-46eb-b8a8-61cf57373066 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:27.325543 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:24:27.331546 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba4cdf-679e-46eb-b8a8-61cf57373066 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:27.335272 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e99fe9-22e3-4db1-a729-79d4d294b005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:27.336440 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e99fe9-22e3-4db1-a729-79d4d294b005 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:27.336440 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e99fe9-22e3-4db1-a729-79d4d294b005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:27.336676 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e99fe9-22e3-4db1-a729-79d4d294b005 admin admin] PATH_INFO: `/v3/projects/380fdfda7e63404fbbc9132232d0a26d/users/eea3187b93e7473891467a6bcc02d97c/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:27.338711 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e99fe9-22e3-4db1-a729-79d4d294b005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=380fdfda7e63404fbbc9132232d0a26d, user_id=eea3187b93e7473891467a6bcc02d97c, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:27.341588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e99fe9-22e3-4db1-a729-79d4d294b005 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:27.353594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1175/2367] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:24:27 2022] PUT /identity/v3/projects/380fdfda7e63404fbbc9132232d0a26d/users/eea3187b93e7473891467a6bcc02d97c/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:24:27.364580 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668fbc5-1347-49ad-94d2-c918a18278da None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:27.365094 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668fbc5-1347-49ad-94d2-c918a18278da None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:27.365209 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668fbc5-1347-49ad-94d2-c918a18278da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:27.394707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-0668fbc5-1347-49ad-94d2-c918a18278da None None] MFA Rules not processed for user `eea3187b93e7473891467a6bcc02d97c`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:24:27.396009 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-0668fbc5-1347-49ad-94d2-c918a18278da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:27.469963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1193/2368] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:24:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:24:27.481048 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e99fe9-22e3-4db1-a729-79d4d294b005 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:27.482790 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-24e99fe9-22e3-4db1-a729-79d4d294b005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:27.544176 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e99fe9-22e3-4db1-a729-79d4d294b005 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:27.548697 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b0e85-1fdf-41e4-afc7-df77481ac69b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:27.549335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b0e85-1fdf-41e4-afc7-df77481ac69b service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:27.549723 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b0e85-1fdf-41e4-afc7-df77481ac69b service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:27.550123 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b0e85-1fdf-41e4-afc7-df77481ac69b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:27.561626 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b0e85-1fdf-41e4-afc7-df77481ac69b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:27.563735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b0e85-1fdf-41e4-afc7-df77481ac69b service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:27.573610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1176/2369] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:24:27 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:24:27.683819 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668fbc5-1347-49ad-94d2-c918a18278da None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:27.698377 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668fbc5-1347-49ad-94d2-c918a18278da None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:27.706145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231a930-bac4-41c5-8352-efacda6bcd58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:27.706865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231a930-bac4-41c5-8352-efacda6bcd58 service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:27.707132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231a930-bac4-41c5-8352-efacda6bcd58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:27.707472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231a930-bac4-41c5-8352-efacda6bcd58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:27.746216 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:24:27.775406 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231a930-bac4-41c5-8352-efacda6bcd58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:27.776857 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231a930-bac4-41c5-8352-efacda6bcd58 service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:27.786364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1194/2370] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:24:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:24:30.651958 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef159b-6f60-4906-85b6-76214d8ab4e4 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:30.652489 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef159b-6f60-4906-85b6-76214d8ab4e4 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:30.652489 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef159b-6f60-4906-85b6-76214d8ab4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:30.672519 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-2fef159b-6f60-4906-85b6-76214d8ab4e4 None None] MFA Rules not processed for user `174ebadbeec64175bd09beb3e270c573`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:24:30.673721 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-2fef159b-6f60-4906-85b6-76214d8ab4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:30.728321 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1177/2371] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:24:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:24:30.962680 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231a930-bac4-41c5-8352-efacda6bcd58 service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:31.032404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231a930-bac4-41c5-8352-efacda6bcd58 service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:31.037086 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f8f97-2fd9-4aa4-b8ad-bf4d9e7fb446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:31.037722 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f8f97-2fd9-4aa4-b8ad-bf4d9e7fb446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:31.037998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f8f97-2fd9-4aa4-b8ad-bf4d9e7fb446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:31.038270 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f8f97-2fd9-4aa4-b8ad-bf4d9e7fb446 admin admin] PATH_INFO: `/v3/users/3a7a6766829b49f387ff75dee73e70da` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:31.039529 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f8f97-2fd9-4aa4-b8ad-bf4d9e7fb446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a7a6766829b49f387ff75dee73e70da)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:31.041702 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f8f97-2fd9-4aa4-b8ad-bf4d9e7fb446 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:31.237437 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-c90f8f97-2fd9-4aa4-b8ad-bf4d9e7fb446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a7a6766829b49f387ff75dee73e70da'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:31.238023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-c90f8f97-2fd9-4aa4-b8ad-bf4d9e7fb446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a7a6766829b49f387ff75dee73e70da'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:31.238651 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-c90f8f97-2fd9-4aa4-b8ad-bf4d9e7fb446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a7a6766829b49f387ff75dee73e70da'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:31.280092 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-c90f8f97-2fd9-4aa4-b8ad-bf4d9e7fb446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a7a6766829b49f387ff75dee73e70da'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:31.301609 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-c90f8f97-2fd9-4aa4-b8ad-bf4d9e7fb446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a7a6766829b49f387ff75dee73e70da'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:31.317899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1195/2372] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:24:30 2022] DELETE /identity/v3/users/3a7a6766829b49f387ff75dee73e70da => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:24:31.320841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633438f-f5be-481f-8111-b2be1219ac95 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:31.320841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633438f-f5be-481f-8111-b2be1219ac95 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:31.320841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633438f-f5be-481f-8111-b2be1219ac95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:31.339590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-0633438f-f5be-481f-8111-b2be1219ac95 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:24:31.340795 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-0633438f-f5be-481f-8111-b2be1219ac95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:31.399173 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1178/2373] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:24:31.409499 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f8f97-2fd9-4aa4-b8ad-bf4d9e7fb446 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:31.410516 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c90f8f97-2fd9-4aa4-b8ad-bf4d9e7fb446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:31.483272 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:24:31.488312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f8f97-2fd9-4aa4-b8ad-bf4d9e7fb446 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:31.492215 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ac1e5-494f-4d3c-b86e-4c3785f18c4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:31.492825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ac1e5-494f-4d3c-b86e-4c3785f18c4d service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:31.493100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ac1e5-494f-4d3c-b86e-4c3785f18c4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:31.493371 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ac1e5-494f-4d3c-b86e-4c3785f18c4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:31.504794 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ac1e5-494f-4d3c-b86e-4c3785f18c4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:31.506250 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ac1e5-494f-4d3c-b86e-4c3785f18c4d service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:31.516598 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1196/2374] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:24:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:24:31.928529 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633438f-f5be-481f-8111-b2be1219ac95 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:31.930523 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-0633438f-f5be-481f-8111-b2be1219ac95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:31.945045 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633438f-f5be-481f-8111-b2be1219ac95 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:31.950516 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea641de-e8e2-467e-9ef1-5a05808c8d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:31.951184 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea641de-e8e2-467e-9ef1-5a05808c8d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:31.956382 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea641de-e8e2-467e-9ef1-5a05808c8d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:31.956382 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea641de-e8e2-467e-9ef1-5a05808c8d15 admin admin] PATH_INFO: `/v3/projects/54ec686bcf6541708f3676387615c4c2` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:31.956382 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea641de-e8e2-467e-9ef1-5a05808c8d15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ec686bcf6541708f3676387615c4c2)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:31.956382 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea641de-e8e2-467e-9ef1-5a05808c8d15 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:32.045857 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:24:32.058007 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-7ea641de-e8e2-467e-9ef1-5a05808c8d15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ec686bcf6541708f3676387615c4c2', 'request_id': 'req-7ea641de-e8e2-467e-9ef1-5a05808c8d15'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:32.063646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-7ea641de-e8e2-467e-9ef1-5a05808c8d15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ec686bcf6541708f3676387615c4c2', 'request_id': 'req-7ea641de-e8e2-467e-9ef1-5a05808c8d15'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:32.069811 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-7ea641de-e8e2-467e-9ef1-5a05808c8d15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ec686bcf6541708f3676387615c4c2', 'request_id': 'req-7ea641de-e8e2-467e-9ef1-5a05808c8d15'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:32.160167 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-7ea641de-e8e2-467e-9ef1-5a05808c8d15 admin admin] The token cache is being invalidate because project 54ec686bcf6541708f3676387615c4c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:24:32.160460 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-7ea641de-e8e2-467e-9ef1-5a05808c8d15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:32.164415 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-7ea641de-e8e2-467e-9ef1-5a05808c8d15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:32.164415 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1179/2375] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:24:31 2022] DELETE /identity/v3/projects/54ec686bcf6541708f3676387615c4c2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:24:32.166859 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ac1e5-494f-4d3c-b86e-4c3785f18c4d service neutron] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:32.177024 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ac1e5-494f-4d3c-b86e-4c3785f18c4d service neutron] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:32.237347 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91112ef2-e61c-4d9f-a313-2b1e54122c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:32.238069 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91112ef2-e61c-4d9f-a313-2b1e54122c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:32.238401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91112ef2-e61c-4d9f-a313-2b1e54122c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:32.238681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91112ef2-e61c-4d9f-a313-2b1e54122c24 admin admin] PATH_INFO: `/v3/users/eea3187b93e7473891467a6bcc02d97c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:32.239894 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91112ef2-e61c-4d9f-a313-2b1e54122c24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eea3187b93e7473891467a6bcc02d97c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:32.241841 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91112ef2-e61c-4d9f-a313-2b1e54122c24 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:32.453886 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-91112ef2-e61c-4d9f-a313-2b1e54122c24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eea3187b93e7473891467a6bcc02d97c'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:32.454567 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-91112ef2-e61c-4d9f-a313-2b1e54122c24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eea3187b93e7473891467a6bcc02d97c'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:32.455173 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-91112ef2-e61c-4d9f-a313-2b1e54122c24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eea3187b93e7473891467a6bcc02d97c'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:32.621735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-91112ef2-e61c-4d9f-a313-2b1e54122c24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eea3187b93e7473891467a6bcc02d97c'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:32.634712 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-91112ef2-e61c-4d9f-a313-2b1e54122c24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eea3187b93e7473891467a6bcc02d97c'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:32.650327 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1197/2376] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:24:32 2022] DELETE /identity/v3/users/eea3187b93e7473891467a6bcc02d97c => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:24:33.145532 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea641de-e8e2-467e-9ef1-5a05808c8d15 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:33.146993 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-7ea641de-e8e2-467e-9ef1-5a05808c8d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:33.163514 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea641de-e8e2-467e-9ef1-5a05808c8d15 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:33.220891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506ea54-4e89-45af-9e25-bf49b725c865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:33.221511 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506ea54-4e89-45af-9e25-bf49b725c865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:33.221787 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506ea54-4e89-45af-9e25-bf49b725c865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:33.222055 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506ea54-4e89-45af-9e25-bf49b725c865 admin admin] PATH_INFO: `/v3/projects/380fdfda7e63404fbbc9132232d0a26d` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:33.223190 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506ea54-4e89-45af-9e25-bf49b725c865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=380fdfda7e63404fbbc9132232d0a26d)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:33.225135 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506ea54-4e89-45af-9e25-bf49b725c865 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:33.326981 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-0506ea54-4e89-45af-9e25-bf49b725c865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '380fdfda7e63404fbbc9132232d0a26d', 'request_id': 'req-0506ea54-4e89-45af-9e25-bf49b725c865'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:33.333168 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-0506ea54-4e89-45af-9e25-bf49b725c865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '380fdfda7e63404fbbc9132232d0a26d', 'request_id': 'req-0506ea54-4e89-45af-9e25-bf49b725c865'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:33.339285 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-0506ea54-4e89-45af-9e25-bf49b725c865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '380fdfda7e63404fbbc9132232d0a26d', 'request_id': 'req-0506ea54-4e89-45af-9e25-bf49b725c865'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:33.404716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-0506ea54-4e89-45af-9e25-bf49b725c865 admin admin] The token cache is being invalidate because project 380fdfda7e63404fbbc9132232d0a26d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:24:33.405012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-0506ea54-4e89-45af-9e25-bf49b725c865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:33.405639 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-0506ea54-4e89-45af-9e25-bf49b725c865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:33.407216 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1180/2377] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:24:33 2022] DELETE /identity/v3/projects/380fdfda7e63404fbbc9132232d0a26d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:24:33.412388 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74873bd-c105-461d-a3ed-57c89dfaa9de None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:33.412870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74873bd-c105-461d-a3ed-57c89dfaa9de None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:33.412973 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74873bd-c105-461d-a3ed-57c89dfaa9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:33.434488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-f74873bd-c105-461d-a3ed-57c89dfaa9de None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:24:33.435618 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-f74873bd-c105-461d-a3ed-57c89dfaa9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:33.496834 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1198/2378] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:24:33.505524 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc363afd-25d6-4384-bbee-67225f71cf35 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:33.505813 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc363afd-25d6-4384-bbee-67225f71cf35 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:33.506091 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc363afd-25d6-4384-bbee-67225f71cf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:33.526238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-cc363afd-25d6-4384-bbee-67225f71cf35 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:24:33.527504 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-cc363afd-25d6-4384-bbee-67225f71cf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:33.535602 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1181/2379] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:24:33.539944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74873bd-c105-461d-a3ed-57c89dfaa9de None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:33.550040 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74873bd-c105-461d-a3ed-57c89dfaa9de None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:33.554928 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd819736-ecda-4c5d-a8e1-f6aa9ac381ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:33.555531 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd819736-ecda-4c5d-a8e1-f6aa9ac381ea admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:33.555813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd819736-ecda-4c5d-a8e1-f6aa9ac381ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:33.556087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd819736-ecda-4c5d-a8e1-f6aa9ac381ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:33.556730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd819736-ecda-4c5d-a8e1-f6aa9ac381ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:24:33.557073 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd819736-ecda-4c5d-a8e1-f6aa9ac381ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:33.558954 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd819736-ecda-4c5d-a8e1-f6aa9ac381ea admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:33.566505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:24:33.571487 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1199/2380] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:24:33.575948 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc363afd-25d6-4384-bbee-67225f71cf35 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:33.585976 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc363afd-25d6-4384-bbee-67225f71cf35 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:33.590830 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044bb31-36e1-411b-9c4b-8aaff427a6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:33.592775 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044bb31-36e1-411b-9c4b-8aaff427a6fa admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:33.592775 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044bb31-36e1-411b-9c4b-8aaff427a6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:33.592775 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044bb31-36e1-411b-9c4b-8aaff427a6fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:33.592775 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044bb31-36e1-411b-9c4b-8aaff427a6fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:33.594950 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044bb31-36e1-411b-9c4b-8aaff427a6fa admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:33.733033 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1182/2381] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:24:33 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:24:33.739571 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd819736-ecda-4c5d-a8e1-f6aa9ac381ea admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:33.750671 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd819736-ecda-4c5d-a8e1-f6aa9ac381ea admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:33.819231 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b86a8-d63f-407d-8d68-d5db8aaa5df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:33.819835 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b86a8-d63f-407d-8d68-d5db8aaa5df0 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:33.820464 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b86a8-d63f-407d-8d68-d5db8aaa5df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:33.820614 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b86a8-d63f-407d-8d68-d5db8aaa5df0 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:33.821196 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b86a8-d63f-407d-8d68-d5db8aaa5df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:33.823160 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b86a8-d63f-407d-8d68-d5db8aaa5df0 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:33.907769 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1200/2382] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:24:33 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:24:33.912095 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044bb31-36e1-411b-9c4b-8aaff427a6fa admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:33.923540 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044bb31-36e1-411b-9c4b-8aaff427a6fa admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:33.928582 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f210f-957c-48c1-9195-9b3b85152f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:33.929189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f210f-957c-48c1-9195-9b3b85152f9d admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:33.929474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f210f-957c-48c1-9195-9b3b85152f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:33.929751 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f210f-957c-48c1-9195-9b3b85152f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:33.930465 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f210f-957c-48c1-9195-9b3b85152f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:33.935601 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f210f-957c-48c1-9195-9b3b85152f9d admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:33.943952 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1183/2383] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:24:33.948098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b86a8-d63f-407d-8d68-d5db8aaa5df0 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:33.958421 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b86a8-d63f-407d-8d68-d5db8aaa5df0 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:33.963184 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a274b-4cf3-4870-b35a-a3c0296517e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:33.963865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a274b-4cf3-4870-b35a-a3c0296517e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:33.964172 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a274b-4cf3-4870-b35a-a3c0296517e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:33.964748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a274b-4cf3-4870-b35a-a3c0296517e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:33.970064 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a274b-4cf3-4870-b35a-a3c0296517e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:33.970064 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a274b-4cf3-4870-b35a-a3c0296517e8 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:33.981144 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1201/2384] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:24:33.982368 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f210f-957c-48c1-9195-9b3b85152f9d admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:33.993227 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f210f-957c-48c1-9195-9b3b85152f9d admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:33.997710 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d80f7-a4a6-4e92-82fa-4b7f930ff382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:33.998400 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d80f7-a4a6-4e92-82fa-4b7f930ff382 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:33.998683 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d80f7-a4a6-4e92-82fa-4b7f930ff382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:33.998952 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d80f7-a4a6-4e92-82fa-4b7f930ff382 admin admin] PATH_INFO: `/v3/projects/0346fba997354f5883163338db84ff45/users/0c66ce4a147c449baf3aca035603ed46/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:34.008231 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:24:34.014655 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d80f7-a4a6-4e92-82fa-4b7f930ff382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0346fba997354f5883163338db84ff45, user_id=0c66ce4a147c449baf3aca035603ed46, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:34.017400 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d80f7-a4a6-4e92-82fa-4b7f930ff382 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:34.109052 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1184/2385] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:24:33 2022] PUT /identity/v3/projects/0346fba997354f5883163338db84ff45/users/0c66ce4a147c449baf3aca035603ed46/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:24:34.121052 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d9c7c-96ea-43c6-a997-449fda3208f4 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:34.121341 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d9c7c-96ea-43c6-a997-449fda3208f4 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:34.121622 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d9c7c-96ea-43c6-a997-449fda3208f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:34.152048 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-985d9c7c-96ea-43c6-a997-449fda3208f4 None None] MFA Rules not processed for user `0c66ce4a147c449baf3aca035603ed46`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:24:34.153629 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-985d9c7c-96ea-43c6-a997-449fda3208f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:34.223238 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1202/2386] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:24:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:24:34.234056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d80f7-a4a6-4e92-82fa-4b7f930ff382 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:34.236644 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-f56d80f7-a4a6-4e92-82fa-4b7f930ff382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:34.296058 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d80f7-a4a6-4e92-82fa-4b7f930ff382 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:34.301174 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825fbb4-09f8-425d-92fe-9400ad37013e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:34.301788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825fbb4-09f8-425d-92fe-9400ad37013e service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:34.302073 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825fbb4-09f8-425d-92fe-9400ad37013e service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:34.302396 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825fbb4-09f8-425d-92fe-9400ad37013e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:34.311992 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825fbb4-09f8-425d-92fe-9400ad37013e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:34.313477 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825fbb4-09f8-425d-92fe-9400ad37013e service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:34.323026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1185/2387] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:24:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:24:43.660344 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d9c7c-96ea-43c6-a997-449fda3208f4 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:43.723179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d9c7c-96ea-43c6-a997-449fda3208f4 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:43.727685 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58124b-f67e-405f-b251-6ac2190d8a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:43.728308 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58124b-f67e-405f-b251-6ac2190d8a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:43.728589 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58124b-f67e-405f-b251-6ac2190d8a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:43.728861 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58124b-f67e-405f-b251-6ac2190d8a5c admin admin] PATH_INFO: `/v3/users/0c66ce4a147c449baf3aca035603ed46` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:43.729971 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58124b-f67e-405f-b251-6ac2190d8a5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c66ce4a147c449baf3aca035603ed46)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:43.731929 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58124b-f67e-405f-b251-6ac2190d8a5c admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:43.738014 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:24:43.903326 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-cc58124b-f67e-405f-b251-6ac2190d8a5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c66ce4a147c449baf3aca035603ed46'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:43.903986 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-cc58124b-f67e-405f-b251-6ac2190d8a5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c66ce4a147c449baf3aca035603ed46'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:43.904622 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-cc58124b-f67e-405f-b251-6ac2190d8a5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c66ce4a147c449baf3aca035603ed46'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:44.000483 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-cc58124b-f67e-405f-b251-6ac2190d8a5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c66ce4a147c449baf3aca035603ed46'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:44.014565 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-cc58124b-f67e-405f-b251-6ac2190d8a5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c66ce4a147c449baf3aca035603ed46'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:44.026976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1203/2388] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:24:43 2022] DELETE /identity/v3/users/0c66ce4a147c449baf3aca035603ed46 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:24:44.031686 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebc8f0-9a1a-4b82-8131-6b993b646a37 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:44.032724 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebc8f0-9a1a-4b82-8131-6b993b646a37 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:44.033098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebc8f0-9a1a-4b82-8131-6b993b646a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:44.052888 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-adebc8f0-9a1a-4b82-8131-6b993b646a37 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:24:44.054369 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-adebc8f0-9a1a-4b82-8131-6b993b646a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:44.123752 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1186/2389] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:24:44.134141 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58124b-f67e-405f-b251-6ac2190d8a5c admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:44.136328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-cc58124b-f67e-405f-b251-6ac2190d8a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:44.205569 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58124b-f67e-405f-b251-6ac2190d8a5c admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:44.209234 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda10a4-c6c4-43a6-a9d8-42d57305c008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:44.210164 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda10a4-c6c4-43a6-a9d8-42d57305c008 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:44.210164 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda10a4-c6c4-43a6-a9d8-42d57305c008 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:44.210406 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda10a4-c6c4-43a6-a9d8-42d57305c008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:44.222152 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda10a4-c6c4-43a6-a9d8-42d57305c008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:44.224034 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda10a4-c6c4-43a6-a9d8-42d57305c008 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:44.236710 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cf562-240a-4d8d-8a2a-8397e1310208 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:44.237361 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cf562-240a-4d8d-8a2a-8397e1310208 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:44.237739 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cf562-240a-4d8d-8a2a-8397e1310208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:44.240376 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1204/2390] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:24:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:24:44.270015 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-ba5cf562-240a-4d8d-8a2a-8397e1310208 None None] MFA Rules not processed for user `970300b51d504a2bbc48158855f02f34`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:24:44.271450 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-ba5cf562-240a-4d8d-8a2a-8397e1310208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:44.341416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1187/2391] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 23 08:24:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:24:44.611674 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda10a4-c6c4-43a6-a9d8-42d57305c008 service neutron] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:44.613109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-5bda10a4-c6c4-43a6-a9d8-42d57305c008 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:44.684620 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda10a4-c6c4-43a6-a9d8-42d57305c008 service neutron] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:44.689863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cebb5-f312-4b41-a5b8-5835e6681885 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4718cad0c0b9461d9c4152d7ea4b385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:44.690473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cebb5-f312-4b41-a5b8-5835e6681885 service swift] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:44.690759 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cebb5-f312-4b41-a5b8-5835e6681885 service swift] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:44.691037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cebb5-f312-4b41-a5b8-5835e6681885 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:44.699044 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cebb5-f312-4b41-a5b8-5835e6681885 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:44.700679 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cebb5-f312-4b41-a5b8-5835e6681885 service swift] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:44.709328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1205/2392] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 23 08:24:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 08:24:44.720786 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cf562-240a-4d8d-8a2a-8397e1310208 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:44.720786 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-ba5cf562-240a-4d8d-8a2a-8397e1310208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:44.735156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cf562-240a-4d8d-8a2a-8397e1310208 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:44.740995 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c9b2d-ef91-4f98-9030-4e47b55d0285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:44.741820 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c9b2d-ef91-4f98-9030-4e47b55d0285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:44.742276 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c9b2d-ef91-4f98-9030-4e47b55d0285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:44.742738 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c9b2d-ef91-4f98-9030-4e47b55d0285 admin admin] PATH_INFO: `/v3/projects/0346fba997354f5883163338db84ff45` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:44.744560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c9b2d-ef91-4f98-9030-4e47b55d0285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0346fba997354f5883163338db84ff45)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:44.747811 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c9b2d-ef91-4f98-9030-4e47b55d0285 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:44.785722 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:24:44.904500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-c22c9b2d-ef91-4f98-9030-4e47b55d0285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0346fba997354f5883163338db84ff45', 'request_id': 'req-c22c9b2d-ef91-4f98-9030-4e47b55d0285'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:44.911195 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-c22c9b2d-ef91-4f98-9030-4e47b55d0285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0346fba997354f5883163338db84ff45', 'request_id': 'req-c22c9b2d-ef91-4f98-9030-4e47b55d0285'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:44.917949 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-c22c9b2d-ef91-4f98-9030-4e47b55d0285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0346fba997354f5883163338db84ff45', 'request_id': 'req-c22c9b2d-ef91-4f98-9030-4e47b55d0285'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:45.020666 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-c22c9b2d-ef91-4f98-9030-4e47b55d0285 admin admin] The token cache is being invalidate because project 0346fba997354f5883163338db84ff45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:24:45.020995 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-c22c9b2d-ef91-4f98-9030-4e47b55d0285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:45.024170 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-c22c9b2d-ef91-4f98-9030-4e47b55d0285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:24:45.025743 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1188/2393] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:24:44 2022] DELETE /identity/v3/projects/0346fba997354f5883163338db84ff45 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:24:45.031014 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409ba7f-f272-4956-8898-5feeeb02204c None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:45.031380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409ba7f-f272-4956-8898-5feeeb02204c None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:45.031734 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409ba7f-f272-4956-8898-5feeeb02204c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:45.060205 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-f409ba7f-f272-4956-8898-5feeeb02204c None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:24:45.061595 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-f409ba7f-f272-4956-8898-5feeeb02204c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:45.076775 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:24:45.142764 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1206/2394] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:24:45.151070 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb94c09-51a1-4615-b81a-433da3a7da1d None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:45.151931 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb94c09-51a1-4615-b81a-433da3a7da1d None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:45.152214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb94c09-51a1-4615-b81a-433da3a7da1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:45.174972 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-2cb94c09-51a1-4615-b81a-433da3a7da1d None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:24:45.176523 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-2cb94c09-51a1-4615-b81a-433da3a7da1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:45.186005 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1189/2395] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:24:45.191250 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409ba7f-f272-4956-8898-5feeeb02204c None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:45.205699 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409ba7f-f272-4956-8898-5feeeb02204c None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:45.218258 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce03a2-66e7-4236-97c6-ab7cf3973792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:45.219281 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce03a2-66e7-4236-97c6-ab7cf3973792 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:45.219543 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce03a2-66e7-4236-97c6-ab7cf3973792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:45.222181 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce03a2-66e7-4236-97c6-ab7cf3973792 admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:45.222181 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce03a2-66e7-4236-97c6-ab7cf3973792 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:24:45.222181 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce03a2-66e7-4236-97c6-ab7cf3973792 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:45.229372 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce03a2-66e7-4236-97c6-ab7cf3973792 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:45.250336 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1207/2396] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:24:45.252309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb94c09-51a1-4615-b81a-433da3a7da1d None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:45.264499 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb94c09-51a1-4615-b81a-433da3a7da1d None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:45.271222 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946eda5c-829b-4156-bf1a-a06c2f4fa4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:45.271836 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946eda5c-829b-4156-bf1a-a06c2f4fa4c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:45.272111 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946eda5c-829b-4156-bf1a-a06c2f4fa4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:45.272558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946eda5c-829b-4156-bf1a-a06c2f4fa4c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:45.273607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946eda5c-829b-4156-bf1a-a06c2f4fa4c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:45.276491 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946eda5c-829b-4156-bf1a-a06c2f4fa4c7 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:45.389802 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1190/2397] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:24:45 2022] POST /identity/v3/projects => generated 369 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:24:45.395933 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce03a2-66e7-4236-97c6-ab7cf3973792 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:45.408417 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce03a2-66e7-4236-97c6-ab7cf3973792 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:45.503198 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999a1a0-e8d7-4251-973d-e533b39de303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:45.504042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999a1a0-e8d7-4251-973d-e533b39de303 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:45.504486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999a1a0-e8d7-4251-973d-e533b39de303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:45.508671 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999a1a0-e8d7-4251-973d-e533b39de303 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:45.508671 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999a1a0-e8d7-4251-973d-e533b39de303 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:45.508671 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999a1a0-e8d7-4251-973d-e533b39de303 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:45.599016 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1208/2398] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:24:45 2022] POST /identity/v3/users => generated 285 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:24:45.602773 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946eda5c-829b-4156-bf1a-a06c2f4fa4c7 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:45.613473 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946eda5c-829b-4156-bf1a-a06c2f4fa4c7 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:45.618813 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26567d-50df-48a7-b4f7-db3f0ed7dc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:45.619532 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26567d-50df-48a7-b4f7-db3f0ed7dc2f admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:45.619875 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26567d-50df-48a7-b4f7-db3f0ed7dc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:45.623304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26567d-50df-48a7-b4f7-db3f0ed7dc2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:45.623304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26567d-50df-48a7-b4f7-db3f0ed7dc2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:45.623304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26567d-50df-48a7-b4f7-db3f0ed7dc2f admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:45.635896 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1191/2399] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:24:45.640044 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999a1a0-e8d7-4251-973d-e533b39de303 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:45.654925 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999a1a0-e8d7-4251-973d-e533b39de303 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:45.662551 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ab90a-ecf4-45f7-ac83-33425a7f5394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:45.663359 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ab90a-ecf4-45f7-ac83-33425a7f5394 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:45.663746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ab90a-ecf4-45f7-ac83-33425a7f5394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:45.664121 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ab90a-ecf4-45f7-ac83-33425a7f5394 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:45.664878 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ab90a-ecf4-45f7-ac83-33425a7f5394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:45.666937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ab90a-ecf4-45f7-ac83-33425a7f5394 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:45.679029 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1209/2400] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:24:45.683483 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26567d-50df-48a7-b4f7-db3f0ed7dc2f admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:45.693628 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26567d-50df-48a7-b4f7-db3f0ed7dc2f admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:45.698216 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992420cc-f259-4a7e-a5bb-e579ded18b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:45.698911 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992420cc-f259-4a7e-a5bb-e579ded18b78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:45.699182 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992420cc-f259-4a7e-a5bb-e579ded18b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:45.699460 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992420cc-f259-4a7e-a5bb-e579ded18b78 admin admin] PATH_INFO: `/v3/projects/13f6f9a422684205b260bdfa85135360/users/39f6a4a546814e30911dc29574b5f04f/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:45.715713 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992420cc-f259-4a7e-a5bb-e579ded18b78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13f6f9a422684205b260bdfa85135360, user_id=39f6a4a546814e30911dc29574b5f04f, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:45.718421 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992420cc-f259-4a7e-a5bb-e579ded18b78 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:45.789152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1192/2401] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:24:45 2022] PUT /identity/v3/projects/13f6f9a422684205b260bdfa85135360/users/39f6a4a546814e30911dc29574b5f04f/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:24:45.801275 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bfa21-020e-49c9-ae7f-72c5e5a75613 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:45.801763 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bfa21-020e-49c9-ae7f-72c5e5a75613 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:45.801861 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bfa21-020e-49c9-ae7f-72c5e5a75613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:45.834481 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-ea9bfa21-020e-49c9-ae7f-72c5e5a75613 None None] MFA Rules not processed for user `39f6a4a546814e30911dc29574b5f04f`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:24:45.835881 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-ea9bfa21-020e-49c9-ae7f-72c5e5a75613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:45.941084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1210/2402] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:24:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:24:45.953539 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992420cc-f259-4a7e-a5bb-e579ded18b78 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:24:45.957406 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-992420cc-f259-4a7e-a5bb-e579ded18b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:24:46.057516 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992420cc-f259-4a7e-a5bb-e579ded18b78 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:24:46.064281 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533d1f6-ec21-4da1-9927-ecf639990096 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f4ee9c3c5be48699a24dfce9b30bda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:24:46.065135 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533d1f6-ec21-4da1-9927-ecf639990096 service glance] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:24:46.065624 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533d1f6-ec21-4da1-9927-ecf639990096 service glance] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:24:46.066086 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533d1f6-ec21-4da1-9927-ecf639990096 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:24:46.076842 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533d1f6-ec21-4da1-9927-ecf639990096 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:24:46.078326 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533d1f6-ec21-4da1-9927-ecf639990096 service glance] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:24:46.091786 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1193/2403] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:24:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:24:55.937065 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=91,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:24:56.086137 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:DELETE=7,keystone:SELECT=68,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:25:07.448365 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38c34c-2d5e-43d3-9991-4b2c761f8f56 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:25:07.448876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38c34c-2d5e-43d3-9991-4b2c761f8f56 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:25:07.448975 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38c34c-2d5e-43d3-9991-4b2c761f8f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:25:07.467846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-de38c34c-2d5e-43d3-9991-4b2c761f8f56 None None] MFA Rules not processed for user `970300b51d504a2bbc48158855f02f34`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:25:07.469040 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-de38c34c-2d5e-43d3-9991-4b2c761f8f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:25:07.531353 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1211/2404] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 23 08:25:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:25:07.543680 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533d1f6-ec21-4da1-9927-ecf639990096 service glance] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:25:07.549543 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-8533d1f6-ec21-4da1-9927-ecf639990096 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:25:07.621285 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533d1f6-ec21-4da1-9927-ecf639990096 service glance] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:25:07.627076 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64b21e-b98c-4e66-96b8-55ccd2ed095c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4718cad0c0b9461d9c4152d7ea4b385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:25:07.627990 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64b21e-b98c-4e66-96b8-55ccd2ed095c service swift] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:25:07.628668 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64b21e-b98c-4e66-96b8-55ccd2ed095c service swift] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:25:07.628947 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64b21e-b98c-4e66-96b8-55ccd2ed095c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:25:07.637602 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64b21e-b98c-4e66-96b8-55ccd2ed095c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:25:07.644181 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64b21e-b98c-4e66-96b8-55ccd2ed095c service swift] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:25:07.653375 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1194/2405] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 23 08:25:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 08:25:17.524509 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=28 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:25:17.646181 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=32 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:25:21.232237 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38c34c-2d5e-43d3-9991-4b2c761f8f56 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:25:21.295079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38c34c-2d5e-43d3-9991-4b2c761f8f56 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:25:21.299609 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd59f3f-d11d-4a6d-bd68-5b45bdf22264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:25:21.300228 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd59f3f-d11d-4a6d-bd68-5b45bdf22264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:25:21.300505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd59f3f-d11d-4a6d-bd68-5b45bdf22264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:25:21.305264 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd59f3f-d11d-4a6d-bd68-5b45bdf22264 admin admin] PATH_INFO: `/v3/users/39f6a4a546814e30911dc29574b5f04f` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:25:21.305264 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd59f3f-d11d-4a6d-bd68-5b45bdf22264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39f6a4a546814e30911dc29574b5f04f)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:25:21.305264 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd59f3f-d11d-4a6d-bd68-5b45bdf22264 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:25:21.492694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-3dd59f3f-d11d-4a6d-bd68-5b45bdf22264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39f6a4a546814e30911dc29574b5f04f'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:25:21.493382 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-3dd59f3f-d11d-4a6d-bd68-5b45bdf22264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39f6a4a546814e30911dc29574b5f04f'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:25:21.493987 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-3dd59f3f-d11d-4a6d-bd68-5b45bdf22264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39f6a4a546814e30911dc29574b5f04f'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:25:21.565621 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-3dd59f3f-d11d-4a6d-bd68-5b45bdf22264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39f6a4a546814e30911dc29574b5f04f'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:25:21.585242 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-3dd59f3f-d11d-4a6d-bd68-5b45bdf22264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39f6a4a546814e30911dc29574b5f04f'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:25:21.595000 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1212/2406] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:25:21 2022] DELETE /identity/v3/users/39f6a4a546814e30911dc29574b5f04f => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:25:21.599670 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348f706-b39e-4489-8726-c6d3be6b4090 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:25:21.600176 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348f706-b39e-4489-8726-c6d3be6b4090 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:25:21.600442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348f706-b39e-4489-8726-c6d3be6b4090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:25:21.619703 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-b348f706-b39e-4489-8726-c6d3be6b4090 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:25:21.621017 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-b348f706-b39e-4489-8726-c6d3be6b4090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:25:21.684092 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1195/2407] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:25:21.694687 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd59f3f-d11d-4a6d-bd68-5b45bdf22264 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:25:21.696154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-3dd59f3f-d11d-4a6d-bd68-5b45bdf22264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:25:21.756082 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd59f3f-d11d-4a6d-bd68-5b45bdf22264 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:25:21.759660 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9970f7c-2c0b-43cd-a861-bc41d4c2fa2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:25:21.760260 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9970f7c-2c0b-43cd-a861-bc41d4c2fa2c service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:25:21.760540 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9970f7c-2c0b-43cd-a861-bc41d4c2fa2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:25:21.760813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9970f7c-2c0b-43cd-a861-bc41d4c2fa2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:25:21.769487 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9970f7c-2c0b-43cd-a861-bc41d4c2fa2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:25:21.771471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9970f7c-2c0b-43cd-a861-bc41d4c2fa2c service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:25:21.780855 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1213/2408] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:25:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:25:22.173166 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348f706-b39e-4489-8726-c6d3be6b4090 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:25:22.177752 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-b348f706-b39e-4489-8726-c6d3be6b4090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:25:22.187861 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348f706-b39e-4489-8726-c6d3be6b4090 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:25:22.192648 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da866d9-09e4-47e9-bc22-099493a840a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:25:22.193334 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da866d9-09e4-47e9-bc22-099493a840a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:25:22.193589 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da866d9-09e4-47e9-bc22-099493a840a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:25:22.193889 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da866d9-09e4-47e9-bc22-099493a840a3 admin admin] PATH_INFO: `/v3/projects/13f6f9a422684205b260bdfa85135360` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:25:22.195039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da866d9-09e4-47e9-bc22-099493a840a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13f6f9a422684205b260bdfa85135360)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:25:22.196966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da866d9-09e4-47e9-bc22-099493a840a3 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:25:22.310055 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-9da866d9-09e4-47e9-bc22-099493a840a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13f6f9a422684205b260bdfa85135360', 'request_id': 'req-9da866d9-09e4-47e9-bc22-099493a840a3'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:25:22.315425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-9da866d9-09e4-47e9-bc22-099493a840a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13f6f9a422684205b260bdfa85135360', 'request_id': 'req-9da866d9-09e4-47e9-bc22-099493a840a3'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:25:22.321600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-9da866d9-09e4-47e9-bc22-099493a840a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13f6f9a422684205b260bdfa85135360', 'request_id': 'req-9da866d9-09e4-47e9-bc22-099493a840a3'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:25:22.405148 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-9da866d9-09e4-47e9-bc22-099493a840a3 admin admin] The token cache is being invalidate because project 13f6f9a422684205b260bdfa85135360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:25:22.405441 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-9da866d9-09e4-47e9-bc22-099493a840a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:25:22.406082 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-9da866d9-09e4-47e9-bc22-099493a840a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:25:22.407630 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1196/2409] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:25:22 2022] DELETE /identity/v3/projects/13f6f9a422684205b260bdfa85135360 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:25:22.412733 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c563471-4900-4c98-a9ec-360c6bec8935 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:25:22.418943 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c563471-4900-4c98-a9ec-360c6bec8935 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:25:22.418943 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c563471-4900-4c98-a9ec-360c6bec8935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:25:22.433573 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-0c563471-4900-4c98-a9ec-360c6bec8935 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:25:22.435060 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-0c563471-4900-4c98-a9ec-360c6bec8935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:25:22.452277 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:25:22.494437 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1214/2410] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:25:22.502592 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70599796-8fea-416a-a66c-ef7f1bd8c5e7 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:25:22.502881 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70599796-8fea-416a-a66c-ef7f1bd8c5e7 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:25:22.503160 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70599796-8fea-416a-a66c-ef7f1bd8c5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:25:22.524041 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-70599796-8fea-416a-a66c-ef7f1bd8c5e7 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:25:22.525407 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-70599796-8fea-416a-a66c-ef7f1bd8c5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:25:22.533701 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1197/2411] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:25:22.538699 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c563471-4900-4c98-a9ec-360c6bec8935 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:25:22.548258 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c563471-4900-4c98-a9ec-360c6bec8935 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:25:22.552937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cef1e-7e2d-4a6f-a6c0-fc2338843103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:25:22.553527 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cef1e-7e2d-4a6f-a6c0-fc2338843103 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:25:22.553808 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cef1e-7e2d-4a6f-a6c0-fc2338843103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:25:22.554080 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cef1e-7e2d-4a6f-a6c0-fc2338843103 admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:25:22.554753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cef1e-7e2d-4a6f-a6c0-fc2338843103 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:25:22.555056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cef1e-7e2d-4a6f-a6c0-fc2338843103 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:25:22.556661 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cef1e-7e2d-4a6f-a6c0-fc2338843103 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:25:22.568312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1215/2412] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:25:22.578349 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70599796-8fea-416a-a66c-ef7f1bd8c5e7 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:25:22.588290 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70599796-8fea-416a-a66c-ef7f1bd8c5e7 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:25:22.592929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf1fa6-d163-46ae-ba63-ffb7bee60130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:25:22.593570 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf1fa6-d163-46ae-ba63-ffb7bee60130 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:25:22.593852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf1fa6-d163-46ae-ba63-ffb7bee60130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:25:22.594124 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf1fa6-d163-46ae-ba63-ffb7bee60130 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:25:22.594839 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf1fa6-d163-46ae-ba63-ffb7bee60130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:25:22.596727 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf1fa6-d163-46ae-ba63-ffb7bee60130 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:25:22.705239 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1198/2413] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:25:22 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:25:22.710251 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cef1e-7e2d-4a6f-a6c0-fc2338843103 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:25:22.720318 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cef1e-7e2d-4a6f-a6c0-fc2338843103 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:25:22.784643 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a63e0b-0d9b-49e1-aa8b-bea43c667294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:25:22.785408 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a63e0b-0d9b-49e1-aa8b-bea43c667294 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:25:22.785811 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a63e0b-0d9b-49e1-aa8b-bea43c667294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:25:22.786222 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a63e0b-0d9b-49e1-aa8b-bea43c667294 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:25:22.786877 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a63e0b-0d9b-49e1-aa8b-bea43c667294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:25:22.788824 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a63e0b-0d9b-49e1-aa8b-bea43c667294 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:25:22.887423 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1216/2414] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:25:22 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:25:22.891761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf1fa6-d163-46ae-ba63-ffb7bee60130 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:25:22.904844 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf1fa6-d163-46ae-ba63-ffb7bee60130 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:25:22.907771 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f22d3-857e-487b-abc4-91ef4a91229e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:25:22.908367 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f22d3-857e-487b-abc4-91ef4a91229e admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:25:22.908648 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f22d3-857e-487b-abc4-91ef4a91229e admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:25:22.908924 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f22d3-857e-487b-abc4-91ef4a91229e admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:25:22.909563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f22d3-857e-487b-abc4-91ef4a91229e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:25:22.911749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f22d3-857e-487b-abc4-91ef4a91229e admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:25:22.923355 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1199/2415] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:25:22.927302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a63e0b-0d9b-49e1-aa8b-bea43c667294 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:25:22.937557 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a63e0b-0d9b-49e1-aa8b-bea43c667294 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:25:22.942188 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb9309-017e-464d-b7b3-9cea012a0165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:25:22.943421 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb9309-017e-464d-b7b3-9cea012a0165 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:25:22.943725 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb9309-017e-464d-b7b3-9cea012a0165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:25:22.944000 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb9309-017e-464d-b7b3-9cea012a0165 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:25:22.944639 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb9309-017e-464d-b7b3-9cea012a0165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:25:22.946346 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb9309-017e-464d-b7b3-9cea012a0165 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:25:22.957030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1217/2416] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:25:22.961794 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f22d3-857e-487b-abc4-91ef4a91229e admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:25:22.971641 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f22d3-857e-487b-abc4-91ef4a91229e admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:25:22.976364 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b80e5-a1f2-4c1b-aa0c-905b16e8ba5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:25:22.979465 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b80e5-a1f2-4c1b-aa0c-905b16e8ba5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:25:22.979465 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b80e5-a1f2-4c1b-aa0c-905b16e8ba5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:25:22.979465 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b80e5-a1f2-4c1b-aa0c-905b16e8ba5b admin admin] PATH_INFO: `/v3/projects/805b12556a234d1dac857071f9fef0fd/users/bd71e04b0f0f442083a37e436bccb596/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:25:22.996856 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b80e5-a1f2-4c1b-aa0c-905b16e8ba5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=805b12556a234d1dac857071f9fef0fd, user_id=bd71e04b0f0f442083a37e436bccb596, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:25:22.999694 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b80e5-a1f2-4c1b-aa0c-905b16e8ba5b admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:25:23.098700 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1200/2417] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:25:22 2022] PUT /identity/v3/projects/805b12556a234d1dac857071f9fef0fd/users/bd71e04b0f0f442083a37e436bccb596/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:25:23.109946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26467d7-f301-4a01-bb42-5b1c14f23007 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:25:23.110467 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26467d7-f301-4a01-bb42-5b1c14f23007 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:25:23.110964 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26467d7-f301-4a01-bb42-5b1c14f23007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:25:23.152873 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-b26467d7-f301-4a01-bb42-5b1c14f23007 None None] MFA Rules not processed for user `bd71e04b0f0f442083a37e436bccb596`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:25:23.154175 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-b26467d7-f301-4a01-bb42-5b1c14f23007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:25:23.232541 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1218/2418] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:25:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:25:23.247503 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b80e5-a1f2-4c1b-aa0c-905b16e8ba5b admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:25:23.248736 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-ec9b80e5-a1f2-4c1b-aa0c-905b16e8ba5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:25:23.274440 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:25:23.313636 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b80e5-a1f2-4c1b-aa0c-905b16e8ba5b admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:25:23.318686 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e353e4-983f-4033-b21d-3716278aa2ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:25:23.321857 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e353e4-983f-4033-b21d-3716278aa2ef service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:25:23.321857 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e353e4-983f-4033-b21d-3716278aa2ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:25:23.321857 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e353e4-983f-4033-b21d-3716278aa2ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:25:23.329560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e353e4-983f-4033-b21d-3716278aa2ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:25:23.331061 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e353e4-983f-4033-b21d-3716278aa2ef service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:25:23.341193 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1201/2419] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:25:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:25:27.371039 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc635986-6e4e-4376-86a1-ebd99ba83573 None None] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:25:27.371586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc635986-6e4e-4376-86a1-ebd99ba83573 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:25:27.371821 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc635986-6e4e-4376-86a1-ebd99ba83573 None None] PATH_INFO: `/` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:25:27.373319 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1219/2420] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 23 08:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:25:27.380566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe7d1c-ca65-4e38-8f89-1ae7adb2f9a9 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:25:27.381743 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe7d1c-ca65-4e38-8f89-1ae7adb2f9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:25:27.382324 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe7d1c-ca65-4e38-8f89-1ae7adb2f9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:25:27.403529 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-abbe7d1c-ca65-4e38-8f89-1ae7adb2f9a9 None None] MFA Rules not processed for user `4239cee14f954e95b4a6b0af2e8799b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:25:27.405035 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-abbe7d1c-ca65-4e38-8f89-1ae7adb2f9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:25:27.462220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1202/2421] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 23 08:25:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:25:27.474797 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc635986-6e4e-4376-86a1-ebd99ba83573 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:25:27.476478 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-fc635986-6e4e-4376-86a1-ebd99ba83573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:25:27.490215 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc635986-6e4e-4376-86a1-ebd99ba83573 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:25:27.494198 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17f396-54d7-4676-a9f0-4593503b4728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:25:27.494463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17f396-54d7-4676-a9f0-4593503b4728 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:25:27.494696 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17f396-54d7-4676-a9f0-4593503b4728 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:25:27.494967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17f396-54d7-4676-a9f0-4593503b4728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:25:27.502334 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17f396-54d7-4676-a9f0-4593503b4728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:25:27.503770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17f396-54d7-4676-a9f0-4593503b4728 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:25:27.512127 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1220/2422] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:25:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:25:27.595216 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1157c-238e-487f-8a51-6c91a89c81fa None None] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:25:27.595505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1157c-238e-487f-8a51-6c91a89c81fa None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:25:27.595780 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1157c-238e-487f-8a51-6c91a89c81fa None None] PATH_INFO: `/` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:25:27.597131 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1203/2423] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 23 08:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 08:25:27.603398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d4dcb-9df8-4538-9948-9cf5666f885b None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:25:27.603687 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d4dcb-9df8-4538-9948-9cf5666f885b None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:25:27.603961 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d4dcb-9df8-4538-9948-9cf5666f885b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:25:27.613027 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:25:27.636720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-5d2d4dcb-9df8-4538-9948-9cf5666f885b None None] MFA Rules not processed for user `b5c55e5c1cea47f29d378ea457384a31`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:25:27.637968 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-5d2d4dcb-9df8-4538-9948-9cf5666f885b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:25:27.687015 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1157c-238e-487f-8a51-6c91a89c81fa None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:25:27.735533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1221/2424] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 23 08:25:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:25:27.746874 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d4dcb-9df8-4538-9948-9cf5666f885b None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:25:27.752433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1157c-238e-487f-8a51-6c91a89c81fa None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:25:27.755907 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d4dcb-9df8-4538-9948-9cf5666f885b None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:25:27.757748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4229a-493d-4026-8ab0-e378de10b81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:25:27.758405 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4229a-493d-4026-8ab0-e378de10b81b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:25:27.758684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4229a-493d-4026-8ab0-e378de10b81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:25:27.758953 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4229a-493d-4026-8ab0-e378de10b81b admin admin] PATH_INFO: `/v3/users/bd71e04b0f0f442083a37e436bccb596` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:25:27.759636 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd29ab-51c7-4d42-8671-9d4ece02b798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:25:27.760080 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4229a-493d-4026-8ab0-e378de10b81b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd71e04b0f0f442083a37e436bccb596)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:25:27.760231 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd29ab-51c7-4d42-8671-9d4ece02b798 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:25:27.760514 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd29ab-51c7-4d42-8671-9d4ece02b798 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:25:27.760791 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd29ab-51c7-4d42-8671-9d4ece02b798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:25:27.762000 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4229a-493d-4026-8ab0-e378de10b81b admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:25:27.771892 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd29ab-51c7-4d42-8671-9d4ece02b798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:25:27.773659 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd29ab-51c7-4d42-8671-9d4ece02b798 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:25:27.784259 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1222/2425] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:25:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:25:27.957637 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-b0f4229a-493d-4026-8ab0-e378de10b81b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd71e04b0f0f442083a37e436bccb596'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:25:27.958948 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-b0f4229a-493d-4026-8ab0-e378de10b81b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd71e04b0f0f442083a37e436bccb596'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:25:27.959710 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-b0f4229a-493d-4026-8ab0-e378de10b81b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd71e04b0f0f442083a37e436bccb596'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:25:28.052123 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-b0f4229a-493d-4026-8ab0-e378de10b81b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd71e04b0f0f442083a37e436bccb596'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:25:28.059921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-b0f4229a-493d-4026-8ab0-e378de10b81b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd71e04b0f0f442083a37e436bccb596'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:25:28.068334 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:25:28.077738 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1204/2426] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:25:27 2022] DELETE /identity/v3/users/bd71e04b0f0f442083a37e436bccb596 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:25:28.082372 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe2fd7-54a4-4cf6-a0ac-d72ae8277a97 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:25:28.082672 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe2fd7-54a4-4cf6-a0ac-d72ae8277a97 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:25:28.082947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe2fd7-54a4-4cf6-a0ac-d72ae8277a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:25:28.102554 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-07fe2fd7-54a4-4cf6-a0ac-d72ae8277a97 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:25:28.103838 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-07fe2fd7-54a4-4cf6-a0ac-d72ae8277a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:25:28.162792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1223/2427] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:25:28.175411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4229a-493d-4026-8ab0-e378de10b81b admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:25:28.176973 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-b0f4229a-493d-4026-8ab0-e378de10b81b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:25:28.242374 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4229a-493d-4026-8ab0-e378de10b81b admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:25:28.245921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9402a996-66c2-43c3-9214-25251700a504 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:25:28.246561 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402a996-66c2-43c3-9214-25251700a504 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:25:28.246842 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402a996-66c2-43c3-9214-25251700a504 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:25:28.247115 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402a996-66c2-43c3-9214-25251700a504 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:25:28.256956 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9402a996-66c2-43c3-9214-25251700a504 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:25:28.258407 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9402a996-66c2-43c3-9214-25251700a504 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:25:28.268157 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1205/2428] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:25:28.959907 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe2fd7-54a4-4cf6-a0ac-d72ae8277a97 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:25:28.959907 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-07fe2fd7-54a4-4cf6-a0ac-d72ae8277a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:25:28.960954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21974022-69b5-4877-98f1-8e01c2c28df7 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:25:28.960954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21974022-69b5-4877-98f1-8e01c2c28df7 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:25:28.960954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21974022-69b5-4877-98f1-8e01c2c28df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:25:28.965329 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe2fd7-54a4-4cf6-a0ac-d72ae8277a97 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:25:28.970269 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c9258-9cc9-4a23-98aa-d14bcab8d3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:25:28.970988 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c9258-9cc9-4a23-98aa-d14bcab8d3c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:25:28.971325 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c9258-9cc9-4a23-98aa-d14bcab8d3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:25:28.971526 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c9258-9cc9-4a23-98aa-d14bcab8d3c0 admin admin] PATH_INFO: `/v3/projects/805b12556a234d1dac857071f9fef0fd` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:25:28.972678 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c9258-9cc9-4a23-98aa-d14bcab8d3c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=805b12556a234d1dac857071f9fef0fd)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:25:28.975392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c9258-9cc9-4a23-98aa-d14bcab8d3c0 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:25:28.988109 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-21974022-69b5-4877-98f1-8e01c2c28df7 None None] MFA Rules not processed for user `970300b51d504a2bbc48158855f02f34`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:25:28.989479 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-21974022-69b5-4877-98f1-8e01c2c28df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:25:29.047279 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1206/2429] 10.222.0.57 () {58 vars in 967 bytes} [Tue Aug 23 08:25:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:25:29.060683 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21974022-69b5-4877-98f1-8e01c2c28df7 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:25:29.062637 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-21974022-69b5-4877-98f1-8e01c2c28df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:25:29.099024 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9b0c9258-9cc9-4a23-98aa-d14bcab8d3c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '805b12556a234d1dac857071f9fef0fd', 'request_id': 'req-9b0c9258-9cc9-4a23-98aa-d14bcab8d3c0'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:25:29.105605 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9b0c9258-9cc9-4a23-98aa-d14bcab8d3c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '805b12556a234d1dac857071f9fef0fd', 'request_id': 'req-9b0c9258-9cc9-4a23-98aa-d14bcab8d3c0'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:25:29.106833 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:25:29.112381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9b0c9258-9cc9-4a23-98aa-d14bcab8d3c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '805b12556a234d1dac857071f9fef0fd', 'request_id': 'req-9b0c9258-9cc9-4a23-98aa-d14bcab8d3c0'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:25:29.135008 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21974022-69b5-4877-98f1-8e01c2c28df7 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:25:29.175930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:25:29.195716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8ef0d-2a4d-4d61-89d8-e9ed59ef053c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4718cad0c0b9461d9c4152d7ea4b385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:25:29.199317 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8ef0d-2a4d-4d61-89d8-e9ed59ef053c service swift] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:25:29.199317 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8ef0d-2a4d-4d61-89d8-e9ed59ef053c service swift] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:25:29.199317 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8ef0d-2a4d-4d61-89d8-e9ed59ef053c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:25:29.223210 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9b0c9258-9cc9-4a23-98aa-d14bcab8d3c0 admin admin] The token cache is being invalidate because project 805b12556a234d1dac857071f9fef0fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:25:29.223466 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9b0c9258-9cc9-4a23-98aa-d14bcab8d3c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:25:29.224723 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9b0c9258-9cc9-4a23-98aa-d14bcab8d3c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:25:29.227609 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1224/2430] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:25:28 2022] DELETE /identity/v3/projects/805b12556a234d1dac857071f9fef0fd => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:25:29.257059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8ef0d-2a4d-4d61-89d8-e9ed59ef053c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:25:29.258759 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8ef0d-2a4d-4d61-89d8-e9ed59ef053c service swift] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:25:29.268181 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1207/2431] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 23 08:25:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 08:25:39.343441 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=4,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:25:39.433456 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=35 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:14.852025 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c9258-9cc9-4a23-98aa-d14bcab8d3c0 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:14.853340 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-9b0c9258-9cc9-4a23-98aa-d14bcab8d3c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:14.959210 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c9258-9cc9-4a23-98aa-d14bcab8d3c0 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:14.964938 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e4444-8017-42cf-aad7-76397a3d0012 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e92560dd9da4c7cbcac5a84bcaca483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:14.965636 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e4444-8017-42cf-aad7-76397a3d0012 service placement] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:14.965932 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e4444-8017-42cf-aad7-76397a3d0012 service placement] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:14.966213 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e4444-8017-42cf-aad7-76397a3d0012 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:14.971757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-968e4444-8017-42cf-aad7-76397a3d0012 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:14.984443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e4444-8017-42cf-aad7-76397a3d0012 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:14.986039 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e4444-8017-42cf-aad7-76397a3d0012 service placement] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:14.998030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1225/2432] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:26:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:26:22.050330 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8ef0d-2a4d-4d61-89d8-e9ed59ef053c service swift] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:22.106944 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8ef0d-2a4d-4d61-89d8-e9ed59ef053c service swift] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:22.110480 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3058db-6990-44a2-afc7-1c1c8cf372dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:22.111086 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3058db-6990-44a2-afc7-1c1c8cf372dc service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:22.111370 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3058db-6990-44a2-afc7-1c1c8cf372dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:22.111637 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3058db-6990-44a2-afc7-1c1c8cf372dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:22.113358 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-1d3058db-6990-44a2-afc7-1c1c8cf372dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:22.183539 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3058db-6990-44a2-afc7-1c1c8cf372dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:22.183539 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3058db-6990-44a2-afc7-1c1c8cf372dc service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:22.191232 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1208/2433] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:26:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:26:24.993070 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=41 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:25.963895 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e4444-8017-42cf-aad7-76397a3d0012 service placement] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:25.964159 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-968e4444-8017-42cf-aad7-76397a3d0012 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:25.978958 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e4444-8017-42cf-aad7-76397a3d0012 service placement] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:25.983532 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ef18d-0f18-4590-bcd7-fed0f9ee7fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:25.984806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ef18d-0f18-4590-bcd7-fed0f9ee7fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:25.985157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ef18d-0f18-4590-bcd7-fed0f9ee7fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:25.985432 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ef18d-0f18-4590-bcd7-fed0f9ee7fac admin admin] PATH_INFO: `/v3/users/a7d7c99fd9e842bdaf539186f7aa0492` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:25.986601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ef18d-0f18-4590-bcd7-fed0f9ee7fac admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7d7c99fd9e842bdaf539186f7aa0492)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:25.988577 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ef18d-0f18-4590-bcd7-fed0f9ee7fac admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:26.182357 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-800ef18d-0f18-4590-bcd7-fed0f9ee7fac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7d7c99fd9e842bdaf539186f7aa0492'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:26.183728 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-800ef18d-0f18-4590-bcd7-fed0f9ee7fac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7d7c99fd9e842bdaf539186f7aa0492'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:26.184340 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-800ef18d-0f18-4590-bcd7-fed0f9ee7fac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7d7c99fd9e842bdaf539186f7aa0492'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:26.259232 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-800ef18d-0f18-4590-bcd7-fed0f9ee7fac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7d7c99fd9e842bdaf539186f7aa0492'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:26.272170 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-800ef18d-0f18-4590-bcd7-fed0f9ee7fac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7d7c99fd9e842bdaf539186f7aa0492'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:26.284355 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1226/2434] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:26:25 2022] DELETE /identity/v3/users/a7d7c99fd9e842bdaf539186f7aa0492 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:26:26.603019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3058db-6990-44a2-afc7-1c1c8cf372dc service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:26.614417 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3058db-6990-44a2-afc7-1c1c8cf372dc service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:26.674495 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720b6a7-be39-48b5-a278-22e5456447bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:26.675128 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720b6a7-be39-48b5-a278-22e5456447bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:26.675405 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720b6a7-be39-48b5-a278-22e5456447bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:26.675675 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720b6a7-be39-48b5-a278-22e5456447bc admin admin] PATH_INFO: `/v3/projects/f133163cd74e4517b36716642bc5a22d` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:26.676773 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720b6a7-be39-48b5-a278-22e5456447bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f133163cd74e4517b36716642bc5a22d)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:26.678913 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720b6a7-be39-48b5-a278-22e5456447bc admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:26.795491 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-4720b6a7-be39-48b5-a278-22e5456447bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f133163cd74e4517b36716642bc5a22d', 'request_id': 'req-4720b6a7-be39-48b5-a278-22e5456447bc'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:26.798112 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:26.801801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-4720b6a7-be39-48b5-a278-22e5456447bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f133163cd74e4517b36716642bc5a22d', 'request_id': 'req-4720b6a7-be39-48b5-a278-22e5456447bc'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:26.807948 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-4720b6a7-be39-48b5-a278-22e5456447bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f133163cd74e4517b36716642bc5a22d', 'request_id': 'req-4720b6a7-be39-48b5-a278-22e5456447bc'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:26.856430 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-4720b6a7-be39-48b5-a278-22e5456447bc admin admin] The token cache is being invalidate because project f133163cd74e4517b36716642bc5a22d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:26:26.856913 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-4720b6a7-be39-48b5-a278-22e5456447bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:26.857539 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-4720b6a7-be39-48b5-a278-22e5456447bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:26.859684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1209/2435] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:26:26 2022] DELETE /identity/v3/projects/f133163cd74e4517b36716642bc5a22d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:26:26.864873 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98947957-390e-4871-b3e1-8ced6c73bbbd None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:26.866829 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98947957-390e-4871-b3e1-8ced6c73bbbd None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:26.866829 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98947957-390e-4871-b3e1-8ced6c73bbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:26.885732 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-98947957-390e-4871-b3e1-8ced6c73bbbd None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:26.886940 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-98947957-390e-4871-b3e1-8ced6c73bbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:26.947084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1227/2436] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:26:26.955849 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3b14f-31bc-4a76-9118-5c4c0d8c2a8d None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:26.956129 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3b14f-31bc-4a76-9118-5c4c0d8c2a8d None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:26.956401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3b14f-31bc-4a76-9118-5c4c0d8c2a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:26.976462 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-fbe3b14f-31bc-4a76-9118-5c4c0d8c2a8d None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:26.977665 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-fbe3b14f-31bc-4a76-9118-5c4c0d8c2a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:26.986512 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1210/2437] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:26:26.990886 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98947957-390e-4871-b3e1-8ced6c73bbbd None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:27.001340 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98947957-390e-4871-b3e1-8ced6c73bbbd None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:27.005906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db40305-41c2-4035-9df0-cf725ec9032a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:27.006550 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db40305-41c2-4035-9df0-cf725ec9032a admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:27.006832 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db40305-41c2-4035-9df0-cf725ec9032a admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:27.007105 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db40305-41c2-4035-9df0-cf725ec9032a admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:27.007749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db40305-41c2-4035-9df0-cf725ec9032a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:26:27.008048 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db40305-41c2-4035-9df0-cf725ec9032a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:27.009640 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db40305-41c2-4035-9df0-cf725ec9032a admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:27.021045 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1228/2438] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:26:27.025438 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3b14f-31bc-4a76-9118-5c4c0d8c2a8d None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:27.034941 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3b14f-31bc-4a76-9118-5c4c0d8c2a8d None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:27.039624 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd49eb-b1b7-4157-a69b-c68ef5a9e8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:27.040202 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd49eb-b1b7-4157-a69b-c68ef5a9e8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:27.040508 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd49eb-b1b7-4157-a69b-c68ef5a9e8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:27.040808 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd49eb-b1b7-4157-a69b-c68ef5a9e8d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:27.041550 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd49eb-b1b7-4157-a69b-c68ef5a9e8d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:27.043479 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd49eb-b1b7-4157-a69b-c68ef5a9e8d5 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:27.129384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1211/2439] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:26:27 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:26:27.133477 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db40305-41c2-4035-9df0-cf725ec9032a admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:27.144486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db40305-41c2-4035-9df0-cf725ec9032a admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:27.200222 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931aef7e-1376-4d0a-818a-9b6d9f91b406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:27.200873 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931aef7e-1376-4d0a-818a-9b6d9f91b406 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:27.201091 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931aef7e-1376-4d0a-818a-9b6d9f91b406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:27.201368 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931aef7e-1376-4d0a-818a-9b6d9f91b406 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:27.201976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931aef7e-1376-4d0a-818a-9b6d9f91b406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:27.204077 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931aef7e-1376-4d0a-818a-9b6d9f91b406 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:27.211763 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:27.318139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1229/2440] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:26:27 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:26:27.321154 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd49eb-b1b7-4157-a69b-c68ef5a9e8d5 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:27.332238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd49eb-b1b7-4157-a69b-c68ef5a9e8d5 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:27.337334 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7732e-20e1-4abf-af38-638f92d48609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:27.338008 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7732e-20e1-4abf-af38-638f92d48609 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:27.338391 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7732e-20e1-4abf-af38-638f92d48609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:27.338732 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7732e-20e1-4abf-af38-638f92d48609 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:27.339455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7732e-20e1-4abf-af38-638f92d48609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:27.341248 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7732e-20e1-4abf-af38-638f92d48609 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:27.355744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1212/2441] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:26:27.356914 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931aef7e-1376-4d0a-818a-9b6d9f91b406 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:27.367717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931aef7e-1376-4d0a-818a-9b6d9f91b406 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:27.372439 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751ff3c-b9fc-4c7e-a2c8-8ebb33c911e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:27.373071 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751ff3c-b9fc-4c7e-a2c8-8ebb33c911e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:27.373352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751ff3c-b9fc-4c7e-a2c8-8ebb33c911e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:27.373622 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751ff3c-b9fc-4c7e-a2c8-8ebb33c911e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:27.374265 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0751ff3c-b9fc-4c7e-a2c8-8ebb33c911e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:27.375929 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0751ff3c-b9fc-4c7e-a2c8-8ebb33c911e7 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:27.388193 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1230/2442] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:26:27.391225 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7732e-20e1-4abf-af38-638f92d48609 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:27.401479 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7732e-20e1-4abf-af38-638f92d48609 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:27.406742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499c935-1b25-4c4c-ad56-9514aa90aa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:27.407338 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499c935-1b25-4c4c-ad56-9514aa90aa9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:27.407614 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499c935-1b25-4c4c-ad56-9514aa90aa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:27.407883 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499c935-1b25-4c4c-ad56-9514aa90aa9a admin admin] PATH_INFO: `/v3/projects/a3074bda3dff4420aa9efcef459260d5/users/8c9a88aecb1947a5b1c9b4683173ff33/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:27.422852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499c935-1b25-4c4c-ad56-9514aa90aa9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3074bda3dff4420aa9efcef459260d5, user_id=8c9a88aecb1947a5b1c9b4683173ff33, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:27.425500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499c935-1b25-4c4c-ad56-9514aa90aa9a admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:27.510617 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1213/2443] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:26:27 2022] PUT /identity/v3/projects/a3074bda3dff4420aa9efcef459260d5/users/8c9a88aecb1947a5b1c9b4683173ff33/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:26:27.522652 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044e930-31be-48f7-84de-ab460128ea11 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:27.522938 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044e930-31be-48f7-84de-ab460128ea11 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:27.523213 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044e930-31be-48f7-84de-ab460128ea11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:27.550740 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-f044e930-31be-48f7-84de-ab460128ea11 None None] MFA Rules not processed for user `8c9a88aecb1947a5b1c9b4683173ff33`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:27.551935 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-f044e930-31be-48f7-84de-ab460128ea11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:27.614720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1231/2444] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:26:27.627839 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499c935-1b25-4c4c-ad56-9514aa90aa9a admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:27.629543 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-f499c935-1b25-4c4c-ad56-9514aa90aa9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:27.706816 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499c935-1b25-4c4c-ad56-9514aa90aa9a admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:27.712310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02148d-c79c-4a90-8e14-7faedc937824 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:27.713045 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02148d-c79c-4a90-8e14-7faedc937824 service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:27.713308 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02148d-c79c-4a90-8e14-7faedc937824 service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:27.713584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02148d-c79c-4a90-8e14-7faedc937824 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:27.721158 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02148d-c79c-4a90-8e14-7faedc937824 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:27.722795 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02148d-c79c-4a90-8e14-7faedc937824 service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:27.731394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1214/2445] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:26:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:26:27.945705 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044e930-31be-48f7-84de-ab460128ea11 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:28.007151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044e930-31be-48f7-84de-ab460128ea11 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:28.011977 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e67978-ae36-44fe-8eb5-29ed91b29b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:28.012604 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e67978-ae36-44fe-8eb5-29ed91b29b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:28.012881 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e67978-ae36-44fe-8eb5-29ed91b29b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:28.013180 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e67978-ae36-44fe-8eb5-29ed91b29b5c admin admin] PATH_INFO: `/v3/users/8c9a88aecb1947a5b1c9b4683173ff33` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:28.014330 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e67978-ae36-44fe-8eb5-29ed91b29b5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c9a88aecb1947a5b1c9b4683173ff33)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:28.016246 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e67978-ae36-44fe-8eb5-29ed91b29b5c admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:28.158789 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f8e67978-ae36-44fe-8eb5-29ed91b29b5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c9a88aecb1947a5b1c9b4683173ff33'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:28.159465 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f8e67978-ae36-44fe-8eb5-29ed91b29b5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c9a88aecb1947a5b1c9b4683173ff33'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:28.160139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f8e67978-ae36-44fe-8eb5-29ed91b29b5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c9a88aecb1947a5b1c9b4683173ff33'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:28.217829 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f8e67978-ae36-44fe-8eb5-29ed91b29b5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c9a88aecb1947a5b1c9b4683173ff33'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:28.231164 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:28.232786 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f8e67978-ae36-44fe-8eb5-29ed91b29b5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c9a88aecb1947a5b1c9b4683173ff33'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:28.245802 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1232/2446] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:26:27 2022] DELETE /identity/v3/users/8c9a88aecb1947a5b1c9b4683173ff33 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:26:28.250916 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83e4d6-3840-4dbe-b613-4924fcabe858 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:28.251212 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83e4d6-3840-4dbe-b613-4924fcabe858 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:28.251497 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83e4d6-3840-4dbe-b613-4924fcabe858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:28.271289 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-2c83e4d6-3840-4dbe-b613-4924fcabe858 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:28.272544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-2c83e4d6-3840-4dbe-b613-4924fcabe858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:28.339954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1215/2447] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:26:28.350079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e67978-ae36-44fe-8eb5-29ed91b29b5c admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:28.351817 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-f8e67978-ae36-44fe-8eb5-29ed91b29b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:28.412416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e67978-ae36-44fe-8eb5-29ed91b29b5c admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:28.414849 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cfc83-a998-42df-a849-c9113401c450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:28.416348 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cfc83-a998-42df-a849-c9113401c450 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:28.416348 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cfc83-a998-42df-a849-c9113401c450 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:28.416348 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cfc83-a998-42df-a849-c9113401c450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:28.426922 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13cfc83-a998-42df-a849-c9113401c450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:28.428377 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13cfc83-a998-42df-a849-c9113401c450 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:28.439238 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1233/2448] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:26:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:26:28.843384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83e4d6-3840-4dbe-b613-4924fcabe858 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:28.845338 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-2c83e4d6-3840-4dbe-b613-4924fcabe858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:28.866868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:28.878566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83e4d6-3840-4dbe-b613-4924fcabe858 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:28.884356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463b4e6-9f1e-44a6-929e-c90720b35a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:28.886514 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463b4e6-9f1e-44a6-929e-c90720b35a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:28.886805 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463b4e6-9f1e-44a6-929e-c90720b35a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:28.897415 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463b4e6-9f1e-44a6-929e-c90720b35a37 admin admin] PATH_INFO: `/v3/projects/a3074bda3dff4420aa9efcef459260d5` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:28.897415 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463b4e6-9f1e-44a6-929e-c90720b35a37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3074bda3dff4420aa9efcef459260d5)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:28.897415 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463b4e6-9f1e-44a6-929e-c90720b35a37 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:29.014770 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-c463b4e6-9f1e-44a6-929e-c90720b35a37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3074bda3dff4420aa9efcef459260d5', 'request_id': 'req-c463b4e6-9f1e-44a6-929e-c90720b35a37'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:29.020849 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-c463b4e6-9f1e-44a6-929e-c90720b35a37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3074bda3dff4420aa9efcef459260d5', 'request_id': 'req-c463b4e6-9f1e-44a6-929e-c90720b35a37'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:29.027256 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-c463b4e6-9f1e-44a6-929e-c90720b35a37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3074bda3dff4420aa9efcef459260d5', 'request_id': 'req-c463b4e6-9f1e-44a6-929e-c90720b35a37'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:29.110597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-c463b4e6-9f1e-44a6-929e-c90720b35a37 admin admin] The token cache is being invalidate because project a3074bda3dff4420aa9efcef459260d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:26:29.115371 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-c463b4e6-9f1e-44a6-929e-c90720b35a37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:29.115371 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-c463b4e6-9f1e-44a6-929e-c90720b35a37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:29.118428 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1216/2449] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:26:28 2022] DELETE /identity/v3/projects/a3074bda3dff4420aa9efcef459260d5 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:26:29.119873 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d366f-21e6-48fe-9590-31b9b4c5c749 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:29.120229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d366f-21e6-48fe-9590-31b9b4c5c749 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:29.120582 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d366f-21e6-48fe-9590-31b9b4c5c749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:29.142309 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-423d366f-21e6-48fe-9590-31b9b4c5c749 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:29.143592 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-423d366f-21e6-48fe-9590-31b9b4c5c749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:29.227157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1234/2450] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:26:29.236177 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9dfde-7426-4573-a6b7-babf00ead3b7 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:29.236376 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9dfde-7426-4573-a6b7-babf00ead3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:29.236642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9dfde-7426-4573-a6b7-babf00ead3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:29.272377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-21f9dfde-7426-4573-a6b7-babf00ead3b7 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:29.273909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-21f9dfde-7426-4573-a6b7-babf00ead3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:29.286559 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1217/2451] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:26:29.292419 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d366f-21e6-48fe-9590-31b9b4c5c749 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:29.305117 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d366f-21e6-48fe-9590-31b9b4c5c749 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:29.310180 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c2c21-3afa-4857-a5a1-6d4415a084de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:29.310944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c2c21-3afa-4857-a5a1-6d4415a084de admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:29.311307 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c2c21-3afa-4857-a5a1-6d4415a084de admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:29.311652 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c2c21-3afa-4857-a5a1-6d4415a084de admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:29.313089 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c2c21-3afa-4857-a5a1-6d4415a084de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:26:29.313637 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c2c21-3afa-4857-a5a1-6d4415a084de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:29.317153 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c2c21-3afa-4857-a5a1-6d4415a084de admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:29.335671 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1235/2452] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:26:29.336965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9dfde-7426-4573-a6b7-babf00ead3b7 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:29.347905 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9dfde-7426-4573-a6b7-babf00ead3b7 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:29.353565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd0b2a-de75-4283-a64b-c25c695a7037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:29.355172 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd0b2a-de75-4283-a64b-c25c695a7037 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:29.355172 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd0b2a-de75-4283-a64b-c25c695a7037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:29.355377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd0b2a-de75-4283-a64b-c25c695a7037 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:29.356141 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd0b2a-de75-4283-a64b-c25c695a7037 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:29.358507 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd0b2a-de75-4283-a64b-c25c695a7037 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:29.455770 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1218/2453] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:26:29 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:26:29.460050 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c2c21-3afa-4857-a5a1-6d4415a084de admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:29.470466 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c2c21-3afa-4857-a5a1-6d4415a084de admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:29.531194 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d387fb6-eb7d-4cb1-a86f-68c6fc1be208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:29.531815 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d387fb6-eb7d-4cb1-a86f-68c6fc1be208 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:29.532233 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d387fb6-eb7d-4cb1-a86f-68c6fc1be208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:29.532517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d387fb6-eb7d-4cb1-a86f-68c6fc1be208 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:29.533163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d387fb6-eb7d-4cb1-a86f-68c6fc1be208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:29.535187 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d387fb6-eb7d-4cb1-a86f-68c6fc1be208 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:29.619454 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1236/2454] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:26:29 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:26:29.623576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd0b2a-de75-4283-a64b-c25c695a7037 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:29.634478 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd0b2a-de75-4283-a64b-c25c695a7037 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:29.639499 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e1a99-4d58-470e-a5eb-9d5cdbd57b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:29.640116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e1a99-4d58-470e-a5eb-9d5cdbd57b34 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:29.641186 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e1a99-4d58-470e-a5eb-9d5cdbd57b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:29.641485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e1a99-4d58-470e-a5eb-9d5cdbd57b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:29.642141 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e1a99-4d58-470e-a5eb-9d5cdbd57b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:29.643796 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e1a99-4d58-470e-a5eb-9d5cdbd57b34 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:29.658396 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1219/2455] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:26:29.662253 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d387fb6-eb7d-4cb1-a86f-68c6fc1be208 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:29.673714 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d387fb6-eb7d-4cb1-a86f-68c6fc1be208 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:29.678396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829e078-5b87-4815-bc6f-b3d3b5709dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:29.678997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829e078-5b87-4815-bc6f-b3d3b5709dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:29.679278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829e078-5b87-4815-bc6f-b3d3b5709dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:29.679552 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829e078-5b87-4815-bc6f-b3d3b5709dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:29.680186 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829e078-5b87-4815-bc6f-b3d3b5709dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:29.681802 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829e078-5b87-4815-bc6f-b3d3b5709dd6 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:29.683226 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:29.696786 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1237/2456] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:26:29.700780 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e1a99-4d58-470e-a5eb-9d5cdbd57b34 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:29.713485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e1a99-4d58-470e-a5eb-9d5cdbd57b34 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:29.719472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fcc42-9962-4ceb-b104-37d57cffd2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:29.723015 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fcc42-9962-4ceb-b104-37d57cffd2d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:29.723015 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fcc42-9962-4ceb-b104-37d57cffd2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:29.723015 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fcc42-9962-4ceb-b104-37d57cffd2d3 admin admin] PATH_INFO: `/v3/projects/a69f1630e55441c083524a1ffb8abbc0/users/c2b75b39e01c4b919c87cf1b2cd1cf1b/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:29.737522 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988fcc42-9962-4ceb-b104-37d57cffd2d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a69f1630e55441c083524a1ffb8abbc0, user_id=c2b75b39e01c4b919c87cf1b2cd1cf1b, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:29.740298 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988fcc42-9962-4ceb-b104-37d57cffd2d3 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:29.836354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1220/2457] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:26:29 2022] PUT /identity/v3/projects/a69f1630e55441c083524a1ffb8abbc0/users/c2b75b39e01c4b919c87cf1b2cd1cf1b/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:26:29.853654 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfb59c-7611-466b-ac1a-30204d159461 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:29.853942 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfb59c-7611-466b-ac1a-30204d159461 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:29.854227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfb59c-7611-466b-ac1a-30204d159461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:29.884249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-eccfb59c-7611-466b-ac1a-30204d159461 None None] MFA Rules not processed for user `c2b75b39e01c4b919c87cf1b2cd1cf1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:29.885562 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-eccfb59c-7611-466b-ac1a-30204d159461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:29.955559 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1238/2458] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:26:29.960375 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fcc42-9962-4ceb-b104-37d57cffd2d3 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:30.024611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fcc42-9962-4ceb-b104-37d57cffd2d3 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:30.029641 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e79b89-856a-45ea-9e49-9910bc9bc7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:30.030503 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e79b89-856a-45ea-9e49-9910bc9bc7b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:30.030786 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e79b89-856a-45ea-9e49-9910bc9bc7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:30.031165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e79b89-856a-45ea-9e49-9910bc9bc7b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:30.032046 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e79b89-856a-45ea-9e49-9910bc9bc7b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:30.033997 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e79b89-856a-45ea-9e49-9910bc9bc7b1 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:30.156087 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1221/2459] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:26:29 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:26:30.158040 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfb59c-7611-466b-ac1a-30204d159461 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:30.169113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfb59c-7611-466b-ac1a-30204d159461 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:30.231764 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f44c38-19c3-4f87-9a1e-76d8b5502525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:30.233049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f44c38-19c3-4f87-9a1e-76d8b5502525 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:30.233371 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f44c38-19c3-4f87-9a1e-76d8b5502525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:30.233681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f44c38-19c3-4f87-9a1e-76d8b5502525 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:30.235021 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f44c38-19c3-4f87-9a1e-76d8b5502525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:30.237117 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f44c38-19c3-4f87-9a1e-76d8b5502525 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:30.306034 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1239/2460] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:26:30 2022] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:26:30.310116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e79b89-856a-45ea-9e49-9910bc9bc7b1 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:30.322733 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e79b89-856a-45ea-9e49-9910bc9bc7b1 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:30.327058 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700dd0a-0cf6-441f-a5f6-f660d23ff812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:30.327677 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700dd0a-0cf6-441f-a5f6-f660d23ff812 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:30.327963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700dd0a-0cf6-441f-a5f6-f660d23ff812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:30.328250 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700dd0a-0cf6-441f-a5f6-f660d23ff812 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:30.328893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700dd0a-0cf6-441f-a5f6-f660d23ff812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:30.330572 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700dd0a-0cf6-441f-a5f6-f660d23ff812 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:30.332040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:30.342639 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1222/2461] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:26:30.347762 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f44c38-19c3-4f87-9a1e-76d8b5502525 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:30.358129 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f44c38-19c3-4f87-9a1e-76d8b5502525 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:30.363592 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc2d44-d35f-4ef3-a65a-569c8644e484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:30.364271 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc2d44-d35f-4ef3-a65a-569c8644e484 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:30.364675 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc2d44-d35f-4ef3-a65a-569c8644e484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:30.364955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc2d44-d35f-4ef3-a65a-569c8644e484 admin admin] PATH_INFO: `/v3/projects/936b959251a543e9a31236093762d57e/users/d3df1598a24949f4a4cdb560099a2c54/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:30.379545 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc2d44-d35f-4ef3-a65a-569c8644e484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936b959251a543e9a31236093762d57e, user_id=d3df1598a24949f4a4cdb560099a2c54, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:30.382183 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc2d44-d35f-4ef3-a65a-569c8644e484 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:30.488895 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1240/2462] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:26:30 2022] PUT /identity/v3/projects/936b959251a543e9a31236093762d57e/users/d3df1598a24949f4a4cdb560099a2c54/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:26:30.493139 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700dd0a-0cf6-441f-a5f6-f660d23ff812 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:30.503841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700dd0a-0cf6-441f-a5f6-f660d23ff812 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:30.558874 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3731717-18b8-4044-bd51-6f88e4855896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:30.559406 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3731717-18b8-4044-bd51-6f88e4855896 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:30.559689 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3731717-18b8-4044-bd51-6f88e4855896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:30.559964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3731717-18b8-4044-bd51-6f88e4855896 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:30.560600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3731717-18b8-4044-bd51-6f88e4855896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:30.562242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3731717-18b8-4044-bd51-6f88e4855896 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:30.572502 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1223/2463] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:26:30.576671 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc2d44-d35f-4ef3-a65a-569c8644e484 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:30.587213 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc2d44-d35f-4ef3-a65a-569c8644e484 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:30.591799 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf012c8d-17d5-4a72-a52d-d8e021cdd659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:30.592486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf012c8d-17d5-4a72-a52d-d8e021cdd659 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:30.592765 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf012c8d-17d5-4a72-a52d-d8e021cdd659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:30.593037 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf012c8d-17d5-4a72-a52d-d8e021cdd659 admin admin] PATH_INFO: `/v3/projects/936b959251a543e9a31236093762d57e/users/d3df1598a24949f4a4cdb560099a2c54/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:30.595716 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf012c8d-17d5-4a72-a52d-d8e021cdd659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936b959251a543e9a31236093762d57e, user_id=d3df1598a24949f4a4cdb560099a2c54, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:30.598384 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf012c8d-17d5-4a72-a52d-d8e021cdd659 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:30.608546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1241/2464] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:26:30 2022] PUT /identity/v3/projects/936b959251a543e9a31236093762d57e/users/d3df1598a24949f4a4cdb560099a2c54/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:26:30.622630 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53c0c0-86b4-4dd3-a1cc-6257cd3c78b1 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:30.622920 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53c0c0-86b4-4dd3-a1cc-6257cd3c78b1 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:30.623196 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53c0c0-86b4-4dd3-a1cc-6257cd3c78b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:30.650926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-ec53c0c0-86b4-4dd3-a1cc-6257cd3c78b1 None None] MFA Rules not processed for user `d3df1598a24949f4a4cdb560099a2c54`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:30.652357 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-ec53c0c0-86b4-4dd3-a1cc-6257cd3c78b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:30.722482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1224/2465] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:26:30.733835 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf012c8d-17d5-4a72-a52d-d8e021cdd659 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:30.735825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-cf012c8d-17d5-4a72-a52d-d8e021cdd659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:30.779214 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:30.794568 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf012c8d-17d5-4a72-a52d-d8e021cdd659 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:30.798530 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f193a-5f6e-4546-8c35-791f2f991c92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:30.799129 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f193a-5f6e-4546-8c35-791f2f991c92 service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:30.802522 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f193a-5f6e-4546-8c35-791f2f991c92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:30.802522 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f193a-5f6e-4546-8c35-791f2f991c92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:30.808436 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f193a-5f6e-4546-8c35-791f2f991c92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:30.810142 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f193a-5f6e-4546-8c35-791f2f991c92 service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:30.820422 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1242/2466] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:26:30 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:26:31.068626 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53c0c0-86b4-4dd3-a1cc-6257cd3c78b1 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:31.078878 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53c0c0-86b4-4dd3-a1cc-6257cd3c78b1 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:31.082505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df5eac-ea05-4e00-ab84-d400467b64cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:31.085790 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df5eac-ea05-4e00-ab84-d400467b64cc service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:31.085790 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df5eac-ea05-4e00-ab84-d400467b64cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:31.085790 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df5eac-ea05-4e00-ab84-d400467b64cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:31.138752 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df5eac-ea05-4e00-ab84-d400467b64cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:31.140189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df5eac-ea05-4e00-ab84-d400467b64cc service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:31.150104 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1225/2467] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:26:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:26:36.042095 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f193a-5f6e-4546-8c35-791f2f991c92 service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:36.043452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-8e2f193a-5f6e-4546-8c35-791f2f991c92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:36.102110 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f193a-5f6e-4546-8c35-791f2f991c92 service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:36.105591 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da4503-58d6-4a36-a6d3-1a3b4104c65e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:36.106188 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da4503-58d6-4a36-a6d3-1a3b4104c65e service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:36.106494 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da4503-58d6-4a36-a6d3-1a3b4104c65e service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:36.106769 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da4503-58d6-4a36-a6d3-1a3b4104c65e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:36.108464 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-33da4503-58d6-4a36-a6d3-1a3b4104c65e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:36.173001 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da4503-58d6-4a36-a6d3-1a3b4104c65e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:36.174407 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da4503-58d6-4a36-a6d3-1a3b4104c65e service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:36.189450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1243/2468] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:26:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:26:40.082643 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df5eac-ea05-4e00-ab84-d400467b64cc service cinder] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:40.098384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df5eac-ea05-4e00-ab84-d400467b64cc service cinder] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:40.104319 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d504af-6eb1-4360-94b9-23362bf73894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:40.105910 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d504af-6eb1-4360-94b9-23362bf73894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:40.106533 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d504af-6eb1-4360-94b9-23362bf73894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:40.107185 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d504af-6eb1-4360-94b9-23362bf73894 admin admin] PATH_INFO: `/v3/users/c2b75b39e01c4b919c87cf1b2cd1cf1b` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:40.109602 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d504af-6eb1-4360-94b9-23362bf73894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2b75b39e01c4b919c87cf1b2cd1cf1b)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:40.112621 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d504af-6eb1-4360-94b9-23362bf73894 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:40.130201 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:40.318152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-38d504af-6eb1-4360-94b9-23362bf73894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2b75b39e01c4b919c87cf1b2cd1cf1b'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:40.319619 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-38d504af-6eb1-4360-94b9-23362bf73894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2b75b39e01c4b919c87cf1b2cd1cf1b'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:40.320694 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-38d504af-6eb1-4360-94b9-23362bf73894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2b75b39e01c4b919c87cf1b2cd1cf1b'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:40.385577 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-38d504af-6eb1-4360-94b9-23362bf73894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2b75b39e01c4b919c87cf1b2cd1cf1b'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:40.397250 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-38d504af-6eb1-4360-94b9-23362bf73894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2b75b39e01c4b919c87cf1b2cd1cf1b'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:40.423962 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1226/2469] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:26:40 2022] DELETE /identity/v3/users/c2b75b39e01c4b919c87cf1b2cd1cf1b => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:26:40.428377 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0082fc-8d8e-42f5-b7f5-cc946d4a85e7 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:40.428871 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0082fc-8d8e-42f5-b7f5-cc946d4a85e7 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:40.428958 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0082fc-8d8e-42f5-b7f5-cc946d4a85e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:40.449385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-0b0082fc-8d8e-42f5-b7f5-cc946d4a85e7 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:40.450656 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-0b0082fc-8d8e-42f5-b7f5-cc946d4a85e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:40.550684 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1244/2470] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:26:40.559002 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d504af-6eb1-4360-94b9-23362bf73894 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:40.560758 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-38d504af-6eb1-4360-94b9-23362bf73894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:40.632618 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d504af-6eb1-4360-94b9-23362bf73894 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:40.636795 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211297b-d3b4-471c-8976-b7230e54ff5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:40.637409 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211297b-d3b4-471c-8976-b7230e54ff5b service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:40.637689 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211297b-d3b4-471c-8976-b7230e54ff5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:40.637980 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211297b-d3b4-471c-8976-b7230e54ff5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:40.650213 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211297b-d3b4-471c-8976-b7230e54ff5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:40.651741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211297b-d3b4-471c-8976-b7230e54ff5b service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:40.662582 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1227/2471] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:26:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:26:40.716716 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0082fc-8d8e-42f5-b7f5-cc946d4a85e7 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:40.718030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-0b0082fc-8d8e-42f5-b7f5-cc946d4a85e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:40.745334 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0082fc-8d8e-42f5-b7f5-cc946d4a85e7 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:40.750772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40683fe-94ce-41d2-b393-12500d3d02eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:40.751586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40683fe-94ce-41d2-b393-12500d3d02eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:40.751865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40683fe-94ce-41d2-b393-12500d3d02eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:40.752749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40683fe-94ce-41d2-b393-12500d3d02eb admin admin] PATH_INFO: `/v3/users/174ebadbeec64175bd09beb3e270c573` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:40.753330 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40683fe-94ce-41d2-b393-12500d3d02eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=174ebadbeec64175bd09beb3e270c573)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:40.756365 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40683fe-94ce-41d2-b393-12500d3d02eb admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:40.861571 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:40.995290 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d40683fe-94ce-41d2-b393-12500d3d02eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '174ebadbeec64175bd09beb3e270c573'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:40.996039 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d40683fe-94ce-41d2-b393-12500d3d02eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '174ebadbeec64175bd09beb3e270c573'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:40.997312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d40683fe-94ce-41d2-b393-12500d3d02eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '174ebadbeec64175bd09beb3e270c573'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:41.122537 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d40683fe-94ce-41d2-b393-12500d3d02eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '174ebadbeec64175bd09beb3e270c573'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:41.136428 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d40683fe-94ce-41d2-b393-12500d3d02eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '174ebadbeec64175bd09beb3e270c573'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:41.153477 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211297b-d3b4-471c-8976-b7230e54ff5b service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:41.155794 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-9211297b-d3b4-471c-8976-b7230e54ff5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:41.157854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1245/2472] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:26:40 2022] DELETE /identity/v3/users/174ebadbeec64175bd09beb3e270c573 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:26:41.176136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211297b-d3b4-471c-8976-b7230e54ff5b service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:41.291833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25b34a-2648-4899-a53c-b1aa1f66491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:41.292547 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25b34a-2648-4899-a53c-b1aa1f66491c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:41.292828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25b34a-2648-4899-a53c-b1aa1f66491c admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:41.293104 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25b34a-2648-4899-a53c-b1aa1f66491c admin admin] PATH_INFO: `/v3/projects/a69f1630e55441c083524a1ffb8abbc0` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:41.295830 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25b34a-2648-4899-a53c-b1aa1f66491c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a69f1630e55441c083524a1ffb8abbc0)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:41.297553 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25b34a-2648-4899-a53c-b1aa1f66491c admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:41.426044 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:41.441359 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-7d25b34a-2648-4899-a53c-b1aa1f66491c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a69f1630e55441c083524a1ffb8abbc0', 'request_id': 'req-7d25b34a-2648-4899-a53c-b1aa1f66491c'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:41.447300 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-7d25b34a-2648-4899-a53c-b1aa1f66491c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a69f1630e55441c083524a1ffb8abbc0', 'request_id': 'req-7d25b34a-2648-4899-a53c-b1aa1f66491c'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:41.454162 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-7d25b34a-2648-4899-a53c-b1aa1f66491c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a69f1630e55441c083524a1ffb8abbc0', 'request_id': 'req-7d25b34a-2648-4899-a53c-b1aa1f66491c'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:41.541813 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-7d25b34a-2648-4899-a53c-b1aa1f66491c admin admin] The token cache is being invalidate because project a69f1630e55441c083524a1ffb8abbc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:26:41.541813 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-7d25b34a-2648-4899-a53c-b1aa1f66491c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:41.546077 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40683fe-94ce-41d2-b393-12500d3d02eb admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:41.546077 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-d40683fe-94ce-41d2-b393-12500d3d02eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:41.548833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-7d25b34a-2648-4899-a53c-b1aa1f66491c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:41.552576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1228/2473] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:26:41 2022] DELETE /identity/v3/projects/a69f1630e55441c083524a1ffb8abbc0 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:26:41.556496 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25b34a-2648-4899-a53c-b1aa1f66491c admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:41.557911 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-7d25b34a-2648-4899-a53c-b1aa1f66491c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:41.571835 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40683fe-94ce-41d2-b393-12500d3d02eb admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:41.638019 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459e8d2-b39c-4f51-93e2-f14662b25d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:41.638739 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459e8d2-b39c-4f51-93e2-f14662b25d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:41.638969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459e8d2-b39c-4f51-93e2-f14662b25d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:41.639258 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459e8d2-b39c-4f51-93e2-f14662b25d30 admin admin] PATH_INFO: `/v3/projects/f42bbc6ead054b49a84dea85315305f6` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:41.640400 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459e8d2-b39c-4f51-93e2-f14662b25d30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f42bbc6ead054b49a84dea85315305f6)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:41.641304 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25b34a-2648-4899-a53c-b1aa1f66491c admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:41.642640 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459e8d2-b39c-4f51-93e2-f14662b25d30 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:41.646263 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113da249-1142-4aad-8e07-fe389a411d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:41.646990 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113da249-1142-4aad-8e07-fe389a411d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:41.647337 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113da249-1142-4aad-8e07-fe389a411d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:41.647677 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113da249-1142-4aad-8e07-fe389a411d69 admin admin] PATH_INFO: `/v3/users/d3df1598a24949f4a4cdb560099a2c54` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:41.648981 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113da249-1142-4aad-8e07-fe389a411d69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3df1598a24949f4a4cdb560099a2c54)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:41.651118 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113da249-1142-4aad-8e07-fe389a411d69 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:41.723514 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-6459e8d2-b39c-4f51-93e2-f14662b25d30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f42bbc6ead054b49a84dea85315305f6', 'request_id': 'req-6459e8d2-b39c-4f51-93e2-f14662b25d30'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:41.729130 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-6459e8d2-b39c-4f51-93e2-f14662b25d30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f42bbc6ead054b49a84dea85315305f6', 'request_id': 'req-6459e8d2-b39c-4f51-93e2-f14662b25d30'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:41.735900 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-6459e8d2-b39c-4f51-93e2-f14662b25d30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f42bbc6ead054b49a84dea85315305f6', 'request_id': 'req-6459e8d2-b39c-4f51-93e2-f14662b25d30'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:41.831434 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-113da249-1142-4aad-8e07-fe389a411d69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3df1598a24949f4a4cdb560099a2c54'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:41.832100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-113da249-1142-4aad-8e07-fe389a411d69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3df1598a24949f4a4cdb560099a2c54'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:41.832718 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-113da249-1142-4aad-8e07-fe389a411d69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3df1598a24949f4a4cdb560099a2c54'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:41.852339 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-6459e8d2-b39c-4f51-93e2-f14662b25d30 admin admin] The token cache is being invalidate because project f42bbc6ead054b49a84dea85315305f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:26:41.853309 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-6459e8d2-b39c-4f51-93e2-f14662b25d30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:41.853309 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-6459e8d2-b39c-4f51-93e2-f14662b25d30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:41.854878 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1246/2474] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:26:41 2022] DELETE /identity/v3/projects/f42bbc6ead054b49a84dea85315305f6 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:26:41.860388 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb1f04-5d8c-4f2f-8341-3f4ae4db61c1 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:41.860676 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb1f04-5d8c-4f2f-8341-3f4ae4db61c1 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:41.860947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb1f04-5d8c-4f2f-8341-3f4ae4db61c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:41.880919 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-d3fb1f04-5d8c-4f2f-8341-3f4ae4db61c1 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:41.882235 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-d3fb1f04-5d8c-4f2f-8341-3f4ae4db61c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:41.911279 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:41.941311 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1247/2475] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:26:41.949924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8a61b-7acb-423d-825d-ddff913ec02f None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:41.950300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8a61b-7acb-423d-825d-ddff913ec02f None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:41.950584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8a61b-7acb-423d-825d-ddff913ec02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:41.967804 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-113da249-1142-4aad-8e07-fe389a411d69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3df1598a24949f4a4cdb560099a2c54'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:41.969889 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-bdf8a61b-7acb-423d-825d-ddff913ec02f None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:41.971100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-bdf8a61b-7acb-423d-825d-ddff913ec02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:41.975610 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-113da249-1142-4aad-8e07-fe389a411d69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3df1598a24949f4a4cdb560099a2c54'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:41.979110 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1248/2476] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:26:41.982953 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8a61b-7acb-423d-825d-ddff913ec02f None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:41.992971 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8a61b-7acb-423d-825d-ddff913ec02f None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:41.994416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1229/2477] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:26:41 2022] DELETE /identity/v3/users/d3df1598a24949f4a4cdb560099a2c54 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:26:42.051242 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad3674-2edc-481c-9b12-ba9770ef6fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:42.051852 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad3674-2edc-481c-9b12-ba9770ef6fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:42.052133 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad3674-2edc-481c-9b12-ba9770ef6fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:42.052407 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad3674-2edc-481c-9b12-ba9770ef6fe2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:42.053172 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad3674-2edc-481c-9b12-ba9770ef6fe2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:26:42.053480 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad3674-2edc-481c-9b12-ba9770ef6fe2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:42.055134 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad3674-2edc-481c-9b12-ba9770ef6fe2 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:42.067644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1249/2478] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 08:26:42.072185 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113da249-1142-4aad-8e07-fe389a411d69 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:42.073694 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-113da249-1142-4aad-8e07-fe389a411d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:42.087444 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113da249-1142-4aad-8e07-fe389a411d69 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:42.092155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89da55-d7f4-458c-a689-4d5ef776e63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:42.092755 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89da55-d7f4-458c-a689-4d5ef776e63e admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:42.093032 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89da55-d7f4-458c-a689-4d5ef776e63e admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:42.093301 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89da55-d7f4-458c-a689-4d5ef776e63e admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:42.093964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89da55-d7f4-458c-a689-4d5ef776e63e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:42.095884 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89da55-d7f4-458c-a689-4d5ef776e63e admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:42.205397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1230/2479] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:26:42 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:26:42.209774 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad3674-2edc-481c-9b12-ba9770ef6fe2 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:42.220979 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad3674-2edc-481c-9b12-ba9770ef6fe2 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:42.297624 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f721dc5-3e31-4d31-aa08-28e4a3a0ccaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:42.298255 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f721dc5-3e31-4d31-aa08-28e4a3a0ccaf admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:42.298563 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f721dc5-3e31-4d31-aa08-28e4a3a0ccaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:42.298837 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f721dc5-3e31-4d31-aa08-28e4a3a0ccaf admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:42.299630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f721dc5-3e31-4d31-aa08-28e4a3a0ccaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:42.301901 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f721dc5-3e31-4d31-aa08-28e4a3a0ccaf admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:42.408464 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1250/2480] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:26:42 2022] POST /identity/v3/users => generated 294 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:26:42.412820 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89da55-d7f4-458c-a689-4d5ef776e63e admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:42.425805 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89da55-d7f4-458c-a689-4d5ef776e63e admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:42.435149 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4aa46e-6d96-430a-96e1-c257588cb44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:42.441632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4aa46e-6d96-430a-96e1-c257588cb44c admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:42.441632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4aa46e-6d96-430a-96e1-c257588cb44c admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:42.441632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4aa46e-6d96-430a-96e1-c257588cb44c admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:42.441632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4aa46e-6d96-430a-96e1-c257588cb44c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:42.441632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4aa46e-6d96-430a-96e1-c257588cb44c admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:42.443187 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f721dc5-3e31-4d31-aa08-28e4a3a0ccaf admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:42.444994 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-1f721dc5-3e31-4d31-aa08-28e4a3a0ccaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:42.459947 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1231/2481] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:26:42.460877 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4aa46e-6d96-430a-96e1-c257588cb44c admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:42.483462 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f721dc5-3e31-4d31-aa08-28e4a3a0ccaf admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:42.491728 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9a271-07d7-4aa8-aa58-49126519eec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:42.491728 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9a271-07d7-4aa8-aa58-49126519eec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:42.491728 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9a271-07d7-4aa8-aa58-49126519eec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:42.491728 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9a271-07d7-4aa8-aa58-49126519eec8 admin admin] PATH_INFO: `/v3/projects/936b959251a543e9a31236093762d57e` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:42.492230 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4aa46e-6d96-430a-96e1-c257588cb44c admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:42.493374 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9a271-07d7-4aa8-aa58-49126519eec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=936b959251a543e9a31236093762d57e)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:42.495380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9a271-07d7-4aa8-aa58-49126519eec8 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:42.497058 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bc7f2-b0cb-451d-8ab3-88554e5c0fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:42.497783 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bc7f2-b0cb-451d-8ab3-88554e5c0fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:42.498028 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bc7f2-b0cb-451d-8ab3-88554e5c0fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:42.498328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bc7f2-b0cb-451d-8ab3-88554e5c0fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:42.499038 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30bc7f2-b0cb-451d-8ab3-88554e5c0fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:42.501105 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30bc7f2-b0cb-451d-8ab3-88554e5c0fb0 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:42.502820 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:42.513105 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1232/2482] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:26:42.518002 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bc7f2-b0cb-451d-8ab3-88554e5c0fb0 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:42.528238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bc7f2-b0cb-451d-8ab3-88554e5c0fb0 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:42.533818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b1ee9-5316-4bec-ac8e-b300ec6edd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:42.534498 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b1ee9-5316-4bec-ac8e-b300ec6edd0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:42.534781 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b1ee9-5316-4bec-ac8e-b300ec6edd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:42.535057 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b1ee9-5316-4bec-ac8e-b300ec6edd0c admin admin] PATH_INFO: `/v3/projects/2e6cd607973344adb1392c3e9a99b238/users/73e6bb9acdb94c41a91fbc710d475160/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:42.550500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b1ee9-5316-4bec-ac8e-b300ec6edd0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e6cd607973344adb1392c3e9a99b238, user_id=73e6bb9acdb94c41a91fbc710d475160, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:42.553175 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b1ee9-5316-4bec-ac8e-b300ec6edd0c admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:42.657057 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1233/2483] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:26:42 2022] PUT /identity/v3/projects/2e6cd607973344adb1392c3e9a99b238/users/73e6bb9acdb94c41a91fbc710d475160/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:26:42.668278 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74318e-6e84-40e4-bb26-30d754e1ee5c None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:42.668671 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74318e-6e84-40e4-bb26-30d754e1ee5c None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:42.669074 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74318e-6e84-40e4-bb26-30d754e1ee5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:42.672673 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:42.677221 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-19e9a271-07d7-4aa8-aa58-49126519eec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '936b959251a543e9a31236093762d57e', 'request_id': 'req-19e9a271-07d7-4aa8-aa58-49126519eec8'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:42.684402 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-19e9a271-07d7-4aa8-aa58-49126519eec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '936b959251a543e9a31236093762d57e', 'request_id': 'req-19e9a271-07d7-4aa8-aa58-49126519eec8'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:42.692335 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-19e9a271-07d7-4aa8-aa58-49126519eec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '936b959251a543e9a31236093762d57e', 'request_id': 'req-19e9a271-07d7-4aa8-aa58-49126519eec8'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:42.715317 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-1c74318e-6e84-40e4-bb26-30d754e1ee5c None None] MFA Rules not processed for user `73e6bb9acdb94c41a91fbc710d475160`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:42.716648 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-1c74318e-6e84-40e4-bb26-30d754e1ee5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:42.774826 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-19e9a271-07d7-4aa8-aa58-49126519eec8 admin admin] The token cache is being invalidate because project 936b959251a543e9a31236093762d57e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:26:42.775465 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-19e9a271-07d7-4aa8-aa58-49126519eec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:42.776357 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-19e9a271-07d7-4aa8-aa58-49126519eec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:42.782892 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1251/2484] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:26:42 2022] DELETE /identity/v3/projects/936b959251a543e9a31236093762d57e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:26:42.783060 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1234/2485] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:26:42.784510 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7bab7-442e-4d80-bfb0-17624f6b56be None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:42.784795 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7bab7-442e-4d80-bfb0-17624f6b56be None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:42.785164 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7bab7-442e-4d80-bfb0-17624f6b56be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:42.786218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74318e-6e84-40e4-bb26-30d754e1ee5c None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:42.804605 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-54c7bab7-442e-4d80-bfb0-17624f6b56be None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:42.805807 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-54c7bab7-442e-4d80-bfb0-17624f6b56be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:42.873685 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74318e-6e84-40e4-bb26-30d754e1ee5c None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:42.879387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c8713-9de4-4874-91bb-90d2c58b3e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:42.879999 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c8713-9de4-4874-91bb-90d2c58b3e51 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:42.880279 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c8713-9de4-4874-91bb-90d2c58b3e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:42.880574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c8713-9de4-4874-91bb-90d2c58b3e51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:42.881155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c8713-9de4-4874-91bb-90d2c58b3e51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:42.883089 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c8713-9de4-4874-91bb-90d2c58b3e51 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:42.884395 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1252/2486] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:26:42.892751 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ca767-764c-4737-9997-6e732faaa677 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:42.892942 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ca767-764c-4737-9997-6e732faaa677 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:42.893204 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ca767-764c-4737-9997-6e732faaa677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:42.913636 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-369ca767-764c-4737-9997-6e732faaa677 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:42.914879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-369ca767-764c-4737-9997-6e732faaa677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:42.923226 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1253/2487] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:26:42.927541 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ca767-764c-4737-9997-6e732faaa677 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:42.936477 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ca767-764c-4737-9997-6e732faaa677 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:42.942638 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759098e-62f6-4904-b6b9-c294f9b3741d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:42.943231 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759098e-62f6-4904-b6b9-c294f9b3741d admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:42.947534 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759098e-62f6-4904-b6b9-c294f9b3741d admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:42.947534 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759098e-62f6-4904-b6b9-c294f9b3741d admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:42.947534 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759098e-62f6-4904-b6b9-c294f9b3741d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:26:42.947534 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759098e-62f6-4904-b6b9-c294f9b3741d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:42.947534 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759098e-62f6-4904-b6b9-c294f9b3741d admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:42.961292 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1254/2488] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 08:26:42.962481 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759098e-62f6-4904-b6b9-c294f9b3741d admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:42.972026 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759098e-62f6-4904-b6b9-c294f9b3741d admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:42.977303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb8847-e6d4-4cb8-8131-2bd3428598ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:42.977712 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb8847-e6d4-4cb8-8131-2bd3428598ce admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:42.977993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb8847-e6d4-4cb8-8131-2bd3428598ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:42.978325 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb8847-e6d4-4cb8-8131-2bd3428598ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:42.979311 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb8847-e6d4-4cb8-8131-2bd3428598ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:42.989520 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb8847-e6d4-4cb8-8131-2bd3428598ce admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:43.021577 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1235/2489] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:26:42 2022] POST /identity/v3/projects => generated 387 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:26:43.025782 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c8713-9de4-4874-91bb-90d2c58b3e51 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:43.027846 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-d32c8713-9de4-4874-91bb-90d2c58b3e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:43.078101 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:43.093019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c8713-9de4-4874-91bb-90d2c58b3e51 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:43.098538 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c10a9-532c-4871-b4d1-d090f5fd451d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:43.101878 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c10a9-532c-4871-b4d1-d090f5fd451d admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:43.101878 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c10a9-532c-4871-b4d1-d090f5fd451d admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:43.101878 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c10a9-532c-4871-b4d1-d090f5fd451d admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:43.101878 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c10a9-532c-4871-b4d1-d090f5fd451d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:43.102391 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c10a9-532c-4871-b4d1-d090f5fd451d admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:43.111357 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1255/2490] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:26:42 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:26:43.113192 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb8847-e6d4-4cb8-8131-2bd3428598ce admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:43.176563 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb8847-e6d4-4cb8-8131-2bd3428598ce admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:43.182113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78784f-dafd-41ac-a1bf-fb49391a5fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:43.183123 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78784f-dafd-41ac-a1bf-fb49391a5fbc admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:43.183123 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78784f-dafd-41ac-a1bf-fb49391a5fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:43.187842 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78784f-dafd-41ac-a1bf-fb49391a5fbc admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:43.187842 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78784f-dafd-41ac-a1bf-fb49391a5fbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:43.187842 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78784f-dafd-41ac-a1bf-fb49391a5fbc admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:43.188276 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1236/2491] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:26:43 2022] POST /identity/v3/users => generated 300 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:26:43.191045 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c10a9-532c-4871-b4d1-d090f5fd451d admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:43.201628 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c10a9-532c-4871-b4d1-d090f5fd451d admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:43.206662 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cde00-8958-4ede-b6d9-6dedb7dd321a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:43.207257 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cde00-8958-4ede-b6d9-6dedb7dd321a admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:43.207531 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cde00-8958-4ede-b6d9-6dedb7dd321a admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:43.207804 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cde00-8958-4ede-b6d9-6dedb7dd321a admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:43.208439 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cde00-8958-4ede-b6d9-6dedb7dd321a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:43.210046 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cde00-8958-4ede-b6d9-6dedb7dd321a admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:43.220643 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1237/2492] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:26:43.224824 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cde00-8958-4ede-b6d9-6dedb7dd321a admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:43.234219 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cde00-8958-4ede-b6d9-6dedb7dd321a admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:43.239534 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad6cfa-e4e8-4c4c-b9ea-94ba1bea959c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:43.240195 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad6cfa-e4e8-4c4c-b9ea-94ba1bea959c admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:43.240478 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad6cfa-e4e8-4c4c-b9ea-94ba1bea959c admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:43.240836 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad6cfa-e4e8-4c4c-b9ea-94ba1bea959c admin admin] PATH_INFO: `/v3/projects/84c75a833d394b6390d535b43597a54f/users/c7cde67837884e17bdf18c1bbc586e83/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:43.256135 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad6cfa-e4e8-4c4c-b9ea-94ba1bea959c admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c75a833d394b6390d535b43597a54f, user_id=c7cde67837884e17bdf18c1bbc586e83, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:43.258845 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad6cfa-e4e8-4c4c-b9ea-94ba1bea959c admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:43.299010 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1256/2493] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:26:43 2022] POST /identity/v3/users => generated 294 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:26:43.300201 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78784f-dafd-41ac-a1bf-fb49391a5fbc admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:43.311004 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78784f-dafd-41ac-a1bf-fb49391a5fbc admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:43.316346 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba67985-8d50-444c-8466-cbc7bc7a7de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:43.316904 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba67985-8d50-444c-8466-cbc7bc7a7de6 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:43.317578 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba67985-8d50-444c-8466-cbc7bc7a7de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:43.317578 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba67985-8d50-444c-8466-cbc7bc7a7de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:43.318086 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba67985-8d50-444c-8466-cbc7bc7a7de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:43.319741 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba67985-8d50-444c-8466-cbc7bc7a7de6 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:43.333621 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1257/2494] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:26:43.335090 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba67985-8d50-444c-8466-cbc7bc7a7de6 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:43.337836 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1238/2495] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:26:43 2022] PUT /identity/v3/projects/84c75a833d394b6390d535b43597a54f/users/c7cde67837884e17bdf18c1bbc586e83/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:26:43.342854 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad6cfa-e4e8-4c4c-b9ea-94ba1bea959c admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:43.345828 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba67985-8d50-444c-8466-cbc7bc7a7de6 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:43.354529 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:43.417620 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42896f7f-1853-411f-b803-3843fcfa7f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:43.418248 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42896f7f-1853-411f-b803-3843fcfa7f57 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:43.418561 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42896f7f-1853-411f-b803-3843fcfa7f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:43.418835 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42896f7f-1853-411f-b803-3843fcfa7f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:43.419613 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42896f7f-1853-411f-b803-3843fcfa7f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:43.421062 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42896f7f-1853-411f-b803-3843fcfa7f57 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:43.430031 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad6cfa-e4e8-4c4c-b9ea-94ba1bea959c admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:43.439976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1258/2496] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:26:43.440156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1184c2-394a-42a4-a34c-b0928f236f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:43.440271 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42896f7f-1853-411f-b803-3843fcfa7f57 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:43.440354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1184c2-394a-42a4-a34c-b0928f236f72 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:43.440354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1184c2-394a-42a4-a34c-b0928f236f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:43.440354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1184c2-394a-42a4-a34c-b0928f236f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:43.440354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1184c2-394a-42a4-a34c-b0928f236f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:43.441404 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1184c2-394a-42a4-a34c-b0928f236f72 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:43.448149 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42896f7f-1853-411f-b803-3843fcfa7f57 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:43.453917 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f8ede-430d-450c-9c87-82b609671c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:43.454064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1239/2497] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:26:43.454252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f8ede-430d-450c-9c87-82b609671c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:43.454795 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f8ede-430d-450c-9c87-82b609671c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:43.455084 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f8ede-430d-450c-9c87-82b609671c2a admin admin] PATH_INFO: `/v3/projects/8ae588fecd454768a6c89bd441b83f77/users/b00556db92eb49f9acd89e5cf6dcec8b/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:43.458142 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1184c2-394a-42a4-a34c-b0928f236f72 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:43.470246 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1184c2-394a-42a4-a34c-b0928f236f72 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:43.471967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f8ede-430d-450c-9c87-82b609671c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ae588fecd454768a6c89bd441b83f77, user_id=b00556db92eb49f9acd89e5cf6dcec8b, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:43.474684 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f8ede-430d-450c-9c87-82b609671c2a admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:43.475166 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d10017-a55a-44b5-a071-cf1280cc7504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:43.475818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d10017-a55a-44b5-a071-cf1280cc7504 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:43.476100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d10017-a55a-44b5-a071-cf1280cc7504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:43.476374 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d10017-a55a-44b5-a071-cf1280cc7504 admin admin] PATH_INFO: `/v3/projects/84c75a833d394b6390d535b43597a54f/users/c7cde67837884e17bdf18c1bbc586e83/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:43.478320 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d10017-a55a-44b5-a071-cf1280cc7504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c75a833d394b6390d535b43597a54f, user_id=c7cde67837884e17bdf18c1bbc586e83, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:43.480948 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d10017-a55a-44b5-a071-cf1280cc7504 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:43.491211 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1240/2498] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:26:43 2022] PUT /identity/v3/projects/84c75a833d394b6390d535b43597a54f/users/c7cde67837884e17bdf18c1bbc586e83/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:26:43.502760 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3e04d-c415-4c96-be2a-80310f4c5867 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:43.503044 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3e04d-c415-4c96-be2a-80310f4c5867 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:43.503324 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3e04d-c415-4c96-be2a-80310f4c5867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:43.530456 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-7cb3e04d-c415-4c96-be2a-80310f4c5867 None None] MFA Rules not processed for user `c7cde67837884e17bdf18c1bbc586e83`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:43.532325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-7cb3e04d-c415-4c96-be2a-80310f4c5867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:43.586368 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1259/2499] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:26:43 2022] PUT /identity/v3/projects/8ae588fecd454768a6c89bd441b83f77/users/b00556db92eb49f9acd89e5cf6dcec8b/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:26:43.598525 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709e0ba-6c5b-47ce-8112-4640db9c5da4 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:43.598845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709e0ba-6c5b-47ce-8112-4640db9c5da4 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:43.599124 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709e0ba-6c5b-47ce-8112-4640db9c5da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:43.601976 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1241/2500] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:43 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:26:43.613392 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3e04d-c415-4c96-be2a-80310f4c5867 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:43.614818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-7cb3e04d-c415-4c96-be2a-80310f4c5867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:43.625447 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:43.627342 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-f709e0ba-6c5b-47ce-8112-4640db9c5da4 None None] MFA Rules not processed for user `b00556db92eb49f9acd89e5cf6dcec8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:43.628557 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-f709e0ba-6c5b-47ce-8112-4640db9c5da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:43.678417 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3e04d-c415-4c96-be2a-80310f4c5867 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:43.728917 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1260/2501] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:26:43.733426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709e0ba-6c5b-47ce-8112-4640db9c5da4 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:43.742199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb6116-f1ce-4aff-ac6c-9e53f7241907 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:43.742872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb6116-f1ce-4aff-ac6c-9e53f7241907 service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:43.743151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb6116-f1ce-4aff-ac6c-9e53f7241907 service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:43.743424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb6116-f1ce-4aff-ac6c-9e53f7241907 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:43.797422 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709e0ba-6c5b-47ce-8112-4640db9c5da4 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:43.803882 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e1475-c146-4fb5-991b-c342e783065f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:43.804494 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e1475-c146-4fb5-991b-c342e783065f admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:43.804777 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e1475-c146-4fb5-991b-c342e783065f admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:43.805058 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e1475-c146-4fb5-991b-c342e783065f admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:43.805697 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e1475-c146-4fb5-991b-c342e783065f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:43.807471 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb6116-f1ce-4aff-ac6c-9e53f7241907 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:43.807822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e1475-c146-4fb5-991b-c342e783065f admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:43.809173 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb6116-f1ce-4aff-ac6c-9e53f7241907 service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:43.821172 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1242/2502] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:26:43 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:26:43.886271 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb6116-f1ce-4aff-ac6c-9e53f7241907 service cinder] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:43.897758 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb6116-f1ce-4aff-ac6c-9e53f7241907 service cinder] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:43.902450 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fcfbf-5209-4731-9591-02001af85e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:43.903065 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fcfbf-5209-4731-9591-02001af85e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:43.903348 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fcfbf-5209-4731-9591-02001af85e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:43.903675 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fcfbf-5209-4731-9591-02001af85e51 admin admin] PATH_INFO: `/v3/users/73e6bb9acdb94c41a91fbc710d475160` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:43.904809 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fcfbf-5209-4731-9591-02001af85e51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73e6bb9acdb94c41a91fbc710d475160)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:43.907028 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fcfbf-5209-4731-9591-02001af85e51 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:43.911964 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:43.922507 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1261/2503] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:26:43 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:26:43.923640 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e1475-c146-4fb5-991b-c342e783065f admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:43.988736 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e1475-c146-4fb5-991b-c342e783065f admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:43.993520 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eaf8e7-0257-48a6-8c93-7837bf04c43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:43.994128 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaf8e7-0257-48a6-8c93-7837bf04c43f admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:43.994441 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaf8e7-0257-48a6-8c93-7837bf04c43f admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:43.994718 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaf8e7-0257-48a6-8c93-7837bf04c43f admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:43.995336 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eaf8e7-0257-48a6-8c93-7837bf04c43f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:44.001063 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eaf8e7-0257-48a6-8c93-7837bf04c43f admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:44.105176 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1262/2504] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:26:43 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:26:44.109282 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eaf8e7-0257-48a6-8c93-7837bf04c43f admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:44.119160 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eaf8e7-0257-48a6-8c93-7837bf04c43f admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:44.123810 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe7759-077c-4999-824d-811172deb24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:44.124391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe7759-077c-4999-824d-811172deb24d admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:44.124674 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe7759-077c-4999-824d-811172deb24d admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:44.125460 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe7759-077c-4999-824d-811172deb24d admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:44.126192 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe7759-077c-4999-824d-811172deb24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:44.127805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe7759-077c-4999-824d-811172deb24d admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:44.138264 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1263/2505] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:26:44.143013 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe7759-077c-4999-824d-811172deb24d admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:44.152469 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe7759-077c-4999-824d-811172deb24d admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:44.157264 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7780b6a-245c-43a9-8904-7dd5f99bffaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:44.157824 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7780b6a-245c-43a9-8904-7dd5f99bffaf admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:44.158151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7780b6a-245c-43a9-8904-7dd5f99bffaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:44.158460 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7780b6a-245c-43a9-8904-7dd5f99bffaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:44.159074 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7780b6a-245c-43a9-8904-7dd5f99bffaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:44.160684 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7780b6a-245c-43a9-8904-7dd5f99bffaf admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:44.170426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1264/2506] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:26:44.176727 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-844fcfbf-5209-4731-9591-02001af85e51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73e6bb9acdb94c41a91fbc710d475160'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:44.177375 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-844fcfbf-5209-4731-9591-02001af85e51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73e6bb9acdb94c41a91fbc710d475160'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:44.177968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-844fcfbf-5209-4731-9591-02001af85e51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73e6bb9acdb94c41a91fbc710d475160'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:44.179359 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7780b6a-245c-43a9-8904-7dd5f99bffaf admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:44.181936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c7780b6a-245c-43a9-8904-7dd5f99bffaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:44.195823 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7780b6a-245c-43a9-8904-7dd5f99bffaf admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:44.200476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ff377-2bf4-412c-9244-4c8faee9a077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:44.201106 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ff377-2bf4-412c-9244-4c8faee9a077 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:44.201384 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ff377-2bf4-412c-9244-4c8faee9a077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:44.201657 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ff377-2bf4-412c-9244-4c8faee9a077 admin admin] PATH_INFO: `/v3/projects/8c13bfefb1b24c828b6c66dcde2d17af/users/235444832c844c859a082b9dbe4835fc/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:44.216118 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ff377-2bf4-412c-9244-4c8faee9a077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c13bfefb1b24c828b6c66dcde2d17af, user_id=235444832c844c859a082b9dbe4835fc, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:44.218998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ff377-2bf4-412c-9244-4c8faee9a077 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:44.264963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-844fcfbf-5209-4731-9591-02001af85e51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73e6bb9acdb94c41a91fbc710d475160'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:44.272837 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-844fcfbf-5209-4731-9591-02001af85e51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73e6bb9acdb94c41a91fbc710d475160'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:44.278250 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:44.290611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1243/2507] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:26:43 2022] DELETE /identity/v3/users/73e6bb9acdb94c41a91fbc710d475160 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:26:44.295117 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8be5cf-4985-4795-ab15-8e1363e7d509 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:44.295408 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8be5cf-4985-4795-ab15-8e1363e7d509 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:44.295687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8be5cf-4985-4795-ab15-8e1363e7d509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:44.300927 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1265/2508] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:26:44 2022] PUT /identity/v3/projects/8c13bfefb1b24c828b6c66dcde2d17af/users/235444832c844c859a082b9dbe4835fc/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:26:44.313811 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f692c42-5513-415d-9634-0ed7076fcd19 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:44.314316 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f692c42-5513-415d-9634-0ed7076fcd19 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:44.314868 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f692c42-5513-415d-9634-0ed7076fcd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:44.317701 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-6f8be5cf-4985-4795-ab15-8e1363e7d509 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:44.318971 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-6f8be5cf-4985-4795-ab15-8e1363e7d509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:44.347730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-6f692c42-5513-415d-9634-0ed7076fcd19 None None] MFA Rules not processed for user `235444832c844c859a082b9dbe4835fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:44.348953 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-6f692c42-5513-415d-9634-0ed7076fcd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:44.388075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1244/2509] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:26:44.398393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8be5cf-4985-4795-ab15-8e1363e7d509 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:44.399777 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-6f8be5cf-4985-4795-ab15-8e1363e7d509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:44.416447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1266/2510] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:26:44.420834 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f692c42-5513-415d-9634-0ed7076fcd19 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:44.432178 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f692c42-5513-415d-9634-0ed7076fcd19 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:44.436954 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22b965-017b-4e33-b307-d33f7477ce67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:44.438174 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22b965-017b-4e33-b307-d33f7477ce67 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:44.438753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22b965-017b-4e33-b307-d33f7477ce67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:44.439094 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22b965-017b-4e33-b307-d33f7477ce67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:44.439712 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22b965-017b-4e33-b307-d33f7477ce67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:44.441656 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22b965-017b-4e33-b307-d33f7477ce67 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:44.457345 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8be5cf-4985-4795-ab15-8e1363e7d509 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:44.461216 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e4578-2c8e-4677-83b8-deba48ee5a5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:44.461809 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e4578-2c8e-4677-83b8-deba48ee5a5b service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:44.462138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e4578-2c8e-4677-83b8-deba48ee5a5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:44.462391 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e4578-2c8e-4677-83b8-deba48ee5a5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:44.473948 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e4578-2c8e-4677-83b8-deba48ee5a5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:44.475447 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e4578-2c8e-4677-83b8-deba48ee5a5b service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:44.485355 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1245/2511] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:26:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:26:44.535682 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1267/2512] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:26:44 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:26:44.539716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e4578-2c8e-4677-83b8-deba48ee5a5b service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:44.550114 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e4578-2c8e-4677-83b8-deba48ee5a5b service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:44.605944 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26659346-1a3a-4690-b221-613826ccf5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:44.606575 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26659346-1a3a-4690-b221-613826ccf5a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:44.606855 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26659346-1a3a-4690-b221-613826ccf5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:44.607123 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26659346-1a3a-4690-b221-613826ccf5a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:44.607723 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26659346-1a3a-4690-b221-613826ccf5a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:44.610399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26659346-1a3a-4690-b221-613826ccf5a7 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:44.745970 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1246/2513] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:26:44 2022] POST /identity/v3/users => generated 300 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:26:44.747297 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22b965-017b-4e33-b307-d33f7477ce67 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:44.761024 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22b965-017b-4e33-b307-d33f7477ce67 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:44.768358 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221735ca-b46e-45c0-9c2a-1de08fcee441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:44.768976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221735ca-b46e-45c0-9c2a-1de08fcee441 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:44.769255 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221735ca-b46e-45c0-9c2a-1de08fcee441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:44.769528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221735ca-b46e-45c0-9c2a-1de08fcee441 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:44.770197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221735ca-b46e-45c0-9c2a-1de08fcee441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:44.771898 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221735ca-b46e-45c0-9c2a-1de08fcee441 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:44.774573 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:44.790412 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1268/2514] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:26:44.795443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26659346-1a3a-4690-b221-613826ccf5a7 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:44.811662 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26659346-1a3a-4690-b221-613826ccf5a7 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:44.817062 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f0663-a419-4a18-b7cf-ac9094e2baae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:44.817861 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f0663-a419-4a18-b7cf-ac9094e2baae admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:44.818214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f0663-a419-4a18-b7cf-ac9094e2baae admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:44.818684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f0663-a419-4a18-b7cf-ac9094e2baae admin admin] PATH_INFO: `/v3/projects/2503837d863f44409b6fa6857fba1948/users/7f6a7d32e9ce459d827229a08b8aac30/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:44.840163 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f0663-a419-4a18-b7cf-ac9094e2baae admin admin] RBAC: Authorizing `identity:create_grant(project_id=2503837d863f44409b6fa6857fba1948, user_id=7f6a7d32e9ce459d827229a08b8aac30, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:44.843059 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f0663-a419-4a18-b7cf-ac9094e2baae admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:44.847181 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:44.884533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221735ca-b46e-45c0-9c2a-1de08fcee441 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:44.886267 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-221735ca-b46e-45c0-9c2a-1de08fcee441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:44.904530 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221735ca-b46e-45c0-9c2a-1de08fcee441 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:44.906931 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1247/2515] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:26:44 2022] PUT /identity/v3/projects/2503837d863f44409b6fa6857fba1948/users/7f6a7d32e9ce459d827229a08b8aac30/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:26:44.913145 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f0663-a419-4a18-b7cf-ac9094e2baae admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:44.970520 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718475d-e653-49ca-b2ea-361c7e2cedc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:44.971150 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718475d-e653-49ca-b2ea-361c7e2cedc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:44.971432 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718475d-e653-49ca-b2ea-361c7e2cedc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:44.971704 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718475d-e653-49ca-b2ea-361c7e2cedc9 admin admin] PATH_INFO: `/v3/projects/2e6cd607973344adb1392c3e9a99b238` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:44.972862 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718475d-e653-49ca-b2ea-361c7e2cedc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e6cd607973344adb1392c3e9a99b238)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:44.974936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718475d-e653-49ca-b2ea-361c7e2cedc9 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:44.982656 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f0663-a419-4a18-b7cf-ac9094e2baae admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:44.987710 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbcb89-a615-464c-933f-8f197bc3ca77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:44.988313 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbcb89-a615-464c-933f-8f197bc3ca77 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:44.988585 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbcb89-a615-464c-933f-8f197bc3ca77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:44.988853 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbcb89-a615-464c-933f-8f197bc3ca77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:44.989486 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbcb89-a615-464c-933f-8f197bc3ca77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:44.991189 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbcb89-a615-464c-933f-8f197bc3ca77 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:45.002328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1248/2516] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:26:45.005795 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbcb89-a615-464c-933f-8f197bc3ca77 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:45.015307 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbcb89-a615-464c-933f-8f197bc3ca77 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:45.021605 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862a122-41d4-4747-ba92-bb8093dbe446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:45.022372 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862a122-41d4-4747-ba92-bb8093dbe446 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:45.022646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862a122-41d4-4747-ba92-bb8093dbe446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:45.022915 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862a122-41d4-4747-ba92-bb8093dbe446 admin admin] PATH_INFO: `/v3/projects/2503837d863f44409b6fa6857fba1948/users/7f6a7d32e9ce459d827229a08b8aac30/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:45.025129 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862a122-41d4-4747-ba92-bb8093dbe446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2503837d863f44409b6fa6857fba1948, user_id=7f6a7d32e9ce459d827229a08b8aac30, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:45.027932 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862a122-41d4-4747-ba92-bb8093dbe446 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:45.039887 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1249/2517] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:26:45 2022] PUT /identity/v3/projects/2503837d863f44409b6fa6857fba1948/users/7f6a7d32e9ce459d827229a08b8aac30/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:26:45.050520 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d903c-237e-4685-873e-70123c445c90 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:45.050812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d903c-237e-4685-873e-70123c445c90 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:45.051097 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d903c-237e-4685-873e-70123c445c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:45.061493 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-3718475d-e653-49ca-b2ea-361c7e2cedc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e6cd607973344adb1392c3e9a99b238', 'request_id': 'req-3718475d-e653-49ca-b2ea-361c7e2cedc9'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:45.068771 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-3718475d-e653-49ca-b2ea-361c7e2cedc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e6cd607973344adb1392c3e9a99b238', 'request_id': 'req-3718475d-e653-49ca-b2ea-361c7e2cedc9'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:45.075333 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-3718475d-e653-49ca-b2ea-361c7e2cedc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e6cd607973344adb1392c3e9a99b238', 'request_id': 'req-3718475d-e653-49ca-b2ea-361c7e2cedc9'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:45.085324 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-1a2d903c-237e-4685-873e-70123c445c90 None None] MFA Rules not processed for user `7f6a7d32e9ce459d827229a08b8aac30`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:45.086605 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-1a2d903c-237e-4685-873e-70123c445c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:45.138621 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-3718475d-e653-49ca-b2ea-361c7e2cedc9 admin admin] The token cache is being invalidate because project 2e6cd607973344adb1392c3e9a99b238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:26:45.138942 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-3718475d-e653-49ca-b2ea-361c7e2cedc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:45.139537 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-3718475d-e653-49ca-b2ea-361c7e2cedc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:45.141969 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1269/2518] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:26:44 2022] DELETE /identity/v3/projects/2e6cd607973344adb1392c3e9a99b238 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:26:45.145875 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718475d-e653-49ca-b2ea-361c7e2cedc9 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:45.147169 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-3718475d-e653-49ca-b2ea-361c7e2cedc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:45.160812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1250/2519] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:45 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:26:45.171494 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d903c-237e-4685-873e-70123c445c90 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:45.172947 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-1a2d903c-237e-4685-873e-70123c445c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:45.220379 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718475d-e653-49ca-b2ea-361c7e2cedc9 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:45.225597 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b2f4b-c563-4f43-8916-87ed02bef40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:45.226234 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b2f4b-c563-4f43-8916-87ed02bef40d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:45.226547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b2f4b-c563-4f43-8916-87ed02bef40d admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:45.226820 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b2f4b-c563-4f43-8916-87ed02bef40d admin admin] PATH_INFO: `/v3/users/c7cde67837884e17bdf18c1bbc586e83` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:45.228036 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b2f4b-c563-4f43-8916-87ed02bef40d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7cde67837884e17bdf18c1bbc586e83)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:45.229887 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b2f4b-c563-4f43-8916-87ed02bef40d admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:45.233709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d903c-237e-4685-873e-70123c445c90 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:45.238790 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156b081-1c2f-49ea-b69f-e828ae64ea7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:45.239394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156b081-1c2f-49ea-b69f-e828ae64ea7c service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:45.239679 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156b081-1c2f-49ea-b69f-e828ae64ea7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:45.239954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156b081-1c2f-49ea-b69f-e828ae64ea7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:45.249405 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156b081-1c2f-49ea-b69f-e828ae64ea7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:45.251081 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156b081-1c2f-49ea-b69f-e828ae64ea7c service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:45.260647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1251/2520] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:26:45 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:26:45.403416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:45.418101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-ac0b2f4b-c563-4f43-8916-87ed02bef40d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7cde67837884e17bdf18c1bbc586e83'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:45.418859 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-ac0b2f4b-c563-4f43-8916-87ed02bef40d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7cde67837884e17bdf18c1bbc586e83'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:45.419491 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-ac0b2f4b-c563-4f43-8916-87ed02bef40d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7cde67837884e17bdf18c1bbc586e83'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:45.499866 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-ac0b2f4b-c563-4f43-8916-87ed02bef40d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7cde67837884e17bdf18c1bbc586e83'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:45.512232 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-ac0b2f4b-c563-4f43-8916-87ed02bef40d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7cde67837884e17bdf18c1bbc586e83'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:45.524617 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1270/2521] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:26:45 2022] DELETE /identity/v3/users/c7cde67837884e17bdf18c1bbc586e83 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:26:45.976674 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156b081-1c2f-49ea-b69f-e828ae64ea7c service cinder] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:45.989809 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156b081-1c2f-49ea-b69f-e828ae64ea7c service cinder] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:45.992612 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:46.046088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b9b00-490a-497b-8e4c-802d32f7fffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:46.046921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b9b00-490a-497b-8e4c-802d32f7fffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:46.047200 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b9b00-490a-497b-8e4c-802d32f7fffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:46.047580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b9b00-490a-497b-8e4c-802d32f7fffe admin admin] PATH_INFO: `/v3/projects/84c75a833d394b6390d535b43597a54f` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:46.048703 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b9b00-490a-497b-8e4c-802d32f7fffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=84c75a833d394b6390d535b43597a54f)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:46.050660 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b9b00-490a-497b-8e4c-802d32f7fffe admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:46.188377 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b2f4b-c563-4f43-8916-87ed02bef40d admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:46.190429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-ac0b2f4b-c563-4f43-8916-87ed02bef40d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:46.202332 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-654b9b00-490a-497b-8e4c-802d32f7fffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84c75a833d394b6390d535b43597a54f', 'request_id': 'req-654b9b00-490a-497b-8e4c-802d32f7fffe'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:46.208838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-654b9b00-490a-497b-8e4c-802d32f7fffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84c75a833d394b6390d535b43597a54f', 'request_id': 'req-654b9b00-490a-497b-8e4c-802d32f7fffe'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:46.214967 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-654b9b00-490a-497b-8e4c-802d32f7fffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84c75a833d394b6390d535b43597a54f', 'request_id': 'req-654b9b00-490a-497b-8e4c-802d32f7fffe'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:46.249067 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b2f4b-c563-4f43-8916-87ed02bef40d admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:46.276831 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-654b9b00-490a-497b-8e4c-802d32f7fffe admin admin] The token cache is being invalidate because project 84c75a833d394b6390d535b43597a54f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:26:46.277132 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-654b9b00-490a-497b-8e4c-802d32f7fffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:46.277768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-654b9b00-490a-497b-8e4c-802d32f7fffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:46.279298 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1252/2522] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:26:45 2022] DELETE /identity/v3/projects/84c75a833d394b6390d535b43597a54f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:26:46.284881 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45aee1b-7d3f-43f0-97f7-4ced9bae036f None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:46.285164 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45aee1b-7d3f-43f0-97f7-4ced9bae036f None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:46.285440 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45aee1b-7d3f-43f0-97f7-4ced9bae036f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:46.300410 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4420bb5-4ed5-454d-bbeb-52a6e60c6769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:46.301081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4420bb5-4ed5-454d-bbeb-52a6e60c6769 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:46.301368 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4420bb5-4ed5-454d-bbeb-52a6e60c6769 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:46.301641 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4420bb5-4ed5-454d-bbeb-52a6e60c6769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:46.303823 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-e4420bb5-4ed5-454d-bbeb-52a6e60c6769 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:46.307478 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-b45aee1b-7d3f-43f0-97f7-4ced9bae036f None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:46.308697 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-b45aee1b-7d3f-43f0-97f7-4ced9bae036f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:46.380795 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1253/2523] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:26:46.388446 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d183070-2b34-4075-8b62-cdd973514cba None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:46.388854 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d183070-2b34-4075-8b62-cdd973514cba None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:46.389216 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d183070-2b34-4075-8b62-cdd973514cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:46.394135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4420bb5-4ed5-454d-bbeb-52a6e60c6769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:46.395709 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4420bb5-4ed5-454d-bbeb-52a6e60c6769 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:46.407189 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1271/2524] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:26:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:26:46.411346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-8d183070-2b34-4075-8b62-cdd973514cba None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:46.412557 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-8d183070-2b34-4075-8b62-cdd973514cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:46.420825 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1254/2525] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:26:46.426122 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4420bb5-4ed5-454d-bbeb-52a6e60c6769 service neutron] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:46.439201 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4420bb5-4ed5-454d-bbeb-52a6e60c6769 service neutron] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:46.445349 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839482aa-f847-4c51-9ef5-2d172204b0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:46.446236 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839482aa-f847-4c51-9ef5-2d172204b0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:46.446559 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839482aa-f847-4c51-9ef5-2d172204b0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:46.446974 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839482aa-f847-4c51-9ef5-2d172204b0c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:46.448106 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839482aa-f847-4c51-9ef5-2d172204b0c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:26:46.448671 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839482aa-f847-4c51-9ef5-2d172204b0c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:46.450353 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839482aa-f847-4c51-9ef5-2d172204b0c9 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:46.462801 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:46.466671 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1272/2526] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:26:46.471723 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d183070-2b34-4075-8b62-cdd973514cba None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:46.482412 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d183070-2b34-4075-8b62-cdd973514cba None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:46.488316 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf965c-0ffe-4467-9b6c-49daefbf5279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:46.488936 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf965c-0ffe-4467-9b6c-49daefbf5279 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:46.489538 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf965c-0ffe-4467-9b6c-49daefbf5279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:46.489538 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf965c-0ffe-4467-9b6c-49daefbf5279 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:46.490452 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf965c-0ffe-4467-9b6c-49daefbf5279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:46.492450 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf965c-0ffe-4467-9b6c-49daefbf5279 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:46.495391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839482aa-f847-4c51-9ef5-2d172204b0c9 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:46.497375 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-839482aa-f847-4c51-9ef5-2d172204b0c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:46.558886 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839482aa-f847-4c51-9ef5-2d172204b0c9 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:46.562816 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ced2f4-8815-4c87-92a3-1e97fb7f9852 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:46.563424 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ced2f4-8815-4c87-92a3-1e97fb7f9852 service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:46.563973 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ced2f4-8815-4c87-92a3-1e97fb7f9852 service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:46.564251 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ced2f4-8815-4c87-92a3-1e97fb7f9852 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:46.566024 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-e0ced2f4-8815-4c87-92a3-1e97fb7f9852 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:46.585322 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1255/2527] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:26:46 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:26:46.586917 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf965c-0ffe-4467-9b6c-49daefbf5279 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:46.598347 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:46.632764 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ced2f4-8815-4c87-92a3-1e97fb7f9852 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:46.634209 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ced2f4-8815-4c87-92a3-1e97fb7f9852 service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:46.644754 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1273/2528] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:26:46 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:26:46.651456 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf965c-0ffe-4467-9b6c-49daefbf5279 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:46.656909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53e460-82ea-459a-96ce-1112032e4081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:46.657209 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53e460-82ea-459a-96ce-1112032e4081 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:46.657377 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53e460-82ea-459a-96ce-1112032e4081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:46.657609 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53e460-82ea-459a-96ce-1112032e4081 admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:46.658228 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53e460-82ea-459a-96ce-1112032e4081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:46.660185 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53e460-82ea-459a-96ce-1112032e4081 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:46.760562 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1256/2529] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:26:46 2022] POST /identity/v3/users => generated 283 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:26:46.762324 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ced2f4-8815-4c87-92a3-1e97fb7f9852 service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:46.774571 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ced2f4-8815-4c87-92a3-1e97fb7f9852 service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:46.780121 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27e229-ff8e-42b3-bb85-f7bebba35e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:46.780773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27e229-ff8e-42b3-bb85-f7bebba35e1a admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:46.782030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27e229-ff8e-42b3-bb85-f7bebba35e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:46.782422 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27e229-ff8e-42b3-bb85-f7bebba35e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:46.783156 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27e229-ff8e-42b3-bb85-f7bebba35e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:46.784944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27e229-ff8e-42b3-bb85-f7bebba35e1a admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:46.798925 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1274/2530] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:26:46.800281 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53e460-82ea-459a-96ce-1112032e4081 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:46.811460 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53e460-82ea-459a-96ce-1112032e4081 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:46.817848 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6c8f4-b44c-4f87-bf93-7576445b6efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:46.818472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6c8f4-b44c-4f87-bf93-7576445b6efe admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:46.818815 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6c8f4-b44c-4f87-bf93-7576445b6efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:46.819092 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6c8f4-b44c-4f87-bf93-7576445b6efe admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:46.819727 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6c8f4-b44c-4f87-bf93-7576445b6efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:46.821317 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6c8f4-b44c-4f87-bf93-7576445b6efe admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:46.832303 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1257/2531] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:26:46.836664 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27e229-ff8e-42b3-bb85-f7bebba35e1a admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:46.846881 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27e229-ff8e-42b3-bb85-f7bebba35e1a admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:46.853192 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c56270-e766-4d3a-b6b9-6146124a92ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:46.853839 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c56270-e766-4d3a-b6b9-6146124a92ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:46.854465 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c56270-e766-4d3a-b6b9-6146124a92ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:46.854465 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c56270-e766-4d3a-b6b9-6146124a92ed admin admin] PATH_INFO: `/v3/projects/efc80273268041bbabfa946828aae5fe/users/828d6f9c18dd4f8192007031ee9d0bff/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:46.872775 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c56270-e766-4d3a-b6b9-6146124a92ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=efc80273268041bbabfa946828aae5fe, user_id=828d6f9c18dd4f8192007031ee9d0bff, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:46.876394 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c56270-e766-4d3a-b6b9-6146124a92ed admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:46.934360 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1275/2532] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:26:46 2022] PUT /identity/v3/projects/efc80273268041bbabfa946828aae5fe/users/828d6f9c18dd4f8192007031ee9d0bff/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:26:46.948305 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8c968-d7a9-46ac-9518-c0ed5415a134 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:46.948656 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8c968-d7a9-46ac-9518-c0ed5415a134 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:46.948970 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8c968-d7a9-46ac-9518-c0ed5415a134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:46.979385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-21c8c968-d7a9-46ac-9518-c0ed5415a134 None None] MFA Rules not processed for user `828d6f9c18dd4f8192007031ee9d0bff`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:46.980843 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-21c8c968-d7a9-46ac-9518-c0ed5415a134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:47.052805 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1258/2533] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:26:47.057325 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c56270-e766-4d3a-b6b9-6146124a92ed admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:47.123631 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c56270-e766-4d3a-b6b9-6146124a92ed admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:47.129027 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec543d0-0723-4d92-a15e-230b0da8e841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:47.129754 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec543d0-0723-4d92-a15e-230b0da8e841 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:47.130041 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec543d0-0723-4d92-a15e-230b0da8e841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:47.130359 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec543d0-0723-4d92-a15e-230b0da8e841 admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:47.131008 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec543d0-0723-4d92-a15e-230b0da8e841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:47.132942 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec543d0-0723-4d92-a15e-230b0da8e841 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:47.259641 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1276/2534] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:26:47 2022] POST /identity/v3/projects => generated 365 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:26:47.261199 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8c968-d7a9-46ac-9518-c0ed5415a134 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:47.272873 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8c968-d7a9-46ac-9518-c0ed5415a134 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:47.333152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b622a76-a8f8-45ad-a752-d45a7a1685df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:47.338129 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b622a76-a8f8-45ad-a752-d45a7a1685df admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:47.338129 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b622a76-a8f8-45ad-a752-d45a7a1685df admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:47.338129 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b622a76-a8f8-45ad-a752-d45a7a1685df admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:47.338129 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b622a76-a8f8-45ad-a752-d45a7a1685df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:47.338129 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b622a76-a8f8-45ad-a752-d45a7a1685df admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:47.449518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1259/2535] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:26:47 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:26:47.453574 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec543d0-0723-4d92-a15e-230b0da8e841 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:47.462707 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:47.467407 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec543d0-0723-4d92-a15e-230b0da8e841 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:47.473163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a424100-c98d-4c9b-8266-d18e8f8ad16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:47.476486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a424100-c98d-4c9b-8266-d18e8f8ad16f admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:47.476486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a424100-c98d-4c9b-8266-d18e8f8ad16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:47.476486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a424100-c98d-4c9b-8266-d18e8f8ad16f admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:47.476486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a424100-c98d-4c9b-8266-d18e8f8ad16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:47.476901 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a424100-c98d-4c9b-8266-d18e8f8ad16f admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:47.494723 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1277/2536] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:26:47.495982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b622a76-a8f8-45ad-a752-d45a7a1685df admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:47.507527 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b622a76-a8f8-45ad-a752-d45a7a1685df admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:47.512647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb94d7-e6f1-4403-9ded-c1c39e17ebd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:47.513328 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb94d7-e6f1-4403-9ded-c1c39e17ebd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:47.514184 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb94d7-e6f1-4403-9ded-c1c39e17ebd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:47.514184 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb94d7-e6f1-4403-9ded-c1c39e17ebd5 admin admin] PATH_INFO: `/v3/projects/8c83fc85b8fe4e6db8dd61c0cd8e2913/users/39bcffba46ba4024af40ffe74136d537/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:47.516541 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:47.531882 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb94d7-e6f1-4403-9ded-c1c39e17ebd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c83fc85b8fe4e6db8dd61c0cd8e2913, user_id=39bcffba46ba4024af40ffe74136d537, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:47.534959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb94d7-e6f1-4403-9ded-c1c39e17ebd5 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:47.670897 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1260/2537] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:26:47 2022] PUT /identity/v3/projects/8c83fc85b8fe4e6db8dd61c0cd8e2913/users/39bcffba46ba4024af40ffe74136d537/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:26:47.675667 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a424100-c98d-4c9b-8266-d18e8f8ad16f admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:47.686019 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a424100-c98d-4c9b-8266-d18e8f8ad16f admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:47.746695 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253d823-920e-4147-b40a-252f13e2c9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:47.747309 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253d823-920e-4147-b40a-252f13e2c9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:47.747590 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253d823-920e-4147-b40a-252f13e2c9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:47.747862 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253d823-920e-4147-b40a-252f13e2c9a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:47.748504 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253d823-920e-4147-b40a-252f13e2c9a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:47.750589 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253d823-920e-4147-b40a-252f13e2c9a3 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:47.764876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1278/2538] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:26:47.766533 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb94d7-e6f1-4403-9ded-c1c39e17ebd5 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:47.777226 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb94d7-e6f1-4403-9ded-c1c39e17ebd5 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:47.782522 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b9b0e-58f4-42c6-806c-98777b33a687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:47.783185 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b9b0e-58f4-42c6-806c-98777b33a687 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:47.783735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b9b0e-58f4-42c6-806c-98777b33a687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:47.783849 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b9b0e-58f4-42c6-806c-98777b33a687 admin admin] PATH_INFO: `/v3/projects/8c83fc85b8fe4e6db8dd61c0cd8e2913/users/39bcffba46ba4024af40ffe74136d537/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:47.785716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b9b0e-58f4-42c6-806c-98777b33a687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c83fc85b8fe4e6db8dd61c0cd8e2913, user_id=39bcffba46ba4024af40ffe74136d537, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:47.788576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b9b0e-58f4-42c6-806c-98777b33a687 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:47.800437 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1261/2539] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:26:47 2022] PUT /identity/v3/projects/8c83fc85b8fe4e6db8dd61c0cd8e2913/users/39bcffba46ba4024af40ffe74136d537/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:26:47.813266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ade75-29df-4d82-9de7-e8a0b665ae17 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:47.814201 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ade75-29df-4d82-9de7-e8a0b665ae17 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:47.814695 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ade75-29df-4d82-9de7-e8a0b665ae17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:47.842793 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-db3ade75-29df-4d82-9de7-e8a0b665ae17 None None] MFA Rules not processed for user `39bcffba46ba4024af40ffe74136d537`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:47.844546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-db3ade75-29df-4d82-9de7-e8a0b665ae17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:47.918117 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1279/2540] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:26:47.927268 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b9b0e-58f4-42c6-806c-98777b33a687 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:47.988314 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b9b0e-58f4-42c6-806c-98777b33a687 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:47.992176 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266f69a-4698-49f6-90b8-e2a49925146d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:47.992833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266f69a-4698-49f6-90b8-e2a49925146d service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:47.993117 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266f69a-4698-49f6-90b8-e2a49925146d service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:47.993390 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266f69a-4698-49f6-90b8-e2a49925146d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:48.003036 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266f69a-4698-49f6-90b8-e2a49925146d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:48.004482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266f69a-4698-49f6-90b8-e2a49925146d service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:48.014894 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1262/2541] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:26:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:26:48.294314 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ade75-29df-4d82-9de7-e8a0b665ae17 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:48.295815 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-db3ade75-29df-4d82-9de7-e8a0b665ae17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:48.309883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ade75-29df-4d82-9de7-e8a0b665ae17 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:48.314276 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c97c9-9932-4fcf-87c1-a6d12f3d2b0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:48.314910 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c97c9-9932-4fcf-87c1-a6d12f3d2b0b service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:48.315208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c97c9-9932-4fcf-87c1-a6d12f3d2b0b service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:48.315584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c97c9-9932-4fcf-87c1-a6d12f3d2b0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:48.379912 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c97c9-9932-4fcf-87c1-a6d12f3d2b0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:48.381381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c97c9-9932-4fcf-87c1-a6d12f3d2b0b service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:48.392039 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1280/2542] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:26:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:26:50.334052 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266f69a-4698-49f6-90b8-e2a49925146d service cinder] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:50.335649 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-c266f69a-4698-49f6-90b8-e2a49925146d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:50.403536 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266f69a-4698-49f6-90b8-e2a49925146d service cinder] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:50.408120 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b93ee0-800c-48b0-a02c-0c39587a221d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:50.408738 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b93ee0-800c-48b0-a02c-0c39587a221d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:50.409015 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b93ee0-800c-48b0-a02c-0c39587a221d admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:50.409290 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b93ee0-800c-48b0-a02c-0c39587a221d admin admin] PATH_INFO: `/v3/users/6c5865eae95b490b8e421153873457bb` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:50.410419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b93ee0-800c-48b0-a02c-0c39587a221d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c5865eae95b490b8e421153873457bb)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:50.412367 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b93ee0-800c-48b0-a02c-0c39587a221d admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:50.627100 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-75b93ee0-800c-48b0-a02c-0c39587a221d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c5865eae95b490b8e421153873457bb'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:50.627679 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-75b93ee0-800c-48b0-a02c-0c39587a221d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c5865eae95b490b8e421153873457bb'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:50.628388 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-75b93ee0-800c-48b0-a02c-0c39587a221d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c5865eae95b490b8e421153873457bb'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:50.699920 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-75b93ee0-800c-48b0-a02c-0c39587a221d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c5865eae95b490b8e421153873457bb'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:50.707855 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-75b93ee0-800c-48b0-a02c-0c39587a221d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c5865eae95b490b8e421153873457bb'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:50.715672 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:50.725819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1263/2543] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:26:50 2022] DELETE /identity/v3/users/6c5865eae95b490b8e421153873457bb => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:26:50.980212 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c97c9-9932-4fcf-87c1-a6d12f3d2b0b service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:50.989439 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c97c9-9932-4fcf-87c1-a6d12f3d2b0b service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:51.003625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:51.052152 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a786e57-d214-41db-8948-adc1aa23420a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:51.052820 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a786e57-d214-41db-8948-adc1aa23420a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:51.053096 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a786e57-d214-41db-8948-adc1aa23420a admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:51.053368 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a786e57-d214-41db-8948-adc1aa23420a admin admin] PATH_INFO: `/v3/projects/76a91d6db2d94343870cdd6ed45f5a8a` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:51.054502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a786e57-d214-41db-8948-adc1aa23420a admin admin] RBAC: Authorizing `identity:delete_project(project_id=76a91d6db2d94343870cdd6ed45f5a8a)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:51.056484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a786e57-d214-41db-8948-adc1aa23420a admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:51.171008 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-8a786e57-d214-41db-8948-adc1aa23420a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76a91d6db2d94343870cdd6ed45f5a8a', 'request_id': 'req-8a786e57-d214-41db-8948-adc1aa23420a'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:51.177761 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-8a786e57-d214-41db-8948-adc1aa23420a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76a91d6db2d94343870cdd6ed45f5a8a', 'request_id': 'req-8a786e57-d214-41db-8948-adc1aa23420a'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:51.184311 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-8a786e57-d214-41db-8948-adc1aa23420a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76a91d6db2d94343870cdd6ed45f5a8a', 'request_id': 'req-8a786e57-d214-41db-8948-adc1aa23420a'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:51.294240 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-8a786e57-d214-41db-8948-adc1aa23420a admin admin] The token cache is being invalidate because project 76a91d6db2d94343870cdd6ed45f5a8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:26:51.300757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-8a786e57-d214-41db-8948-adc1aa23420a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:51.300757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-8a786e57-d214-41db-8948-adc1aa23420a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:51.300757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1281/2544] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:26:50 2022] DELETE /identity/v3/projects/76a91d6db2d94343870cdd6ed45f5a8a => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:26:51.302814 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e7823-ab8e-4401-b525-1d540e29f3dc None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:51.303106 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e7823-ab8e-4401-b525-1d540e29f3dc None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:51.303414 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e7823-ab8e-4401-b525-1d540e29f3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:51.327879 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-5d5e7823-ab8e-4401-b525-1d540e29f3dc None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:51.329145 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-5d5e7823-ab8e-4401-b525-1d540e29f3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:51.386830 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1264/2545] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:26:51.394866 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9d4e7-fa3b-405f-8fcc-aa602e55bab1 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:51.395148 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9d4e7-fa3b-405f-8fcc-aa602e55bab1 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:51.395420 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9d4e7-fa3b-405f-8fcc-aa602e55bab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:51.415557 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-47f9d4e7-fa3b-405f-8fcc-aa602e55bab1 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:51.416750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-47f9d4e7-fa3b-405f-8fcc-aa602e55bab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:51.426384 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1282/2546] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:26:51.430611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e7823-ab8e-4401-b525-1d540e29f3dc None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:51.440583 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e7823-ab8e-4401-b525-1d540e29f3dc None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:51.445235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b490116-c734-498d-be55-b4eb3aeb828d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:51.445829 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b490116-c734-498d-be55-b4eb3aeb828d admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:51.446109 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b490116-c734-498d-be55-b4eb3aeb828d admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:51.446433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b490116-c734-498d-be55-b4eb3aeb828d admin admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:51.447056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b490116-c734-498d-be55-b4eb3aeb828d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:26:51.447359 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b490116-c734-498d-be55-b4eb3aeb828d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:51.448966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b490116-c734-498d-be55-b4eb3aeb828d admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:51.460444 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1265/2547] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:26:51.464622 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9d4e7-fa3b-405f-8fcc-aa602e55bab1 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:51.474474 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9d4e7-fa3b-405f-8fcc-aa602e55bab1 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:51.479340 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a79565-1d8b-4ca0-9ade-3c4523c2889b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:51.479936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a79565-1d8b-4ca0-9ade-3c4523c2889b admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:51.480213 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a79565-1d8b-4ca0-9ade-3c4523c2889b admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:51.480486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a79565-1d8b-4ca0-9ade-3c4523c2889b admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:51.481126 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a79565-1d8b-4ca0-9ade-3c4523c2889b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:51.483196 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a79565-1d8b-4ca0-9ade-3c4523c2889b admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:51.583496 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1283/2548] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:26:51 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:26:51.586540 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b490116-c734-498d-be55-b4eb3aeb828d admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:51.597046 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b490116-c734-498d-be55-b4eb3aeb828d admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:51.688160 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917a0a5-8cac-4b6c-a097-26460e255d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:51.688160 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917a0a5-8cac-4b6c-a097-26460e255d2d admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:51.688160 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917a0a5-8cac-4b6c-a097-26460e255d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:51.688160 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917a0a5-8cac-4b6c-a097-26460e255d2d admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:51.688590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917a0a5-8cac-4b6c-a097-26460e255d2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:51.688590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917a0a5-8cac-4b6c-a097-26460e255d2d admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:51.809496 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1266/2549] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:26:51 2022] POST /identity/v3/users => generated 284 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:26:51.817225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a79565-1d8b-4ca0-9ade-3c4523c2889b admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:51.827450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a79565-1d8b-4ca0-9ade-3c4523c2889b admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:51.832213 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5cafb-d2eb-4000-a0ca-ac36c7becaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:51.832815 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5cafb-d2eb-4000-a0ca-ac36c7becaf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:51.836685 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5cafb-d2eb-4000-a0ca-ac36c7becaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:51.836685 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5cafb-d2eb-4000-a0ca-ac36c7becaf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:51.836685 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5cafb-d2eb-4000-a0ca-ac36c7becaf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:51.836685 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5cafb-d2eb-4000-a0ca-ac36c7becaf7 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:51.845597 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1284/2550] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:26:51.849589 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917a0a5-8cac-4b6c-a097-26460e255d2d admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:51.860418 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917a0a5-8cac-4b6c-a097-26460e255d2d admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:51.865032 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fb59a-a839-43f6-a683-fb40a6f13d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:51.865940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fb59a-a839-43f6-a683-fb40a6f13d72 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:51.865940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fb59a-a839-43f6-a683-fb40a6f13d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:51.866194 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fb59a-a839-43f6-a683-fb40a6f13d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:51.866819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92fb59a-a839-43f6-a683-fb40a6f13d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:51.868418 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92fb59a-a839-43f6-a683-fb40a6f13d72 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:51.880141 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1267/2551] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:26:51.884546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5cafb-d2eb-4000-a0ca-ac36c7becaf7 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:51.895498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5cafb-d2eb-4000-a0ca-ac36c7becaf7 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:51.900049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e18757-19b4-4855-a906-c6b878a5096e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:51.908617 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e18757-19b4-4855-a906-c6b878a5096e admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:51.908617 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e18757-19b4-4855-a906-c6b878a5096e admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:51.908617 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e18757-19b4-4855-a906-c6b878a5096e admin admin] PATH_INFO: `/v3/projects/6601928f32a64bc48f9ab9bd4eed29a7/users/18ece95514744aee88d2d66d38be0f8e/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:51.916087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e18757-19b4-4855-a906-c6b878a5096e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6601928f32a64bc48f9ab9bd4eed29a7, user_id=18ece95514744aee88d2d66d38be0f8e, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:51.918789 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e18757-19b4-4855-a906-c6b878a5096e admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:51.997026 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1285/2552] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:26:51 2022] PUT /identity/v3/projects/6601928f32a64bc48f9ab9bd4eed29a7/users/18ece95514744aee88d2d66d38be0f8e/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:26:52.008292 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6027da9-d6ae-4bd0-9bc9-d57c19b5fb81 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:52.008583 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6027da9-d6ae-4bd0-9bc9-d57c19b5fb81 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:52.008856 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6027da9-d6ae-4bd0-9bc9-d57c19b5fb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:52.037217 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-f6027da9-d6ae-4bd0-9bc9-d57c19b5fb81 None None] MFA Rules not processed for user `18ece95514744aee88d2d66d38be0f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:52.038790 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-f6027da9-d6ae-4bd0-9bc9-d57c19b5fb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:52.084543 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:52.103966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1268/2553] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:26:52.116142 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e18757-19b4-4855-a906-c6b878a5096e admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:52.117864 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-52e18757-19b4-4855-a906-c6b878a5096e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:52.161514 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:52.176453 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e18757-19b4-4855-a906-c6b878a5096e admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:52.180394 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472de3d-fe48-4241-94c2-b5cc0a0da3db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:52.180991 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472de3d-fe48-4241-94c2-b5cc0a0da3db service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:52.181357 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472de3d-fe48-4241-94c2-b5cc0a0da3db service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:52.181670 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472de3d-fe48-4241-94c2-b5cc0a0da3db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:52.190916 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472de3d-fe48-4241-94c2-b5cc0a0da3db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:52.192371 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472de3d-fe48-4241-94c2-b5cc0a0da3db service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:52.201044 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1286/2554] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:26:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:26:52.894054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6027da9-d6ae-4bd0-9bc9-d57c19b5fb81 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:52.905049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6027da9-d6ae-4bd0-9bc9-d57c19b5fb81 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:52.912243 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b3290-6905-48b2-a099-56d266fbb107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:52.912243 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b3290-6905-48b2-a099-56d266fbb107 service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:52.912243 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b3290-6905-48b2-a099-56d266fbb107 service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:52.912243 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b3290-6905-48b2-a099-56d266fbb107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:52.912858 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-376b3290-6905-48b2-a099-56d266fbb107 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:52.992375 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b3290-6905-48b2-a099-56d266fbb107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:52.992375 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b3290-6905-48b2-a099-56d266fbb107 service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:53.001813 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1269/2555] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:26:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:26:57.132684 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472de3d-fe48-4241-94c2-b5cc0a0da3db service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:57.134130 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-4472de3d-fe48-4241-94c2-b5cc0a0da3db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:57.199407 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472de3d-fe48-4241-94c2-b5cc0a0da3db service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:57.204074 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b188bd-8f9a-4dd1-8526-45e8cd05be94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:57.205636 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b188bd-8f9a-4dd1-8526-45e8cd05be94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:57.205967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b188bd-8f9a-4dd1-8526-45e8cd05be94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:57.206214 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b188bd-8f9a-4dd1-8526-45e8cd05be94 admin admin] PATH_INFO: `/v3/users/828d6f9c18dd4f8192007031ee9d0bff` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:57.207435 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b188bd-8f9a-4dd1-8526-45e8cd05be94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=828d6f9c18dd4f8192007031ee9d0bff)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:57.209355 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b188bd-8f9a-4dd1-8526-45e8cd05be94 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:57.352786 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-09b188bd-8f9a-4dd1-8526-45e8cd05be94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '828d6f9c18dd4f8192007031ee9d0bff'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:57.353365 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-09b188bd-8f9a-4dd1-8526-45e8cd05be94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '828d6f9c18dd4f8192007031ee9d0bff'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:57.353975 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-09b188bd-8f9a-4dd1-8526-45e8cd05be94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '828d6f9c18dd4f8192007031ee9d0bff'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:57.413983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-09b188bd-8f9a-4dd1-8526-45e8cd05be94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '828d6f9c18dd4f8192007031ee9d0bff'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:57.426966 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-09b188bd-8f9a-4dd1-8526-45e8cd05be94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '828d6f9c18dd4f8192007031ee9d0bff'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:57.440629 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1287/2556] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:26:57 2022] DELETE /identity/v3/users/828d6f9c18dd4f8192007031ee9d0bff => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:26:57.445225 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c074e-47cd-4842-b046-fd3a6538face None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:57.446087 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c074e-47cd-4842-b046-fd3a6538face None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:57.446469 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c074e-47cd-4842-b046-fd3a6538face None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:57.467022 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-193c074e-47cd-4842-b046-fd3a6538face None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:57.468253 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-193c074e-47cd-4842-b046-fd3a6538face None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:57.517765 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b188bd-8f9a-4dd1-8526-45e8cd05be94 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:57.519783 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-09b188bd-8f9a-4dd1-8526-45e8cd05be94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:57.541276 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1270/2557] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:26:57.554099 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c074e-47cd-4842-b046-fd3a6538face None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:57.555565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-193c074e-47cd-4842-b046-fd3a6538face None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:57.588367 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b188bd-8f9a-4dd1-8526-45e8cd05be94 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:57.593305 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d2bc1-1e54-4334-ab79-e5e2021ff18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:57.593943 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d2bc1-1e54-4334-ab79-e5e2021ff18a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:57.594226 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d2bc1-1e54-4334-ab79-e5e2021ff18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:57.594533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d2bc1-1e54-4334-ab79-e5e2021ff18a admin admin] PATH_INFO: `/v3/users/b00556db92eb49f9acd89e5cf6dcec8b` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:57.595761 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d2bc1-1e54-4334-ab79-e5e2021ff18a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b00556db92eb49f9acd89e5cf6dcec8b)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:57.597704 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d2bc1-1e54-4334-ab79-e5e2021ff18a admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:57.600465 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:57.614771 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c074e-47cd-4842-b046-fd3a6538face None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:57.618454 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4c865-d00c-414f-98f2-d6287a98637b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:57.619063 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4c865-d00c-414f-98f2-d6287a98637b service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:57.619346 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4c865-d00c-414f-98f2-d6287a98637b service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:57.619626 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4c865-d00c-414f-98f2-d6287a98637b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:57.629684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4c865-d00c-414f-98f2-d6287a98637b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:57.631159 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4c865-d00c-414f-98f2-d6287a98637b service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:57.640555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1271/2558] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:26:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:26:57.834762 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d44d2bc1-1e54-4334-ab79-e5e2021ff18a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b00556db92eb49f9acd89e5cf6dcec8b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:57.835789 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d44d2bc1-1e54-4334-ab79-e5e2021ff18a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b00556db92eb49f9acd89e5cf6dcec8b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:57.836409 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d44d2bc1-1e54-4334-ab79-e5e2021ff18a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b00556db92eb49f9acd89e5cf6dcec8b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:58.018725 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d44d2bc1-1e54-4334-ab79-e5e2021ff18a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b00556db92eb49f9acd89e5cf6dcec8b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:58.028520 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d44d2bc1-1e54-4334-ab79-e5e2021ff18a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b00556db92eb49f9acd89e5cf6dcec8b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:58.041465 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1288/2559] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:26:57 2022] DELETE /identity/v3/users/b00556db92eb49f9acd89e5cf6dcec8b => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:26:58.046083 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cecc77-0735-4001-8f31-779125e319ea None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:58.046486 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cecc77-0735-4001-8f31-779125e319ea None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:58.046777 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cecc77-0735-4001-8f31-779125e319ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:58.067766 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-d3cecc77-0735-4001-8f31-779125e319ea None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:58.068983 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-d3cecc77-0735-4001-8f31-779125e319ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:58.093443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:58.108015 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d2bc1-1e54-4334-ab79-e5e2021ff18a admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:58.110169 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-d44d2bc1-1e54-4334-ab79-e5e2021ff18a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:58.149430 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1272/2560] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:26:58.156923 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cecc77-0735-4001-8f31-779125e319ea None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:58.159541 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-d3cecc77-0735-4001-8f31-779125e319ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:58.203922 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d2bc1-1e54-4334-ab79-e5e2021ff18a admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:58.209633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd96b5-4ed1-4d70-9fa6-8bf66db45025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:58.210002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd96b5-4ed1-4d70-9fa6-8bf66db45025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:58.213755 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd96b5-4ed1-4d70-9fa6-8bf66db45025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:58.213755 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd96b5-4ed1-4d70-9fa6-8bf66db45025 admin admin] PATH_INFO: `/v3/projects/efc80273268041bbabfa946828aae5fe` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:58.213755 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd96b5-4ed1-4d70-9fa6-8bf66db45025 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efc80273268041bbabfa946828aae5fe)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:58.213755 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd96b5-4ed1-4d70-9fa6-8bf66db45025 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:58.228596 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cecc77-0735-4001-8f31-779125e319ea None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:58.232344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66faaf9-33d8-4eab-82e2-57df0dd4bbdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:58.236913 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66faaf9-33d8-4eab-82e2-57df0dd4bbdd service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:58.236913 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66faaf9-33d8-4eab-82e2-57df0dd4bbdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:58.236913 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66faaf9-33d8-4eab-82e2-57df0dd4bbdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:58.243930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66faaf9-33d8-4eab-82e2-57df0dd4bbdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:58.245429 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66faaf9-33d8-4eab-82e2-57df0dd4bbdd service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:58.255153 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1273/2561] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:26:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:26:58.304050 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2abd96b5-4ed1-4d70-9fa6-8bf66db45025 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efc80273268041bbabfa946828aae5fe', 'request_id': 'req-2abd96b5-4ed1-4d70-9fa6-8bf66db45025'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:58.311887 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2abd96b5-4ed1-4d70-9fa6-8bf66db45025 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efc80273268041bbabfa946828aae5fe', 'request_id': 'req-2abd96b5-4ed1-4d70-9fa6-8bf66db45025'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:58.320054 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2abd96b5-4ed1-4d70-9fa6-8bf66db45025 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efc80273268041bbabfa946828aae5fe', 'request_id': 'req-2abd96b5-4ed1-4d70-9fa6-8bf66db45025'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:58.377530 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2abd96b5-4ed1-4d70-9fa6-8bf66db45025 admin admin] The token cache is being invalidate because project efc80273268041bbabfa946828aae5fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:26:58.377530 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2abd96b5-4ed1-4d70-9fa6-8bf66db45025 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:58.377530 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2abd96b5-4ed1-4d70-9fa6-8bf66db45025 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:58.377530 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1289/2562] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:26:58 2022] DELETE /identity/v3/projects/efc80273268041bbabfa946828aae5fe => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:26:58.380960 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66faaf9-33d8-4eab-82e2-57df0dd4bbdd service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:58.391551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66faaf9-33d8-4eab-82e2-57df0dd4bbdd service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:58.453431 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbcff9-a9fb-4377-848a-bea043922b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:58.454136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbcff9-a9fb-4377-848a-bea043922b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:58.454419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbcff9-a9fb-4377-848a-bea043922b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:58.454777 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbcff9-a9fb-4377-848a-bea043922b40 admin admin] PATH_INFO: `/v3/users/39bcffba46ba4024af40ffe74136d537` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:58.455839 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bbcff9-a9fb-4377-848a-bea043922b40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39bcffba46ba4024af40ffe74136d537)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:58.457756 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bbcff9-a9fb-4377-848a-bea043922b40 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:58.677876 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-63bbcff9-a9fb-4377-848a-bea043922b40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39bcffba46ba4024af40ffe74136d537'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:58.678577 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-63bbcff9-a9fb-4377-848a-bea043922b40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39bcffba46ba4024af40ffe74136d537'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:58.679182 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-63bbcff9-a9fb-4377-848a-bea043922b40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39bcffba46ba4024af40ffe74136d537'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:58.714790 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd96b5-4ed1-4d70-9fa6-8bf66db45025 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:58.716310 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-2abd96b5-4ed1-4d70-9fa6-8bf66db45025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:58.729305 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-63bbcff9-a9fb-4377-848a-bea043922b40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39bcffba46ba4024af40ffe74136d537'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:58.736238 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd96b5-4ed1-4d70-9fa6-8bf66db45025 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:58.738416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-63bbcff9-a9fb-4377-848a-bea043922b40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39bcffba46ba4024af40ffe74136d537'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:58.744694 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e78496-d614-4dbd-988e-12dc26f34f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:58.745658 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e78496-d614-4dbd-988e-12dc26f34f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:58.745887 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e78496-d614-4dbd-988e-12dc26f34f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:58.746195 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e78496-d614-4dbd-988e-12dc26f34f06 admin admin] PATH_INFO: `/v3/projects/8ae588fecd454768a6c89bd441b83f77` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:58.747415 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e78496-d614-4dbd-988e-12dc26f34f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ae588fecd454768a6c89bd441b83f77)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:58.749549 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e78496-d614-4dbd-988e-12dc26f34f06 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:58.755713 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:58.757766 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:58.766385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1274/2563] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:26:58 2022] DELETE /identity/v3/users/39bcffba46ba4024af40ffe74136d537 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:26:58.855098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f3e78496-d614-4dbd-988e-12dc26f34f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ae588fecd454768a6c89bd441b83f77', 'request_id': 'req-f3e78496-d614-4dbd-988e-12dc26f34f06'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:58.863321 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f3e78496-d614-4dbd-988e-12dc26f34f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ae588fecd454768a6c89bd441b83f77', 'request_id': 'req-f3e78496-d614-4dbd-988e-12dc26f34f06'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:58.871804 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f3e78496-d614-4dbd-988e-12dc26f34f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ae588fecd454768a6c89bd441b83f77', 'request_id': 'req-f3e78496-d614-4dbd-988e-12dc26f34f06'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:58.998760 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f3e78496-d614-4dbd-988e-12dc26f34f06 admin admin] The token cache is being invalidate because project 8ae588fecd454768a6c89bd441b83f77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:26:58.999283 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f3e78496-d614-4dbd-988e-12dc26f34f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:58.999942 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f3e78496-d614-4dbd-988e-12dc26f34f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:59.002443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1290/2564] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:26:58 2022] DELETE /identity/v3/projects/8ae588fecd454768a6c89bd441b83f77 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:26:59.006628 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbcff9-a9fb-4377-848a-bea043922b40 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:59.007939 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-63bbcff9-a9fb-4377-848a-bea043922b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:59.086031 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbcff9-a9fb-4377-848a-bea043922b40 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:59.145505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a93f75-0011-40ac-bde4-6c94247d289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:59.146071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a93f75-0011-40ac-bde4-6c94247d289d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:59.146379 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a93f75-0011-40ac-bde4-6c94247d289d admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:59.146657 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a93f75-0011-40ac-bde4-6c94247d289d admin admin] PATH_INFO: `/v3/users/235444832c844c859a082b9dbe4835fc` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:59.147850 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a93f75-0011-40ac-bde4-6c94247d289d admin admin] RBAC: Authorizing `identity:delete_user(user_id=235444832c844c859a082b9dbe4835fc)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:59.149879 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a93f75-0011-40ac-bde4-6c94247d289d admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:59.241763 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e78496-d614-4dbd-988e-12dc26f34f06 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:59.243300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-f3e78496-d614-4dbd-988e-12dc26f34f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:59.257641 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e78496-d614-4dbd-988e-12dc26f34f06 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:59.264145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df86b9-f977-4d1b-9b87-508d70ba4732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:59.264798 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df86b9-f977-4d1b-9b87-508d70ba4732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:59.265098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df86b9-f977-4d1b-9b87-508d70ba4732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:59.265355 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df86b9-f977-4d1b-9b87-508d70ba4732 admin admin] PATH_INFO: `/v3/projects/8c83fc85b8fe4e6db8dd61c0cd8e2913` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:59.266841 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df86b9-f977-4d1b-9b87-508d70ba4732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c83fc85b8fe4e6db8dd61c0cd8e2913)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:59.268966 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df86b9-f977-4d1b-9b87-508d70ba4732 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:59.365252 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-98a93f75-0011-40ac-bde4-6c94247d289d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '235444832c844c859a082b9dbe4835fc'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:59.365891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-98a93f75-0011-40ac-bde4-6c94247d289d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '235444832c844c859a082b9dbe4835fc'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:59.366528 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-98a93f75-0011-40ac-bde4-6c94247d289d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '235444832c844c859a082b9dbe4835fc'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:59.369091 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-88df86b9-f977-4d1b-9b87-508d70ba4732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c83fc85b8fe4e6db8dd61c0cd8e2913', 'request_id': 'req-88df86b9-f977-4d1b-9b87-508d70ba4732'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:59.374719 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-88df86b9-f977-4d1b-9b87-508d70ba4732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c83fc85b8fe4e6db8dd61c0cd8e2913', 'request_id': 'req-88df86b9-f977-4d1b-9b87-508d70ba4732'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:59.381860 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-88df86b9-f977-4d1b-9b87-508d70ba4732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c83fc85b8fe4e6db8dd61c0cd8e2913', 'request_id': 'req-88df86b9-f977-4d1b-9b87-508d70ba4732'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:59.454570 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-98a93f75-0011-40ac-bde4-6c94247d289d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '235444832c844c859a082b9dbe4835fc'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:59.461994 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-98a93f75-0011-40ac-bde4-6c94247d289d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '235444832c844c859a082b9dbe4835fc'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:59.478908 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1275/2565] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:26:59 2022] DELETE /identity/v3/users/235444832c844c859a082b9dbe4835fc => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:26:59.506107 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-88df86b9-f977-4d1b-9b87-508d70ba4732 admin admin] The token cache is being invalidate because project 8c83fc85b8fe4e6db8dd61c0cd8e2913 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:26:59.506505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-88df86b9-f977-4d1b-9b87-508d70ba4732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:59.507142 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-88df86b9-f977-4d1b-9b87-508d70ba4732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:26:59.508681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1291/2566] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:26:59 2022] DELETE /identity/v3/projects/8c83fc85b8fe4e6db8dd61c0cd8e2913 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:26:59.515710 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4dc57-7d9b-4b61-9c5c-2fa462a05b9a None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:59.515990 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4dc57-7d9b-4b61-9c5c-2fa462a05b9a None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:59.516270 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4dc57-7d9b-4b61-9c5c-2fa462a05b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:59.540915 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-48e4dc57-7d9b-4b61-9c5c-2fa462a05b9a None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:59.542150 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-48e4dc57-7d9b-4b61-9c5c-2fa462a05b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:59.555977 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:59.604381 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1276/2567] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:26:59.612981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594063b5-5599-48d5-80b4-8aad079e2dc9 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:59.613271 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594063b5-5599-48d5-80b4-8aad079e2dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:59.613554 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594063b5-5599-48d5-80b4-8aad079e2dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:59.633771 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-594063b5-5599-48d5-80b4-8aad079e2dc9 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:26:59.635013 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-594063b5-5599-48d5-80b4-8aad079e2dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:59.643268 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1292/2568] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:26:59.647793 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4dc57-7d9b-4b61-9c5c-2fa462a05b9a None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:59.658137 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4dc57-7d9b-4b61-9c5c-2fa462a05b9a None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:59.667565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e511787-96a5-4c9d-b40a-f48e13d28c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:59.667565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e511787-96a5-4c9d-b40a-f48e13d28c20 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:59.667565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e511787-96a5-4c9d-b40a-f48e13d28c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:59.667565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e511787-96a5-4c9d-b40a-f48e13d28c20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:59.667927 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e511787-96a5-4c9d-b40a-f48e13d28c20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:26:59.667927 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e511787-96a5-4c9d-b40a-f48e13d28c20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:59.667927 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e511787-96a5-4c9d-b40a-f48e13d28c20 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:59.680670 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1277/2569] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 08:26:59.684967 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594063b5-5599-48d5-80b4-8aad079e2dc9 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:59.694971 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594063b5-5599-48d5-80b4-8aad079e2dc9 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:59.699834 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e2b6f-40d4-4849-a9ae-d2076107b22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:59.700435 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e2b6f-40d4-4849-a9ae-d2076107b22b admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:59.700724 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e2b6f-40d4-4849-a9ae-d2076107b22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:59.701002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e2b6f-40d4-4849-a9ae-d2076107b22b admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:59.701619 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e2b6f-40d4-4849-a9ae-d2076107b22b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:59.703698 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e2b6f-40d4-4849-a9ae-d2076107b22b admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:59.820585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1293/2570] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:26:59 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:26:59.821927 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e511787-96a5-4c9d-b40a-f48e13d28c20 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:59.832562 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e511787-96a5-4c9d-b40a-f48e13d28c20 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:59.915489 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cf680-e078-4f05-8d81-b188199e279b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:59.916018 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cf680-e078-4f05-8d81-b188199e279b admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:59.916303 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cf680-e078-4f05-8d81-b188199e279b admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:59.916578 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cf680-e078-4f05-8d81-b188199e279b admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:59.917198 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629cf680-e078-4f05-8d81-b188199e279b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:59.919765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629cf680-e078-4f05-8d81-b188199e279b admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:59.943659 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e2b6f-40d4-4849-a9ae-d2076107b22b admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:26:59.944114 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-077e2b6f-40d4-4849-a9ae-d2076107b22b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:26:59.960831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e2b6f-40d4-4849-a9ae-d2076107b22b admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:26:59.967631 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6eacf-384c-40b4-b8ef-76af6825109c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:26:59.968323 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6eacf-384c-40b4-b8ef-76af6825109c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:26:59.971097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6eacf-384c-40b4-b8ef-76af6825109c admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:26:59.971456 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6eacf-384c-40b4-b8ef-76af6825109c admin admin] PATH_INFO: `/v3/projects/8c13bfefb1b24c828b6c66dcde2d17af` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:26:59.972865 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6eacf-384c-40b4-b8ef-76af6825109c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c13bfefb1b24c828b6c66dcde2d17af)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:26:59.974776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6eacf-384c-40b4-b8ef-76af6825109c admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:26:59.997983 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1278/2571] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:26:59 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:27:00.002091 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cf680-e078-4f05-8d81-b188199e279b admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:00.011787 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cf680-e078-4f05-8d81-b188199e279b admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:00.016724 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64de75d-350f-4362-887a-e515cfe2a776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:00.017942 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64de75d-350f-4362-887a-e515cfe2a776 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:00.018352 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64de75d-350f-4362-887a-e515cfe2a776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:00.018632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64de75d-350f-4362-887a-e515cfe2a776 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:00.019267 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64de75d-350f-4362-887a-e515cfe2a776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:00.020925 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64de75d-350f-4362-887a-e515cfe2a776 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:00.031531 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1279/2572] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:27:00.036455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64de75d-350f-4362-887a-e515cfe2a776 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:00.045988 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64de75d-350f-4362-887a-e515cfe2a776 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:00.050874 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4665789-ce5b-4e76-88ba-3f2a27314378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:00.051442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4665789-ce5b-4e76-88ba-3f2a27314378 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:00.051718 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4665789-ce5b-4e76-88ba-3f2a27314378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:00.051986 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4665789-ce5b-4e76-88ba-3f2a27314378 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:00.052590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4665789-ce5b-4e76-88ba-3f2a27314378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:00.054242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4665789-ce5b-4e76-88ba-3f2a27314378 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:00.063914 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1280/2573] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:27:00.068224 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4665789-ce5b-4e76-88ba-3f2a27314378 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:00.077743 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4665789-ce5b-4e76-88ba-3f2a27314378 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:00.083028 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d19da-9503-45a0-a287-ee820084bed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:00.083647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d19da-9503-45a0-a287-ee820084bed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:00.083927 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d19da-9503-45a0-a287-ee820084bed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:00.084204 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d19da-9503-45a0-a287-ee820084bed2 admin admin] PATH_INFO: `/v3/projects/68e9fcda90cf4b91b8495798fb68e49b/users/6056566a75094ab9a2fb63e886a138a7/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:00.100179 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d19da-9503-45a0-a287-ee820084bed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68e9fcda90cf4b91b8495798fb68e49b, user_id=6056566a75094ab9a2fb63e886a138a7, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:00.102883 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d19da-9503-45a0-a287-ee820084bed2 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:00.115724 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:00.119447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-6ee6eacf-384c-40b4-b8ef-76af6825109c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c13bfefb1b24c828b6c66dcde2d17af', 'request_id': 'req-6ee6eacf-384c-40b4-b8ef-76af6825109c'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:00.125078 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-6ee6eacf-384c-40b4-b8ef-76af6825109c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c13bfefb1b24c828b6c66dcde2d17af', 'request_id': 'req-6ee6eacf-384c-40b4-b8ef-76af6825109c'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:00.134792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-6ee6eacf-384c-40b4-b8ef-76af6825109c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c13bfefb1b24c828b6c66dcde2d17af', 'request_id': 'req-6ee6eacf-384c-40b4-b8ef-76af6825109c'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:00.189106 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1281/2574] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:00 2022] PUT /identity/v3/projects/68e9fcda90cf4b91b8495798fb68e49b/users/6056566a75094ab9a2fb63e886a138a7/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:27:00.201908 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c397f5d-0538-4e51-a00e-861585cab27d None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:00.202194 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c397f5d-0538-4e51-a00e-861585cab27d None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:00.202504 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c397f5d-0538-4e51-a00e-861585cab27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:00.231523 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-4c397f5d-0538-4e51-a00e-861585cab27d None None] MFA Rules not processed for user `6056566a75094ab9a2fb63e886a138a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:00.232416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-6ee6eacf-384c-40b4-b8ef-76af6825109c admin admin] The token cache is being invalidate because project 8c13bfefb1b24c828b6c66dcde2d17af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:27:00.232416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-6ee6eacf-384c-40b4-b8ef-76af6825109c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:00.232773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-6ee6eacf-384c-40b4-b8ef-76af6825109c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:00.233102 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-4c397f5d-0538-4e51-a00e-861585cab27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:00.234859 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1294/2575] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:26:59 2022] DELETE /identity/v3/projects/8c13bfefb1b24c828b6c66dcde2d17af => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:00.238689 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6eacf-384c-40b4-b8ef-76af6825109c admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:00.240050 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-6ee6eacf-384c-40b4-b8ef-76af6825109c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:00.275699 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:00.303234 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1282/2576] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:27:00.306879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6eacf-384c-40b4-b8ef-76af6825109c admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:00.307937 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c397f5d-0538-4e51-a00e-861585cab27d None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:00.309344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-4c397f5d-0538-4e51-a00e-861585cab27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:00.366621 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f12cd-252f-47e9-81dd-16e03c532fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:00.367256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f12cd-252f-47e9-81dd-16e03c532fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:00.367554 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f12cd-252f-47e9-81dd-16e03c532fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:00.367815 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f12cd-252f-47e9-81dd-16e03c532fc8 admin admin] PATH_INFO: `/v3/users/7f6a7d32e9ce459d827229a08b8aac30` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:00.369009 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f12cd-252f-47e9-81dd-16e03c532fc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f6a7d32e9ce459d827229a08b8aac30)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:00.371045 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f12cd-252f-47e9-81dd-16e03c532fc8 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:00.374579 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c397f5d-0538-4e51-a00e-861585cab27d None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:00.380909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437651f-176d-454e-b763-c723b7da4499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:00.381538 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437651f-176d-454e-b763-c723b7da4499 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:00.381821 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437651f-176d-454e-b763-c723b7da4499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:00.382092 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437651f-176d-454e-b763-c723b7da4499 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:00.382749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437651f-176d-454e-b763-c723b7da4499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:00.384661 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437651f-176d-454e-b763-c723b7da4499 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:00.485161 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1283/2577] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:27:00 2022] POST /identity/v3/projects => generated 387 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:27:00.488811 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437651f-176d-454e-b763-c723b7da4499 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:00.551017 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437651f-176d-454e-b763-c723b7da4499 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:00.555642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d9d92-3e85-497b-b664-5ada4e883fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:00.556241 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d9d92-3e85-497b-b664-5ada4e883fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:00.556520 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d9d92-3e85-497b-b664-5ada4e883fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:00.556791 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d9d92-3e85-497b-b664-5ada4e883fa7 admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:00.557409 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d9d92-3e85-497b-b664-5ada4e883fa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:00.559393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d9d92-3e85-497b-b664-5ada4e883fa7 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:00.617468 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-267f12cd-252f-47e9-81dd-16e03c532fc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f6a7d32e9ce459d827229a08b8aac30'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:00.618127 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-267f12cd-252f-47e9-81dd-16e03c532fc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f6a7d32e9ce459d827229a08b8aac30'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:00.618814 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-267f12cd-252f-47e9-81dd-16e03c532fc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f6a7d32e9ce459d827229a08b8aac30'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:00.706858 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1284/2578] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:27:00 2022] POST /identity/v3/users => generated 300 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:27:00.710856 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d9d92-3e85-497b-b664-5ada4e883fa7 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:00.712505 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-271d9d92-3e85-497b-b664-5ada4e883fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:00.723319 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-267f12cd-252f-47e9-81dd-16e03c532fc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f6a7d32e9ce459d827229a08b8aac30'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:00.725313 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d9d92-3e85-497b-b664-5ada4e883fa7 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:00.730542 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008c4ea-4b7d-4aa4-b741-5854e793f58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:00.731147 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008c4ea-4b7d-4aa4-b741-5854e793f58e admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:00.731424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008c4ea-4b7d-4aa4-b741-5854e793f58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:00.734048 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008c4ea-4b7d-4aa4-b741-5854e793f58e admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:00.734048 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008c4ea-4b7d-4aa4-b741-5854e793f58e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:00.734048 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008c4ea-4b7d-4aa4-b741-5854e793f58e admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:00.738140 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-267f12cd-252f-47e9-81dd-16e03c532fc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f6a7d32e9ce459d827229a08b8aac30'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:00.745213 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1285/2579] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:27:00.746983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:00.749553 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008c4ea-4b7d-4aa4-b741-5854e793f58e admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:00.753060 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1295/2580] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:27:00 2022] DELETE /identity/v3/users/7f6a7d32e9ce459d827229a08b8aac30 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:00.763180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008c4ea-4b7d-4aa4-b741-5854e793f58e admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:00.808465 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:00.833083 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9c09c-9a31-4d74-aea9-3f740a97c11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:00.833750 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9c09c-9a31-4d74-aea9-3f740a97c11e admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:00.834031 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9c09c-9a31-4d74-aea9-3f740a97c11e admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:00.834329 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9c09c-9a31-4d74-aea9-3f740a97c11e admin admin] PATH_INFO: `/v3/projects/f3830e31491a47cd912422562ff4be0b/users/8c3892d112df4060bafd2f7e1d718e33/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:00.850410 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9c09c-9a31-4d74-aea9-3f740a97c11e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3830e31491a47cd912422562ff4be0b, user_id=8c3892d112df4060bafd2f7e1d718e33, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:00.853058 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9c09c-9a31-4d74-aea9-3f740a97c11e admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:00.966983 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1286/2581] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:00 2022] PUT /identity/v3/projects/f3830e31491a47cd912422562ff4be0b/users/8c3892d112df4060bafd2f7e1d718e33/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:27:00.971068 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f12cd-252f-47e9-81dd-16e03c532fc8 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:00.981124 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f12cd-252f-47e9-81dd-16e03c532fc8 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:01.043706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d659a06-f0fc-4747-b931-7db760b81a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:01.050078 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d659a06-f0fc-4747-b931-7db760b81a99 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:01.050078 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d659a06-f0fc-4747-b931-7db760b81a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:01.050078 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d659a06-f0fc-4747-b931-7db760b81a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:01.050078 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d659a06-f0fc-4747-b931-7db760b81a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:01.050078 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d659a06-f0fc-4747-b931-7db760b81a99 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:01.057656 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1296/2582] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:01.061817 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9c09c-9a31-4d74-aea9-3f740a97c11e admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:01.072444 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9c09c-9a31-4d74-aea9-3f740a97c11e admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:01.077643 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f61a7a-e552-47e6-bd8f-babc028e5cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:01.078720 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f61a7a-e552-47e6-bd8f-babc028e5cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:01.084411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f61a7a-e552-47e6-bd8f-babc028e5cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:01.084411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f61a7a-e552-47e6-bd8f-babc028e5cc3 admin admin] PATH_INFO: `/v3/projects/f3830e31491a47cd912422562ff4be0b/users/8c3892d112df4060bafd2f7e1d718e33/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:01.084411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f61a7a-e552-47e6-bd8f-babc028e5cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3830e31491a47cd912422562ff4be0b, user_id=8c3892d112df4060bafd2f7e1d718e33, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:01.084411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f61a7a-e552-47e6-bd8f-babc028e5cc3 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:01.094318 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1287/2583] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:01 2022] PUT /identity/v3/projects/f3830e31491a47cd912422562ff4be0b/users/8c3892d112df4060bafd2f7e1d718e33/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:27:01.106825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ded1d-0355-431d-943c-a38a92d89fb0 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:01.107115 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ded1d-0355-431d-943c-a38a92d89fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:01.107521 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ded1d-0355-431d-943c-a38a92d89fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:01.137047 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-e81ded1d-0355-431d-943c-a38a92d89fb0 None None] MFA Rules not processed for user `8c3892d112df4060bafd2f7e1d718e33`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:01.138426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-e81ded1d-0355-431d-943c-a38a92d89fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:01.210115 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1297/2584] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:01 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:01.222670 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f61a7a-e552-47e6-bd8f-babc028e5cc3 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:01.224384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-78f61a7a-e552-47e6-bd8f-babc028e5cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:01.252185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ded1d-0355-431d-943c-a38a92d89fb0 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:01.253640 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-e81ded1d-0355-431d-943c-a38a92d89fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:01.311709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f61a7a-e552-47e6-bd8f-babc028e5cc3 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:01.315912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607cf5d9-389f-42ae-b55e-5f7be1f5dfa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:01.316517 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cf5d9-389f-42ae-b55e-5f7be1f5dfa8 service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:01.317409 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cf5d9-389f-42ae-b55e-5f7be1f5dfa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:01.317409 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cf5d9-389f-42ae-b55e-5f7be1f5dfa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:01.326579 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ded1d-0355-431d-943c-a38a92d89fb0 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:01.327419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607cf5d9-389f-42ae-b55e-5f7be1f5dfa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:01.329161 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607cf5d9-389f-42ae-b55e-5f7be1f5dfa8 service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:01.333472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decefdb6-111d-4fbc-9dc4-2d677ef8a84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:01.334760 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decefdb6-111d-4fbc-9dc4-2d677ef8a84f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:01.335124 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decefdb6-111d-4fbc-9dc4-2d677ef8a84f admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:01.335409 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decefdb6-111d-4fbc-9dc4-2d677ef8a84f admin admin] PATH_INFO: `/v3/projects/2503837d863f44409b6fa6857fba1948` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:01.336591 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decefdb6-111d-4fbc-9dc4-2d677ef8a84f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2503837d863f44409b6fa6857fba1948)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:01.338584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decefdb6-111d-4fbc-9dc4-2d677ef8a84f admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:01.340644 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1288/2585] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:01 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:27:01.366563 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:01.458651 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-decefdb6-111d-4fbc-9dc4-2d677ef8a84f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2503837d863f44409b6fa6857fba1948', 'request_id': 'req-decefdb6-111d-4fbc-9dc4-2d677ef8a84f'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:01.463994 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-decefdb6-111d-4fbc-9dc4-2d677ef8a84f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2503837d863f44409b6fa6857fba1948', 'request_id': 'req-decefdb6-111d-4fbc-9dc4-2d677ef8a84f'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:01.471189 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-decefdb6-111d-4fbc-9dc4-2d677ef8a84f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2503837d863f44409b6fa6857fba1948', 'request_id': 'req-decefdb6-111d-4fbc-9dc4-2d677ef8a84f'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:01.536078 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-decefdb6-111d-4fbc-9dc4-2d677ef8a84f admin admin] The token cache is being invalidate because project 2503837d863f44409b6fa6857fba1948 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:27:01.536600 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-decefdb6-111d-4fbc-9dc4-2d677ef8a84f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:01.537263 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-decefdb6-111d-4fbc-9dc4-2d677ef8a84f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:01.539062 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1298/2586] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:27:01 2022] DELETE /identity/v3/projects/2503837d863f44409b6fa6857fba1948 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:27:01.546713 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94017c3-8e8d-45c3-b4e2-6c46f6b2f257 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:01.547250 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94017c3-8e8d-45c3-b4e2-6c46f6b2f257 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:01.547250 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94017c3-8e8d-45c3-b4e2-6c46f6b2f257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:01.567449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-f94017c3-8e8d-45c3-b4e2-6c46f6b2f257 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:01.568759 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-f94017c3-8e8d-45c3-b4e2-6c46f6b2f257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:01.627931 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1289/2587] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:27:01.636588 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035bc59-f8ce-4f60-978e-d86841149abe None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:01.636878 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035bc59-f8ce-4f60-978e-d86841149abe None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:01.637179 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035bc59-f8ce-4f60-978e-d86841149abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:01.659199 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-f035bc59-f8ce-4f60-978e-d86841149abe None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:01.660541 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-f035bc59-f8ce-4f60-978e-d86841149abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:01.668693 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1299/2588] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:01.673190 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94017c3-8e8d-45c3-b4e2-6c46f6b2f257 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:01.683040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94017c3-8e8d-45c3-b4e2-6c46f6b2f257 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:01.687992 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748feacf-e31d-4887-a75a-49dac15d100f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:01.698331 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748feacf-e31d-4887-a75a-49dac15d100f admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:01.698331 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748feacf-e31d-4887-a75a-49dac15d100f admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:01.698331 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748feacf-e31d-4887-a75a-49dac15d100f admin admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:01.698331 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748feacf-e31d-4887-a75a-49dac15d100f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:27:01.698331 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748feacf-e31d-4887-a75a-49dac15d100f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:01.698331 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748feacf-e31d-4887-a75a-49dac15d100f admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:01.704917 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1290/2589] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:27:01.709249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035bc59-f8ce-4f60-978e-d86841149abe None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:01.718765 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035bc59-f8ce-4f60-978e-d86841149abe None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:01.725561 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3a715-3e02-43ae-9d70-8b2be43a03d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:01.726418 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3a715-3e02-43ae-9d70-8b2be43a03d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:01.726524 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3a715-3e02-43ae-9d70-8b2be43a03d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:01.726723 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3a715-3e02-43ae-9d70-8b2be43a03d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:01.727355 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df3a715-3e02-43ae-9d70-8b2be43a03d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:01.729577 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df3a715-3e02-43ae-9d70-8b2be43a03d7 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:01.843950 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1300/2590] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:27:01 2022] POST /identity/v3/projects => generated 409 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:27:01.847847 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748feacf-e31d-4887-a75a-49dac15d100f admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:01.857696 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748feacf-e31d-4887-a75a-49dac15d100f admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:01.901641 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:01.919793 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037d398-870b-4b23-83f6-d9409dda0cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:01.920419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037d398-870b-4b23-83f6-d9409dda0cff admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:01.921057 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037d398-870b-4b23-83f6-d9409dda0cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:01.921057 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037d398-870b-4b23-83f6-d9409dda0cff admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:01.921758 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037d398-870b-4b23-83f6-d9409dda0cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:01.924182 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037d398-870b-4b23-83f6-d9409dda0cff admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:02.030303 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1291/2591] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:27:01 2022] POST /identity/v3/users => generated 305 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:27:02.030411 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3a715-3e02-43ae-9d70-8b2be43a03d7 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:02.041456 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3a715-3e02-43ae-9d70-8b2be43a03d7 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:02.050209 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee46f1-be5b-4711-a625-4bad78a08b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:02.050875 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee46f1-be5b-4711-a625-4bad78a08b46 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:02.051160 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee46f1-be5b-4711-a625-4bad78a08b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:02.051439 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee46f1-be5b-4711-a625-4bad78a08b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:02.052159 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee46f1-be5b-4711-a625-4bad78a08b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:02.053767 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee46f1-be5b-4711-a625-4bad78a08b46 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:02.065077 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1301/2592] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:02.071783 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037d398-870b-4b23-83f6-d9409dda0cff admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:02.082466 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037d398-870b-4b23-83f6-d9409dda0cff admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:02.087049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904dd8d-0995-4b23-a42e-a46bdf8bbd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:02.087640 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904dd8d-0995-4b23-a42e-a46bdf8bbd4d admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:02.087929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904dd8d-0995-4b23-a42e-a46bdf8bbd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:02.088203 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904dd8d-0995-4b23-a42e-a46bdf8bbd4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:02.088841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904dd8d-0995-4b23-a42e-a46bdf8bbd4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:02.090474 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904dd8d-0995-4b23-a42e-a46bdf8bbd4d admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:02.101455 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1292/2593] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:02.105607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee46f1-be5b-4711-a625-4bad78a08b46 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:02.115596 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee46f1-be5b-4711-a625-4bad78a08b46 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:02.120176 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878ec2a-79fb-4b4a-b355-fad5e5e37c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:02.120818 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878ec2a-79fb-4b4a-b355-fad5e5e37c24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:02.121095 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878ec2a-79fb-4b4a-b355-fad5e5e37c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:02.121371 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878ec2a-79fb-4b4a-b355-fad5e5e37c24 admin admin] PATH_INFO: `/v3/projects/7013ecc2814e4dd2a86445cdb3519335/users/e92d25c9ac6a42cb9a4e1ae5e35a2967/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:02.139304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878ec2a-79fb-4b4a-b355-fad5e5e37c24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7013ecc2814e4dd2a86445cdb3519335, user_id=e92d25c9ac6a42cb9a4e1ae5e35a2967, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:02.139304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878ec2a-79fb-4b4a-b355-fad5e5e37c24 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:02.220450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1302/2594] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:02 2022] PUT /identity/v3/projects/7013ecc2814e4dd2a86445cdb3519335/users/e92d25c9ac6a42cb9a4e1ae5e35a2967/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:02.231858 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb19936-8fe1-4dc9-acb6-990ff6e02f3c None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:02.232142 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb19936-8fe1-4dc9-acb6-990ff6e02f3c None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:02.232443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb19936-8fe1-4dc9-acb6-990ff6e02f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:02.260656 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-feb19936-8fe1-4dc9-acb6-990ff6e02f3c None None] MFA Rules not processed for user `e92d25c9ac6a42cb9a4e1ae5e35a2967`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:02.261865 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-feb19936-8fe1-4dc9-acb6-990ff6e02f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:02.328495 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1293/2595] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:02 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:27:02.337591 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878ec2a-79fb-4b4a-b355-fad5e5e37c24 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:02.401432 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878ec2a-79fb-4b4a-b355-fad5e5e37c24 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:02.406132 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ed493-2c09-415a-9c6b-a003d908b621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:02.406780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ed493-2c09-415a-9c6b-a003d908b621 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:02.407135 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ed493-2c09-415a-9c6b-a003d908b621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:02.407449 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ed493-2c09-415a-9c6b-a003d908b621 admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:02.408078 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ed493-2c09-415a-9c6b-a003d908b621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:02.410128 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ed493-2c09-415a-9c6b-a003d908b621 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:02.465044 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb19936-8fe1-4dc9-acb6-990ff6e02f3c None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:02.466456 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-feb19936-8fe1-4dc9-acb6-990ff6e02f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:02.479533 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb19936-8fe1-4dc9-acb6-990ff6e02f3c None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:02.484237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede10a1b-18af-40d6-91cd-53b2f8fd14db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:02.486883 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede10a1b-18af-40d6-91cd-53b2f8fd14db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:02.486883 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede10a1b-18af-40d6-91cd-53b2f8fd14db admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:02.486883 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede10a1b-18af-40d6-91cd-53b2f8fd14db admin admin] PATH_INFO: `/v3/users/18ece95514744aee88d2d66d38be0f8e` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:02.487274 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede10a1b-18af-40d6-91cd-53b2f8fd14db admin admin] RBAC: Authorizing `identity:delete_user(user_id=18ece95514744aee88d2d66d38be0f8e)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:02.488974 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede10a1b-18af-40d6-91cd-53b2f8fd14db admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:02.514386 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1303/2596] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:27:02 2022] POST /identity/v3/projects => generated 409 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:27:02.518883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ed493-2c09-415a-9c6b-a003d908b621 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:02.553508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:02.584791 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ed493-2c09-415a-9c6b-a003d908b621 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:02.589524 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426697b1-ecde-44d9-88e7-05fc28597960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:02.590168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426697b1-ecde-44d9-88e7-05fc28597960 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:02.590480 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426697b1-ecde-44d9-88e7-05fc28597960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:02.590758 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426697b1-ecde-44d9-88e7-05fc28597960 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:02.591412 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426697b1-ecde-44d9-88e7-05fc28597960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:02.593342 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426697b1-ecde-44d9-88e7-05fc28597960 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:02.692442 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1304/2597] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:27:02 2022] POST /identity/v3/users => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:27:02.692442 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426697b1-ecde-44d9-88e7-05fc28597960 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:02.692442 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-426697b1-ecde-44d9-88e7-05fc28597960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:02.697265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ede10a1b-18af-40d6-91cd-53b2f8fd14db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18ece95514744aee88d2d66d38be0f8e'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:02.699023 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ede10a1b-18af-40d6-91cd-53b2f8fd14db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18ece95514744aee88d2d66d38be0f8e'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:02.699023 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ede10a1b-18af-40d6-91cd-53b2f8fd14db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18ece95514744aee88d2d66d38be0f8e'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:02.704356 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426697b1-ecde-44d9-88e7-05fc28597960 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:02.709896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e27c3-57b7-4579-b86a-d5d98899948a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:02.710609 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e27c3-57b7-4579-b86a-d5d98899948a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:02.710897 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e27c3-57b7-4579-b86a-d5d98899948a admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:02.711177 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e27c3-57b7-4579-b86a-d5d98899948a admin admin] PATH_INFO: `/v3/users/6056566a75094ab9a2fb63e886a138a7` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:02.712307 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e27c3-57b7-4579-b86a-d5d98899948a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6056566a75094ab9a2fb63e886a138a7)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:02.714369 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e27c3-57b7-4579-b86a-d5d98899948a admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:02.774657 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ede10a1b-18af-40d6-91cd-53b2f8fd14db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18ece95514744aee88d2d66d38be0f8e'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:02.782465 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ede10a1b-18af-40d6-91cd-53b2f8fd14db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18ece95514744aee88d2d66d38be0f8e'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:02.799557 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1294/2598] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:27:02 2022] DELETE /identity/v3/users/18ece95514744aee88d2d66d38be0f8e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:27:02.800460 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede10a1b-18af-40d6-91cd-53b2f8fd14db admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:02.801828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-ede10a1b-18af-40d6-91cd-53b2f8fd14db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:02.828315 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:02.865345 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede10a1b-18af-40d6-91cd-53b2f8fd14db admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:02.869919 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957d094-d2bf-4012-8c8f-bd3fd17125fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:02.870792 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957d094-d2bf-4012-8c8f-bd3fd17125fe admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:02.871081 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957d094-d2bf-4012-8c8f-bd3fd17125fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:02.876789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957d094-d2bf-4012-8c8f-bd3fd17125fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:02.876789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957d094-d2bf-4012-8c8f-bd3fd17125fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:02.876789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957d094-d2bf-4012-8c8f-bd3fd17125fe admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:02.883838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1295/2599] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:02.884966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ead83-13d1-4911-8469-93180fcd4b93 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:02.885246 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ead83-13d1-4911-8469-93180fcd4b93 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:02.885522 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ead83-13d1-4911-8469-93180fcd4b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:02.904013 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-a70ead83-13d1-4911-8469-93180fcd4b93 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:02.905170 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a70ead83-13d1-4911-8469-93180fcd4b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:02.908353 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d69e27c3-57b7-4579-b86a-d5d98899948a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6056566a75094ab9a2fb63e886a138a7'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:02.909051 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d69e27c3-57b7-4579-b86a-d5d98899948a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6056566a75094ab9a2fb63e886a138a7'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:02.918429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d69e27c3-57b7-4579-b86a-d5d98899948a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6056566a75094ab9a2fb63e886a138a7'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:02.918580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1296/2600] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:02.918580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ead83-13d1-4911-8469-93180fcd4b93 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:02.918580 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a70ead83-13d1-4911-8469-93180fcd4b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:02.927228 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ead83-13d1-4911-8469-93180fcd4b93 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:02.932954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee5cbf-759b-48da-8ecd-a451d702ce8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:02.938632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee5cbf-759b-48da-8ecd-a451d702ce8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:02.938632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee5cbf-759b-48da-8ecd-a451d702ce8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:02.938632 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee5cbf-759b-48da-8ecd-a451d702ce8c admin admin] PATH_INFO: `/v3/projects/ccf2969eff04449291ba6f86c832067e/users/8ae0dd54a50248ff8f8ec4660d0313d3/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:02.950611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee5cbf-759b-48da-8ecd-a451d702ce8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf2969eff04449291ba6f86c832067e, user_id=8ae0dd54a50248ff8f8ec4660d0313d3, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:02.953300 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee5cbf-759b-48da-8ecd-a451d702ce8c admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:03.042767 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d69e27c3-57b7-4579-b86a-d5d98899948a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6056566a75094ab9a2fb63e886a138a7'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:03.055750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d69e27c3-57b7-4579-b86a-d5d98899948a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6056566a75094ab9a2fb63e886a138a7'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:03.068482 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1305/2601] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:27:02 2022] DELETE /identity/v3/users/6056566a75094ab9a2fb63e886a138a7 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:03.069266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e27c3-57b7-4579-b86a-d5d98899948a admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:03.070671 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-d69e27c3-57b7-4579-b86a-d5d98899948a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:03.078862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1297/2602] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:02 2022] PUT /identity/v3/projects/ccf2969eff04449291ba6f86c832067e/users/8ae0dd54a50248ff8f8ec4660d0313d3/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:03.080442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f50249-83ff-4d80-b1f5-9531475faecc None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:03.080727 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f50249-83ff-4d80-b1f5-9531475faecc None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:03.081001 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f50249-83ff-4d80-b1f5-9531475faecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:03.099744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-c0f50249-83ff-4d80-b1f5-9531475faecc None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:03.100960 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-c0f50249-83ff-4d80-b1f5-9531475faecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:03.130304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e27c3-57b7-4579-b86a-d5d98899948a admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:03.164536 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1298/2603] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:03.164536 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f50249-83ff-4d80-b1f5-9531475faecc None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:03.171707 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f50249-83ff-4d80-b1f5-9531475faecc None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:03.177524 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382abde-5257-4756-8492-6166d0c4f68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:03.178166 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382abde-5257-4756-8492-6166d0c4f68f admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:03.178475 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382abde-5257-4756-8492-6166d0c4f68f admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:03.182749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382abde-5257-4756-8492-6166d0c4f68f admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:03.182749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382abde-5257-4756-8492-6166d0c4f68f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:03.182749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382abde-5257-4756-8492-6166d0c4f68f admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:03.183028 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257636ff-73af-4887-928f-700fbe5391fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:03.183028 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257636ff-73af-4887-928f-700fbe5391fd service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:03.183211 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257636ff-73af-4887-928f-700fbe5391fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:03.183313 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257636ff-73af-4887-928f-700fbe5391fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:03.192607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1299/2604] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:03.193502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257636ff-73af-4887-928f-700fbe5391fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:03.193646 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382abde-5257-4756-8492-6166d0c4f68f admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:03.195153 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257636ff-73af-4887-928f-700fbe5391fd service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:03.203210 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382abde-5257-4756-8492-6166d0c4f68f admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:03.204924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1306/2605] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:27:03.205880 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257636ff-73af-4887-928f-700fbe5391fd service neutron] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:03.207446 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87cf94-b5c7-4b9c-854b-9fc2dbfd041d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:03.212188 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87cf94-b5c7-4b9c-854b-9fc2dbfd041d service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:03.212188 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87cf94-b5c7-4b9c-854b-9fc2dbfd041d service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:03.212188 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87cf94-b5c7-4b9c-854b-9fc2dbfd041d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:03.214904 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257636ff-73af-4887-928f-700fbe5391fd service neutron] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:03.218569 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87cf94-b5c7-4b9c-854b-9fc2dbfd041d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:03.220033 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87cf94-b5c7-4b9c-854b-9fc2dbfd041d service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:03.220560 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fb0b8-d518-48a4-abad-e7c8cfb0a347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:03.221452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fb0b8-d518-48a4-abad-e7c8cfb0a347 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:03.221834 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fb0b8-d518-48a4-abad-e7c8cfb0a347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:03.222429 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fb0b8-d518-48a4-abad-e7c8cfb0a347 admin admin] PATH_INFO: `/v3/projects/ccf2969eff04449291ba6f86c832067e/users/8ae0dd54a50248ff8f8ec4660d0313d3/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:03.225513 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136fb0b8-d518-48a4-abad-e7c8cfb0a347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf2969eff04449291ba6f86c832067e, user_id=8ae0dd54a50248ff8f8ec4660d0313d3, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:03.228351 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136fb0b8-d518-48a4-abad-e7c8cfb0a347 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:03.229995 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1300/2606] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:27:03.240575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1307/2607] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:03 2022] PUT /identity/v3/projects/ccf2969eff04449291ba6f86c832067e/users/8ae0dd54a50248ff8f8ec4660d0313d3/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:03.252727 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cc307-0c67-4b41-8fe7-32d47d97060d None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:03.253019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cc307-0c67-4b41-8fe7-32d47d97060d None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:03.253296 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cc307-0c67-4b41-8fe7-32d47d97060d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:03.260615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:03.280430 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-848cc307-0c67-4b41-8fe7-32d47d97060d None None] MFA Rules not processed for user `8ae0dd54a50248ff8f8ec4660d0313d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:03.281778 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-848cc307-0c67-4b41-8fe7-32d47d97060d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:03.334168 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:03.353914 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1301/2608] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:03 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:03.366647 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fb0b8-d518-48a4-abad-e7c8cfb0a347 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:03.368523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-136fb0b8-d518-48a4-abad-e7c8cfb0a347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:03.426042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fb0b8-d518-48a4-abad-e7c8cfb0a347 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:03.429823 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e1c73-460b-4a74-b677-eea4f80b28ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:03.430470 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e1c73-460b-4a74-b677-eea4f80b28ec service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:03.431113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e1c73-460b-4a74-b677-eea4f80b28ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:03.431113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e1c73-460b-4a74-b677-eea4f80b28ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:03.440794 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e1c73-460b-4a74-b677-eea4f80b28ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:03.442246 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e1c73-460b-4a74-b677-eea4f80b28ec service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:03.452161 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1308/2609] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:03 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:27:03.713905 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848cc307-0c67-4b41-8fe7-32d47d97060d None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:03.715387 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-848cc307-0c67-4b41-8fe7-32d47d97060d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:03.749858 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e1c73-460b-4a74-b677-eea4f80b28ec service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:03.751639 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-4d0e1c73-460b-4a74-b677-eea4f80b28ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:03.804654 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848cc307-0c67-4b41-8fe7-32d47d97060d None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:03.809414 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a1da2-aae1-4e3a-92e6-2e96ca0c0e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:03.810000 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a1da2-aae1-4e3a-92e6-2e96ca0c0e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:03.810276 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a1da2-aae1-4e3a-92e6-2e96ca0c0e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:03.810578 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a1da2-aae1-4e3a-92e6-2e96ca0c0e3d admin admin] PATH_INFO: `/v3/projects/6601928f32a64bc48f9ab9bd4eed29a7` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:03.811687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a1da2-aae1-4e3a-92e6-2e96ca0c0e3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6601928f32a64bc48f9ab9bd4eed29a7)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:03.813583 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a1da2-aae1-4e3a-92e6-2e96ca0c0e3d admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:03.826681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e1c73-460b-4a74-b677-eea4f80b28ec service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:03.832698 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a04004-d764-484e-a2eb-fe99823c4958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:03.833811 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a04004-d764-484e-a2eb-fe99823c4958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:03.833999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a04004-d764-484e-a2eb-fe99823c4958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:03.834484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a04004-d764-484e-a2eb-fe99823c4958 admin admin] PATH_INFO: `/v3/projects/68e9fcda90cf4b91b8495798fb68e49b` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:03.835787 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a04004-d764-484e-a2eb-fe99823c4958 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68e9fcda90cf4b91b8495798fb68e49b)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:03.839151 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a04004-d764-484e-a2eb-fe99823c4958 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:03.940446 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-892a1da2-aae1-4e3a-92e6-2e96ca0c0e3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6601928f32a64bc48f9ab9bd4eed29a7', 'request_id': 'req-892a1da2-aae1-4e3a-92e6-2e96ca0c0e3d'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:03.945916 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-892a1da2-aae1-4e3a-92e6-2e96ca0c0e3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6601928f32a64bc48f9ab9bd4eed29a7', 'request_id': 'req-892a1da2-aae1-4e3a-92e6-2e96ca0c0e3d'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:03.952041 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-892a1da2-aae1-4e3a-92e6-2e96ca0c0e3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6601928f32a64bc48f9ab9bd4eed29a7', 'request_id': 'req-892a1da2-aae1-4e3a-92e6-2e96ca0c0e3d'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:03.991747 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-29a04004-d764-484e-a2eb-fe99823c4958 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68e9fcda90cf4b91b8495798fb68e49b', 'request_id': 'req-29a04004-d764-484e-a2eb-fe99823c4958'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:03.997089 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-29a04004-d764-484e-a2eb-fe99823c4958 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68e9fcda90cf4b91b8495798fb68e49b', 'request_id': 'req-29a04004-d764-484e-a2eb-fe99823c4958'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:04.003423 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-29a04004-d764-484e-a2eb-fe99823c4958 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68e9fcda90cf4b91b8495798fb68e49b', 'request_id': 'req-29a04004-d764-484e-a2eb-fe99823c4958'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:04.071576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-892a1da2-aae1-4e3a-92e6-2e96ca0c0e3d admin admin] The token cache is being invalidate because project 6601928f32a64bc48f9ab9bd4eed29a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:27:04.071860 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-892a1da2-aae1-4e3a-92e6-2e96ca0c0e3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:04.072522 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-892a1da2-aae1-4e3a-92e6-2e96ca0c0e3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:04.074087 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1302/2610] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:27:03 2022] DELETE /identity/v3/projects/6601928f32a64bc48f9ab9bd4eed29a7 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:04.074914 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a1da2-aae1-4e3a-92e6-2e96ca0c0e3d admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:04.076264 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-892a1da2-aae1-4e3a-92e6-2e96ca0c0e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:04.133228 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a1da2-aae1-4e3a-92e6-2e96ca0c0e3d admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:04.133528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-29a04004-d764-484e-a2eb-fe99823c4958 admin admin] The token cache is being invalidate because project 68e9fcda90cf4b91b8495798fb68e49b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:27:04.133822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-29a04004-d764-484e-a2eb-fe99823c4958 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:04.134480 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-29a04004-d764-484e-a2eb-fe99823c4958 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:04.135960 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1309/2611] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:27:03 2022] DELETE /identity/v3/projects/68e9fcda90cf4b91b8495798fb68e49b => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:27:04.140517 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a89f31-01e8-4c00-92e4-546ea5c8601a None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:04.140669 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a89f31-01e8-4c00-92e4-546ea5c8601a None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:04.140908 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a89f31-01e8-4c00-92e4-546ea5c8601a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:04.160922 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-f1a89f31-01e8-4c00-92e4-546ea5c8601a None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:04.162113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-f1a89f31-01e8-4c00-92e4-546ea5c8601a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:04.166122 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:04.167785 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:04.182446 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c844aab-f412-4c30-8a59-df2abd92699a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:04.183060 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c844aab-f412-4c30-8a59-df2abd92699a service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:04.183342 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c844aab-f412-4c30-8a59-df2abd92699a service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:04.183615 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c844aab-f412-4c30-8a59-df2abd92699a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:04.185414 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-1c844aab-f412-4c30-8a59-df2abd92699a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:04.232180 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1310/2612] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:04.232180 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a89f31-01e8-4c00-92e4-546ea5c8601a None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:04.232180 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-f1a89f31-01e8-4c00-92e4-546ea5c8601a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:04.239542 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a89f31-01e8-4c00-92e4-546ea5c8601a None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:04.244431 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e240f-9e81-42da-8490-73cf33585c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:04.245142 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e240f-9e81-42da-8490-73cf33585c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:04.245562 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e240f-9e81-42da-8490-73cf33585c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:04.245841 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e240f-9e81-42da-8490-73cf33585c6c admin admin] PATH_INFO: `/v3/users/8c3892d112df4060bafd2f7e1d718e33` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:04.247172 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e240f-9e81-42da-8490-73cf33585c6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c3892d112df4060bafd2f7e1d718e33)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:04.249010 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e240f-9e81-42da-8490-73cf33585c6c admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:04.253715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c844aab-f412-4c30-8a59-df2abd92699a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:04.255215 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c844aab-f412-4c30-8a59-df2abd92699a service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:04.264391 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1303/2613] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:04 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:27:04.265584 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34a4ab-8dc1-4214-8794-b4f5699f30c8 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:04.266654 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34a4ab-8dc1-4214-8794-b4f5699f30c8 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:04.266654 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34a4ab-8dc1-4214-8794-b4f5699f30c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:04.286678 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-2e34a4ab-8dc1-4214-8794-b4f5699f30c8 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:04.287912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-2e34a4ab-8dc1-4214-8794-b4f5699f30c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:04.295838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1304/2614] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:04.300784 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34a4ab-8dc1-4214-8794-b4f5699f30c8 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:04.310543 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34a4ab-8dc1-4214-8794-b4f5699f30c8 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:04.316422 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0a4e3-b550-49ce-ad69-c527c23bfabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:04.317011 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0a4e3-b550-49ce-ad69-c527c23bfabd admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:04.317292 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0a4e3-b550-49ce-ad69-c527c23bfabd admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:04.317566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0a4e3-b550-49ce-ad69-c527c23bfabd admin admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:04.318198 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0a4e3-b550-49ce-ad69-c527c23bfabd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:27:04.318534 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0a4e3-b550-49ce-ad69-c527c23bfabd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:04.320155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0a4e3-b550-49ce-ad69-c527c23bfabd admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:04.334045 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1305/2615] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 08:27:04.338787 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0a4e3-b550-49ce-ad69-c527c23bfabd admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:04.348583 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0a4e3-b550-49ce-ad69-c527c23bfabd admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:04.353073 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1104585-c4fa-4013-b9b6-2caff37a3498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:04.353658 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1104585-c4fa-4013-b9b6-2caff37a3498 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:04.354071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1104585-c4fa-4013-b9b6-2caff37a3498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:04.354244 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1104585-c4fa-4013-b9b6-2caff37a3498 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:04.354836 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1104585-c4fa-4013-b9b6-2caff37a3498 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:04.356818 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1104585-c4fa-4013-b9b6-2caff37a3498 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:04.430456 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-e56e240f-9e81-42da-8490-73cf33585c6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c3892d112df4060bafd2f7e1d718e33'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:04.431150 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-e56e240f-9e81-42da-8490-73cf33585c6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c3892d112df4060bafd2f7e1d718e33'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:04.432109 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-e56e240f-9e81-42da-8490-73cf33585c6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c3892d112df4060bafd2f7e1d718e33'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:04.456717 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1306/2616] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:27:04 2022] POST /identity/v3/projects => generated 363 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:27:04.461241 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1104585-c4fa-4013-b9b6-2caff37a3498 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:04.462634 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-e1104585-c4fa-4013-b9b6-2caff37a3498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:04.526652 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1104585-c4fa-4013-b9b6-2caff37a3498 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:04.531281 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254e69e-758e-4d6f-9fca-d1dd6f053e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:04.531873 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254e69e-758e-4d6f-9fca-d1dd6f053e0a admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:04.532149 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254e69e-758e-4d6f-9fca-d1dd6f053e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:04.532418 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254e69e-758e-4d6f-9fca-d1dd6f053e0a admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:04.533324 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254e69e-758e-4d6f-9fca-d1dd6f053e0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:04.535275 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254e69e-758e-4d6f-9fca-d1dd6f053e0a admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:04.540334 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-e56e240f-9e81-42da-8490-73cf33585c6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c3892d112df4060bafd2f7e1d718e33'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:04.554101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-e56e240f-9e81-42da-8490-73cf33585c6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c3892d112df4060bafd2f7e1d718e33'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:04.566922 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1311/2617] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:27:04 2022] DELETE /identity/v3/users/8c3892d112df4060bafd2f7e1d718e33 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:04.632742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1307/2618] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:27:04 2022] POST /identity/v3/users => generated 282 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:27:04.636780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e240f-9e81-42da-8490-73cf33585c6c admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:04.707099 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e240f-9e81-42da-8490-73cf33585c6c admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:04.711682 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abc3a8-75b5-43f0-86ce-8d48f07824ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:04.712269 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abc3a8-75b5-43f0-86ce-8d48f07824ef admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:04.712556 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abc3a8-75b5-43f0-86ce-8d48f07824ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:04.712821 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abc3a8-75b5-43f0-86ce-8d48f07824ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:04.713450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0abc3a8-75b5-43f0-86ce-8d48f07824ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:04.715176 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0abc3a8-75b5-43f0-86ce-8d48f07824ef admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:04.725437 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1312/2619] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:04.732369 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254e69e-758e-4d6f-9fca-d1dd6f053e0a admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:04.740919 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254e69e-758e-4d6f-9fca-d1dd6f053e0a admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:04.745839 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47e230-3aae-41cc-89c6-60ad979eabcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:04.746484 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47e230-3aae-41cc-89c6-60ad979eabcf admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:04.746766 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47e230-3aae-41cc-89c6-60ad979eabcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:04.747044 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47e230-3aae-41cc-89c6-60ad979eabcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:04.747680 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47e230-3aae-41cc-89c6-60ad979eabcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:04.749275 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47e230-3aae-41cc-89c6-60ad979eabcf admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:04.761065 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1308/2620] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:04.765695 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abc3a8-75b5-43f0-86ce-8d48f07824ef admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:04.776074 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abc3a8-75b5-43f0-86ce-8d48f07824ef admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:04.780773 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c0a69-d408-4849-bf09-901ca91f47fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:04.781362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c0a69-d408-4849-bf09-901ca91f47fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:04.781639 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c0a69-d408-4849-bf09-901ca91f47fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:04.781912 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c0a69-d408-4849-bf09-901ca91f47fc admin admin] PATH_INFO: `/v3/projects/05cbddf6c17e4726b6a09ec39afc0ae5/users/6ce9bc8d780d4a9c9c0c697229f54919/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:04.800162 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c0a69-d408-4849-bf09-901ca91f47fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=05cbddf6c17e4726b6a09ec39afc0ae5, user_id=6ce9bc8d780d4a9c9c0c697229f54919, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:04.803698 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c0a69-d408-4849-bf09-901ca91f47fc admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:04.807405 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:04.939579 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1313/2621] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:04 2022] PUT /identity/v3/projects/05cbddf6c17e4726b6a09ec39afc0ae5/users/6ce9bc8d780d4a9c9c0c697229f54919/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:04.944017 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971811a-8e28-44db-b734-f725fc58f583 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:04.944252 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971811a-8e28-44db-b734-f725fc58f583 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:04.944800 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971811a-8e28-44db-b734-f725fc58f583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:04.975439 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-7971811a-8e28-44db-b734-f725fc58f583 None None] MFA Rules not processed for user `6ce9bc8d780d4a9c9c0c697229f54919`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:04.976671 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-7971811a-8e28-44db-b734-f725fc58f583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:04.998901 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:05.022147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c0a69-d408-4849-bf09-901ca91f47fc admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:05.023998 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c72c0a69-d408-4849-bf09-901ca91f47fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:05.054543 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1309/2622] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:05.058789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971811a-8e28-44db-b734-f725fc58f583 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:05.123124 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c0a69-d408-4849-bf09-901ca91f47fc admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:05.128354 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346403fe-d931-4769-9984-6f747a6b327d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:05.129000 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346403fe-d931-4769-9984-6f747a6b327d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:05.129276 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346403fe-d931-4769-9984-6f747a6b327d admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:05.129391 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971811a-8e28-44db-b734-f725fc58f583 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:05.129546 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346403fe-d931-4769-9984-6f747a6b327d admin admin] PATH_INFO: `/v3/projects/f3830e31491a47cd912422562ff4be0b` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:05.130735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346403fe-d931-4769-9984-6f747a6b327d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3830e31491a47cd912422562ff4be0b)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:05.132817 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346403fe-d931-4769-9984-6f747a6b327d admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:05.134512 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c1b3c-fb99-43d3-a07e-044db158e288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:05.135403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c1b3c-fb99-43d3-a07e-044db158e288 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:05.135403 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c1b3c-fb99-43d3-a07e-044db158e288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:05.135684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c1b3c-fb99-43d3-a07e-044db158e288 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:05.136303 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c1b3c-fb99-43d3-a07e-044db158e288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:05.138193 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c1b3c-fb99-43d3-a07e-044db158e288 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:05.268647 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1310/2623] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:27:05 2022] POST /identity/v3/projects => generated 365 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:27:05.272620 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c1b3c-fb99-43d3-a07e-044db158e288 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:05.307748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-346403fe-d931-4769-9984-6f747a6b327d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3830e31491a47cd912422562ff4be0b', 'request_id': 'req-346403fe-d931-4769-9984-6f747a6b327d'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:05.313309 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-346403fe-d931-4769-9984-6f747a6b327d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3830e31491a47cd912422562ff4be0b', 'request_id': 'req-346403fe-d931-4769-9984-6f747a6b327d'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:05.320198 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-346403fe-d931-4769-9984-6f747a6b327d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3830e31491a47cd912422562ff4be0b', 'request_id': 'req-346403fe-d931-4769-9984-6f747a6b327d'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:05.341375 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c1b3c-fb99-43d3-a07e-044db158e288 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:05.384837 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:05.397829 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fb655-de72-4bc8-9eb0-e0a9138d874b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:05.398606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fb655-de72-4bc8-9eb0-e0a9138d874b admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:05.398893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fb655-de72-4bc8-9eb0-e0a9138d874b admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:05.399457 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fb655-de72-4bc8-9eb0-e0a9138d874b admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:05.399804 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fb655-de72-4bc8-9eb0-e0a9138d874b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:05.401790 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fb655-de72-4bc8-9eb0-e0a9138d874b admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:05.402963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-346403fe-d931-4769-9984-6f747a6b327d admin admin] The token cache is being invalidate because project f3830e31491a47cd912422562ff4be0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:27:05.403254 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-346403fe-d931-4769-9984-6f747a6b327d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:05.403894 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-346403fe-d931-4769-9984-6f747a6b327d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:05.405607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1314/2624] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:27:05 2022] DELETE /identity/v3/projects/f3830e31491a47cd912422562ff4be0b => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:27:05.411086 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efbed6-96c3-40e1-9635-879f0e8c2865 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:05.411372 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efbed6-96c3-40e1-9635-879f0e8c2865 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:05.412047 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efbed6-96c3-40e1-9635-879f0e8c2865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:05.432548 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-43efbed6-96c3-40e1-9635-879f0e8c2865 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:05.433766 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-43efbed6-96c3-40e1-9635-879f0e8c2865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:05.444017 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1315/2625] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:27:05.452943 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcc19b-0608-4e27-a317-3ece8eeafa85 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:05.452943 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcc19b-0608-4e27-a317-3ece8eeafa85 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:05.452943 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcc19b-0608-4e27-a317-3ece8eeafa85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:05.474923 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-a0fcc19b-0608-4e27-a317-3ece8eeafa85 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:05.476435 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-a0fcc19b-0608-4e27-a317-3ece8eeafa85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:05.487283 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1316/2626] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:05.491622 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcc19b-0608-4e27-a317-3ece8eeafa85 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:05.501862 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcc19b-0608-4e27-a317-3ece8eeafa85 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:05.508532 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1311/2627] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:27:05 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:27:05.518879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae272f78-aba5-4129-9ab6-98d986431240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:05.518879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae272f78-aba5-4129-9ab6-98d986431240 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:05.518879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae272f78-aba5-4129-9ab6-98d986431240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:05.518879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae272f78-aba5-4129-9ab6-98d986431240 admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:05.519292 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae272f78-aba5-4129-9ab6-98d986431240 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:27:05.519292 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae272f78-aba5-4129-9ab6-98d986431240 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:05.519292 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae272f78-aba5-4129-9ab6-98d986431240 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:05.520737 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fb655-de72-4bc8-9eb0-e0a9138d874b admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:05.522534 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-740fb655-de72-4bc8-9eb0-e0a9138d874b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:05.525917 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1317/2628] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:27:05.531123 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae272f78-aba5-4129-9ab6-98d986431240 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:05.536261 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fb655-de72-4bc8-9eb0-e0a9138d874b admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:05.541120 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31427f13-1793-4429-b0bc-00471f417de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:05.541762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31427f13-1793-4429-b0bc-00471f417de8 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:05.541884 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae272f78-aba5-4129-9ab6-98d986431240 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:05.542045 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31427f13-1793-4429-b0bc-00471f417de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:05.542352 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31427f13-1793-4429-b0bc-00471f417de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:05.543001 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31427f13-1793-4429-b0bc-00471f417de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:05.544662 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31427f13-1793-4429-b0bc-00471f417de8 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:05.548844 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ced8f5-595e-4a4e-861f-7f0b9c6d69a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:05.549481 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ced8f5-595e-4a4e-861f-7f0b9c6d69a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:05.549813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ced8f5-595e-4a4e-861f-7f0b9c6d69a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:05.550091 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ced8f5-595e-4a4e-861f-7f0b9c6d69a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:05.551225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ced8f5-595e-4a4e-861f-7f0b9c6d69a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:05.552876 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ced8f5-595e-4a4e-861f-7f0b9c6d69a1 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:05.557063 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1312/2629] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:27:05.561430 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31427f13-1793-4429-b0bc-00471f417de8 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:05.573110 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31427f13-1793-4429-b0bc-00471f417de8 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:05.577946 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060b3d1-ae94-4139-b5af-5ff59d43bd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:05.578664 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060b3d1-ae94-4139-b5af-5ff59d43bd51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:05.578966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060b3d1-ae94-4139-b5af-5ff59d43bd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:05.580177 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060b3d1-ae94-4139-b5af-5ff59d43bd51 admin admin] PATH_INFO: `/v3/projects/f831feff82074276ac4c5308d9c6096d/users/74bd68a89e7542c9be75cdbe1b0ed684/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:05.595857 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060b3d1-ae94-4139-b5af-5ff59d43bd51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f831feff82074276ac4c5308d9c6096d, user_id=74bd68a89e7542c9be75cdbe1b0ed684, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:05.598583 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060b3d1-ae94-4139-b5af-5ff59d43bd51 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:05.717947 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1318/2630] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:27:05 2022] POST /identity/v3/projects => generated 383 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:27:05.718840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1313/2631] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:05 2022] PUT /identity/v3/projects/f831feff82074276ac4c5308d9c6096d/users/74bd68a89e7542c9be75cdbe1b0ed684/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:27:05.721822 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ced8f5-595e-4a4e-861f-7f0b9c6d69a1 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:05.722787 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060b3d1-ae94-4139-b5af-5ff59d43bd51 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:05.770831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:05.786494 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060b3d1-ae94-4139-b5af-5ff59d43bd51 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:05.796982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ced8f5-595e-4a4e-861f-7f0b9c6d69a1 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:05.802251 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0070215-4410-44ee-ba35-e6e58e0989c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:05.803108 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0070215-4410-44ee-ba35-e6e58e0989c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:05.803474 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0070215-4410-44ee-ba35-e6e58e0989c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:05.803904 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0070215-4410-44ee-ba35-e6e58e0989c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:05.804650 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0070215-4410-44ee-ba35-e6e58e0989c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:05.806741 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0070215-4410-44ee-ba35-e6e58e0989c9 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:05.862796 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc875c5-aa86-46da-9288-07614183681c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:05.863375 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc875c5-aa86-46da-9288-07614183681c admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:05.863658 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc875c5-aa86-46da-9288-07614183681c admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:05.863930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc875c5-aa86-46da-9288-07614183681c admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:05.864564 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc875c5-aa86-46da-9288-07614183681c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:05.866242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc875c5-aa86-46da-9288-07614183681c admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:05.876179 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1314/2632] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:27:05.880415 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc875c5-aa86-46da-9288-07614183681c admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:05.890065 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc875c5-aa86-46da-9288-07614183681c admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:05.891157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1319/2633] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:27:05 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:27:05.896063 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b3fc9-c2e4-42f6-9546-8ad104e808e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:05.896712 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b3fc9-c2e4-42f6-9546-8ad104e808e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:05.896993 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b3fc9-c2e4-42f6-9546-8ad104e808e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:05.897268 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b3fc9-c2e4-42f6-9546-8ad104e808e5 admin admin] PATH_INFO: `/v3/projects/f831feff82074276ac4c5308d9c6096d/users/74bd68a89e7542c9be75cdbe1b0ed684/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:05.897753 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0070215-4410-44ee-ba35-e6e58e0989c9 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:05.899228 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b3fc9-c2e4-42f6-9546-8ad104e808e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f831feff82074276ac4c5308d9c6096d, user_id=74bd68a89e7542c9be75cdbe1b0ed684, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:05.901893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b3fc9-c2e4-42f6-9546-8ad104e808e5 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:05.909330 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0070215-4410-44ee-ba35-e6e58e0989c9 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:05.914179 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1315/2634] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:05 2022] PUT /identity/v3/projects/f831feff82074276ac4c5308d9c6096d/users/74bd68a89e7542c9be75cdbe1b0ed684/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:27:05.929745 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c8d6d-0414-4d30-8ed4-54724b1ed9fc None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:05.930032 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c8d6d-0414-4d30-8ed4-54724b1ed9fc None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:05.930338 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c8d6d-0414-4d30-8ed4-54724b1ed9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:05.961491 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-195c8d6d-0414-4d30-8ed4-54724b1ed9fc None None] MFA Rules not processed for user `74bd68a89e7542c9be75cdbe1b0ed684`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:05.962781 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-195c8d6d-0414-4d30-8ed4-54724b1ed9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:05.969485 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde920f-5a4b-4fba-8338-c9035292bd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:05.970678 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde920f-5a4b-4fba-8338-c9035292bd51 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:05.971199 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde920f-5a4b-4fba-8338-c9035292bd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:05.971609 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde920f-5a4b-4fba-8338-c9035292bd51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:05.972328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde920f-5a4b-4fba-8338-c9035292bd51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:05.974082 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde920f-5a4b-4fba-8338-c9035292bd51 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:05.983930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:05.988572 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1320/2635] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:05.989849 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde920f-5a4b-4fba-8338-c9035292bd51 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:06.000425 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde920f-5a4b-4fba-8338-c9035292bd51 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:06.006412 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06a731-4758-4e60-b0b0-1af1eb6599b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:06.007077 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06a731-4758-4e60-b0b0-1af1eb6599b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:06.007957 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06a731-4758-4e60-b0b0-1af1eb6599b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:06.007957 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06a731-4758-4e60-b0b0-1af1eb6599b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:06.008587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06a731-4758-4e60-b0b0-1af1eb6599b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:06.010186 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06a731-4758-4e60-b0b0-1af1eb6599b8 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:06.026962 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1321/2636] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:27:06.028283 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06a731-4758-4e60-b0b0-1af1eb6599b8 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:06.040605 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06a731-4758-4e60-b0b0-1af1eb6599b8 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:06.046666 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1316/2637] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:27:06.046817 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34204d34-5cd3-4f4a-bcee-ff58aa9c4e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:06.046817 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34204d34-5cd3-4f4a-bcee-ff58aa9c4e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:06.046993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34204d34-5cd3-4f4a-bcee-ff58aa9c4e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:06.047256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34204d34-5cd3-4f4a-bcee-ff58aa9c4e42 admin admin] PATH_INFO: `/v3/projects/190f078f49ff40d8b5bf20955ca32739/users/92725b0663bc4afb8bc63fbf14048d01/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:06.069850 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c8d6d-0414-4d30-8ed4-54724b1ed9fc None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:06.069850 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-195c8d6d-0414-4d30-8ed4-54724b1ed9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:06.070047 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34204d34-5cd3-4f4a-bcee-ff58aa9c4e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=190f078f49ff40d8b5bf20955ca32739, user_id=92725b0663bc4afb8bc63fbf14048d01, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:06.075330 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34204d34-5cd3-4f4a-bcee-ff58aa9c4e42 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:06.122872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c8d6d-0414-4d30-8ed4-54724b1ed9fc None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:06.127236 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc355d-2805-4988-91a2-8c1bef8b29ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:06.127924 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc355d-2805-4988-91a2-8c1bef8b29ea service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:06.128209 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc355d-2805-4988-91a2-8c1bef8b29ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:06.128536 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc355d-2805-4988-91a2-8c1bef8b29ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:06.138120 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc355d-2805-4988-91a2-8c1bef8b29ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:06.139595 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc355d-2805-4988-91a2-8c1bef8b29ea service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:06.149393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1317/2638] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:06 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:27:06.180282 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1322/2639] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:06 2022] PUT /identity/v3/projects/190f078f49ff40d8b5bf20955ca32739/users/92725b0663bc4afb8bc63fbf14048d01/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:06.192576 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411e685-1fdb-45b9-a114-8f0a6f3a7dea None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:06.192865 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411e685-1fdb-45b9-a114-8f0a6f3a7dea None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:06.193144 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411e685-1fdb-45b9-a114-8f0a6f3a7dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:06.222419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-8411e685-1fdb-45b9-a114-8f0a6f3a7dea None None] MFA Rules not processed for user `92725b0663bc4afb8bc63fbf14048d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:06.223988 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-8411e685-1fdb-45b9-a114-8f0a6f3a7dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:06.300106 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1318/2640] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:06.304732 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34204d34-5cd3-4f4a-bcee-ff58aa9c4e42 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:06.372657 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34204d34-5cd3-4f4a-bcee-ff58aa9c4e42 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:06.377935 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43aba3-c82d-4f52-a455-2ecafb90f91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:06.378581 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43aba3-c82d-4f52-a455-2ecafb90f91f admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:06.378871 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43aba3-c82d-4f52-a455-2ecafb90f91f admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:06.379152 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43aba3-c82d-4f52-a455-2ecafb90f91f admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:06.379775 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43aba3-c82d-4f52-a455-2ecafb90f91f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:06.381920 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43aba3-c82d-4f52-a455-2ecafb90f91f admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:06.446232 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1323/2641] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:27:06 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:27:06.450782 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411e685-1fdb-45b9-a114-8f0a6f3a7dea None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:06.466190 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411e685-1fdb-45b9-a114-8f0a6f3a7dea None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:06.534443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=100 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:06.544121 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71130284-b697-472c-9342-f3cd87910922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:06.544747 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71130284-b697-472c-9342-f3cd87910922 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:06.545031 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71130284-b697-472c-9342-f3cd87910922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:06.545355 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71130284-b697-472c-9342-f3cd87910922 admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:06.545981 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71130284-b697-472c-9342-f3cd87910922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:06.547981 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71130284-b697-472c-9342-f3cd87910922 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:06.660235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1319/2642] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:27:06 2022] POST /identity/v3/users => generated 298 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:27:06.664652 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43aba3-c82d-4f52-a455-2ecafb90f91f admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:06.675837 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43aba3-c82d-4f52-a455-2ecafb90f91f admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:06.680636 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe15dc-d971-4627-8698-9157eb254f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:06.681251 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe15dc-d971-4627-8698-9157eb254f38 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:06.681746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe15dc-d971-4627-8698-9157eb254f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:06.681946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe15dc-d971-4627-8698-9157eb254f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:06.682604 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe15dc-d971-4627-8698-9157eb254f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:06.684215 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe15dc-d971-4627-8698-9157eb254f38 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:06.695585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1324/2643] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:06.699842 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71130284-b697-472c-9342-f3cd87910922 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:06.711807 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71130284-b697-472c-9342-f3cd87910922 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:06.716833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36baf343-0250-4b73-a8a5-09db436993c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:06.717520 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36baf343-0250-4b73-a8a5-09db436993c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:06.717801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36baf343-0250-4b73-a8a5-09db436993c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:06.718104 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36baf343-0250-4b73-a8a5-09db436993c3 admin admin] PATH_INFO: `/v3/projects/a0c62621bc1e41ebad4fc84f537ed8d4/users/2dc19a0273e74da6b544b0b969cb3b2b/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:06.735298 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36baf343-0250-4b73-a8a5-09db436993c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0c62621bc1e41ebad4fc84f537ed8d4, user_id=2dc19a0273e74da6b544b0b969cb3b2b, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:06.737968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36baf343-0250-4b73-a8a5-09db436993c3 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:06.791603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1320/2644] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:06 2022] PUT /identity/v3/projects/a0c62621bc1e41ebad4fc84f537ed8d4/users/2dc19a0273e74da6b544b0b969cb3b2b/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:06.795501 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe15dc-d971-4627-8698-9157eb254f38 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:06.800888 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:06.806395 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe15dc-d971-4627-8698-9157eb254f38 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:06.876176 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c851e8a-e711-4f95-8be2-a8e9b1ea3a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:06.877489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c851e8a-e711-4f95-8be2-a8e9b1ea3a15 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:06.877774 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c851e8a-e711-4f95-8be2-a8e9b1ea3a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:06.878054 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c851e8a-e711-4f95-8be2-a8e9b1ea3a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:06.878742 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c851e8a-e711-4f95-8be2-a8e9b1ea3a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:06.880370 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c851e8a-e711-4f95-8be2-a8e9b1ea3a15 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:06.891262 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1325/2645] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:06.896597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36baf343-0250-4b73-a8a5-09db436993c3 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:06.907426 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36baf343-0250-4b73-a8a5-09db436993c3 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:06.912828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9684086-3800-46c4-acda-3083318c07fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:06.913492 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9684086-3800-46c4-acda-3083318c07fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:06.913788 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9684086-3800-46c4-acda-3083318c07fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:06.914053 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9684086-3800-46c4-acda-3083318c07fc admin admin] PATH_INFO: `/v3/projects/a0c62621bc1e41ebad4fc84f537ed8d4/users/2dc19a0273e74da6b544b0b969cb3b2b/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:06.916105 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9684086-3800-46c4-acda-3083318c07fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0c62621bc1e41ebad4fc84f537ed8d4, user_id=2dc19a0273e74da6b544b0b969cb3b2b, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:06.918827 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9684086-3800-46c4-acda-3083318c07fc admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:06.930213 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1321/2646] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:06 2022] PUT /identity/v3/projects/a0c62621bc1e41ebad4fc84f537ed8d4/users/2dc19a0273e74da6b544b0b969cb3b2b/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:06.941235 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2b6c8-5ad0-48ea-b29b-498f1bebe815 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:06.941521 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2b6c8-5ad0-48ea-b29b-498f1bebe815 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:06.941797 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2b6c8-5ad0-48ea-b29b-498f1bebe815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:06.974058 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-74b2b6c8-5ad0-48ea-b29b-498f1bebe815 None None] MFA Rules not processed for user `2dc19a0273e74da6b544b0b969cb3b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:06.975363 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-74b2b6c8-5ad0-48ea-b29b-498f1bebe815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:07.042619 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9684086-3800-46c4-acda-3083318c07fc admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:07.053718 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1326/2647] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:07.065696 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2b6c8-5ad0-48ea-b29b-498f1bebe815 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:07.109420 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9684086-3800-46c4-acda-3083318c07fc admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:07.115202 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3394268-971e-4484-b0ef-4a7178eb0324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:07.115833 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3394268-971e-4484-b0ef-4a7178eb0324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:07.116107 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3394268-971e-4484-b0ef-4a7178eb0324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:07.116402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3394268-971e-4484-b0ef-4a7178eb0324 admin admin] PATH_INFO: `/v3/users/6ce9bc8d780d4a9c9c0c697229f54919` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:07.117541 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3394268-971e-4484-b0ef-4a7178eb0324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ce9bc8d780d4a9c9c0c697229f54919)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:07.119497 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3394268-971e-4484-b0ef-4a7178eb0324 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:07.124030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2b6c8-5ad0-48ea-b29b-498f1bebe815 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:07.127124 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf275f-2b37-437b-989d-fdb1b9da60e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:07.127746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf275f-2b37-437b-989d-fdb1b9da60e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:07.128023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf275f-2b37-437b-989d-fdb1b9da60e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:07.128294 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf275f-2b37-437b-989d-fdb1b9da60e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:07.172227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:07.192297 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf275f-2b37-437b-989d-fdb1b9da60e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:07.193756 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf275f-2b37-437b-989d-fdb1b9da60e2 service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:07.202697 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1327/2648] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:27:07.326741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-d3394268-971e-4484-b0ef-4a7178eb0324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ce9bc8d780d4a9c9c0c697229f54919'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:07.327496 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-d3394268-971e-4484-b0ef-4a7178eb0324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ce9bc8d780d4a9c9c0c697229f54919'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:07.328254 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-d3394268-971e-4484-b0ef-4a7178eb0324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ce9bc8d780d4a9c9c0c697229f54919'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:07.396430 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-d3394268-971e-4484-b0ef-4a7178eb0324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ce9bc8d780d4a9c9c0c697229f54919'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:07.405110 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-d3394268-971e-4484-b0ef-4a7178eb0324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ce9bc8d780d4a9c9c0c697229f54919'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:07.425699 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1322/2649] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:27:07 2022] DELETE /identity/v3/users/6ce9bc8d780d4a9c9c0c697229f54919 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:27:07.430278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b692e2-9448-4f82-b5a1-39980d03df3a None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:07.430588 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b692e2-9448-4f82-b5a1-39980d03df3a None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:07.430911 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b692e2-9448-4f82-b5a1-39980d03df3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:07.452254 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-37b692e2-9448-4f82-b5a1-39980d03df3a None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:07.453605 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-37b692e2-9448-4f82-b5a1-39980d03df3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:07.521178 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1328/2650] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:07.532115 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3394268-971e-4484-b0ef-4a7178eb0324 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:07.533914 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-d3394268-971e-4484-b0ef-4a7178eb0324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:07.561492 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:07.593624 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3394268-971e-4484-b0ef-4a7178eb0324 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:07.597732 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bff098-e912-4004-b73e-b100dd8846d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:07.598373 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bff098-e912-4004-b73e-b100dd8846d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:07.598660 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bff098-e912-4004-b73e-b100dd8846d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:07.598939 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bff098-e912-4004-b73e-b100dd8846d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:07.608567 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bff098-e912-4004-b73e-b100dd8846d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:07.610045 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bff098-e912-4004-b73e-b100dd8846d2 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:07.620514 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1323/2651] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:27:08.216586 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b692e2-9448-4f82-b5a1-39980d03df3a None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:08.218018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-37b692e2-9448-4f82-b5a1-39980d03df3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:08.230942 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b692e2-9448-4f82-b5a1-39980d03df3a None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:08.236254 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58eac6-66e4-4189-a492-79e916b180c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:08.236815 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58eac6-66e4-4189-a492-79e916b180c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:08.237288 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58eac6-66e4-4189-a492-79e916b180c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:08.237570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58eac6-66e4-4189-a492-79e916b180c2 admin admin] PATH_INFO: `/v3/projects/05cbddf6c17e4726b6a09ec39afc0ae5` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:08.238804 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a58eac6-66e4-4189-a492-79e916b180c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05cbddf6c17e4726b6a09ec39afc0ae5)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:08.240749 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a58eac6-66e4-4189-a492-79e916b180c2 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:08.414045 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-4a58eac6-66e4-4189-a492-79e916b180c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05cbddf6c17e4726b6a09ec39afc0ae5', 'request_id': 'req-4a58eac6-66e4-4189-a492-79e916b180c2'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:08.424899 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-4a58eac6-66e4-4189-a492-79e916b180c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05cbddf6c17e4726b6a09ec39afc0ae5', 'request_id': 'req-4a58eac6-66e4-4189-a492-79e916b180c2'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:08.436547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-4a58eac6-66e4-4189-a492-79e916b180c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05cbddf6c17e4726b6a09ec39afc0ae5', 'request_id': 'req-4a58eac6-66e4-4189-a492-79e916b180c2'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:08.562672 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-4a58eac6-66e4-4189-a492-79e916b180c2 admin admin] The token cache is being invalidate because project 05cbddf6c17e4726b6a09ec39afc0ae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:27:08.567169 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-4a58eac6-66e4-4189-a492-79e916b180c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:08.567169 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-4a58eac6-66e4-4189-a492-79e916b180c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:08.567169 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1329/2652] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:27:08 2022] DELETE /identity/v3/projects/05cbddf6c17e4726b6a09ec39afc0ae5 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:08.569705 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bff098-e912-4004-b73e-b100dd8846d2 service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:08.579512 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bff098-e912-4004-b73e-b100dd8846d2 service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:08.638923 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b56520-2765-4c93-b9c7-ad1407abbc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:08.639553 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b56520-2765-4c93-b9c7-ad1407abbc19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:08.639837 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b56520-2765-4c93-b9c7-ad1407abbc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:08.640115 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b56520-2765-4c93-b9c7-ad1407abbc19 admin admin] PATH_INFO: `/v3/users/74bd68a89e7542c9be75cdbe1b0ed684` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:08.641237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b56520-2765-4c93-b9c7-ad1407abbc19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74bd68a89e7542c9be75cdbe1b0ed684)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:08.643294 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b56520-2765-4c93-b9c7-ad1407abbc19 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:08.857845 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-b0b56520-2765-4c93-b9c7-ad1407abbc19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74bd68a89e7542c9be75cdbe1b0ed684'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:08.858446 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-b0b56520-2765-4c93-b9c7-ad1407abbc19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74bd68a89e7542c9be75cdbe1b0ed684'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:08.860318 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-b0b56520-2765-4c93-b9c7-ad1407abbc19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74bd68a89e7542c9be75cdbe1b0ed684'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:08.996766 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-b0b56520-2765-4c93-b9c7-ad1407abbc19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74bd68a89e7542c9be75cdbe1b0ed684'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:09.004959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-b0b56520-2765-4c93-b9c7-ad1407abbc19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74bd68a89e7542c9be75cdbe1b0ed684'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:09.023597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1324/2653] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:27:08 2022] DELETE /identity/v3/users/74bd68a89e7542c9be75cdbe1b0ed684 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:09.448677 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58eac6-66e4-4189-a492-79e916b180c2 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:09.449345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-4a58eac6-66e4-4189-a492-79e916b180c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:09.464026 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58eac6-66e4-4189-a492-79e916b180c2 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:09.526244 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf306d-cf2b-43ca-a620-422f14a5f67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:09.526939 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf306d-cf2b-43ca-a620-422f14a5f67c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:09.527227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf306d-cf2b-43ca-a620-422f14a5f67c admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:09.527523 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf306d-cf2b-43ca-a620-422f14a5f67c admin admin] PATH_INFO: `/v3/projects/f831feff82074276ac4c5308d9c6096d` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:09.528727 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf306d-cf2b-43ca-a620-422f14a5f67c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f831feff82074276ac4c5308d9c6096d)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:09.530704 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf306d-cf2b-43ca-a620-422f14a5f67c admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:09.533263 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:09.646767 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d2cf306d-cf2b-43ca-a620-422f14a5f67c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f831feff82074276ac4c5308d9c6096d', 'request_id': 'req-d2cf306d-cf2b-43ca-a620-422f14a5f67c'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:09.652549 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d2cf306d-cf2b-43ca-a620-422f14a5f67c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f831feff82074276ac4c5308d9c6096d', 'request_id': 'req-d2cf306d-cf2b-43ca-a620-422f14a5f67c'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:09.659133 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d2cf306d-cf2b-43ca-a620-422f14a5f67c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f831feff82074276ac4c5308d9c6096d', 'request_id': 'req-d2cf306d-cf2b-43ca-a620-422f14a5f67c'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:09.728976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d2cf306d-cf2b-43ca-a620-422f14a5f67c admin admin] The token cache is being invalidate because project f831feff82074276ac4c5308d9c6096d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:27:09.729498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d2cf306d-cf2b-43ca-a620-422f14a5f67c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:09.730331 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-d2cf306d-cf2b-43ca-a620-422f14a5f67c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:09.731856 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1330/2654] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:27:09 2022] DELETE /identity/v3/projects/f831feff82074276ac4c5308d9c6096d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:09.739110 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dccf7-b833-46df-b927-4cfde66df5ba None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:09.739599 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dccf7-b833-46df-b927-4cfde66df5ba None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:09.740023 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dccf7-b833-46df-b927-4cfde66df5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:09.761074 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-de8dccf7-b833-46df-b927-4cfde66df5ba None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:09.762313 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-de8dccf7-b833-46df-b927-4cfde66df5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:09.805543 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:09.825743 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1325/2655] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:09.834076 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02af9a-8ee6-4118-aa3f-572516dc958c None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:09.834427 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02af9a-8ee6-4118-aa3f-572516dc958c None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:09.834714 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02af9a-8ee6-4118-aa3f-572516dc958c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:09.854794 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-fb02af9a-8ee6-4118-aa3f-572516dc958c None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:09.856027 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-fb02af9a-8ee6-4118-aa3f-572516dc958c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:09.864988 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1331/2656] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:09.869766 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8dccf7-b833-46df-b927-4cfde66df5ba None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:09.880638 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8dccf7-b833-46df-b927-4cfde66df5ba None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:09.886975 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de0bf4-eb51-44fc-ac37-2fc5dd6b15de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:09.887770 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de0bf4-eb51-44fc-ac37-2fc5dd6b15de admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:09.888056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de0bf4-eb51-44fc-ac37-2fc5dd6b15de admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:09.888327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de0bf4-eb51-44fc-ac37-2fc5dd6b15de admin admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:09.888972 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de0bf4-eb51-44fc-ac37-2fc5dd6b15de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:27:09.889278 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de0bf4-eb51-44fc-ac37-2fc5dd6b15de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:09.890913 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de0bf4-eb51-44fc-ac37-2fc5dd6b15de admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:09.914426 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1326/2657] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:27:09.918490 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02af9a-8ee6-4118-aa3f-572516dc958c None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:09.929375 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02af9a-8ee6-4118-aa3f-572516dc958c None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:09.934914 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335623b-1156-4092-83ad-5e227d2d3e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:09.935528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335623b-1156-4092-83ad-5e227d2d3e27 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:09.935811 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335623b-1156-4092-83ad-5e227d2d3e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:09.936121 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335623b-1156-4092-83ad-5e227d2d3e27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:09.936777 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335623b-1156-4092-83ad-5e227d2d3e27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:09.938890 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335623b-1156-4092-83ad-5e227d2d3e27 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:10.041022 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1332/2658] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:27:09 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:27:10.045656 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de0bf4-eb51-44fc-ac37-2fc5dd6b15de admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:10.056832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de0bf4-eb51-44fc-ac37-2fc5dd6b15de admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:10.120917 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f17ee8-4f69-4453-917b-4f1342cd6242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:10.121830 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f17ee8-4f69-4453-917b-4f1342cd6242 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:10.122168 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f17ee8-4f69-4453-917b-4f1342cd6242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:10.122469 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f17ee8-4f69-4453-917b-4f1342cd6242 admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:10.123076 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f17ee8-4f69-4453-917b-4f1342cd6242 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:10.124988 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f17ee8-4f69-4453-917b-4f1342cd6242 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:10.221556 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1327/2659] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:27:10 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:27:10.226247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335623b-1156-4092-83ad-5e227d2d3e27 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:10.237488 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335623b-1156-4092-83ad-5e227d2d3e27 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:10.242169 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed695a92-7801-45ef-8bcf-f5f93773ce5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:10.242805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed695a92-7801-45ef-8bcf-f5f93773ce5a admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:10.243087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed695a92-7801-45ef-8bcf-f5f93773ce5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:10.243392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed695a92-7801-45ef-8bcf-f5f93773ce5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:10.244004 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed695a92-7801-45ef-8bcf-f5f93773ce5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:10.245640 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed695a92-7801-45ef-8bcf-f5f93773ce5a admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:10.255898 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1333/2660] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:27:10.260010 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f17ee8-4f69-4453-917b-4f1342cd6242 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:10.271882 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f17ee8-4f69-4453-917b-4f1342cd6242 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:10.276874 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4c088-16a3-44e2-8ba9-1c1612721418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:10.277465 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4c088-16a3-44e2-8ba9-1c1612721418 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:10.277748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4c088-16a3-44e2-8ba9-1c1612721418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:10.278022 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4c088-16a3-44e2-8ba9-1c1612721418 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:10.278699 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4c088-16a3-44e2-8ba9-1c1612721418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:10.280319 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4c088-16a3-44e2-8ba9-1c1612721418 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:10.291743 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1328/2661] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:10.296056 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed695a92-7801-45ef-8bcf-f5f93773ce5a admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:10.308349 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed695a92-7801-45ef-8bcf-f5f93773ce5a admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:10.313098 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2396bf-9aac-4d41-a00a-3e32ee91a346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:10.313805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2396bf-9aac-4d41-a00a-3e32ee91a346 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:10.314209 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2396bf-9aac-4d41-a00a-3e32ee91a346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:10.314699 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2396bf-9aac-4d41-a00a-3e32ee91a346 admin admin] PATH_INFO: `/v3/projects/c397da9a54b34bdca26bac2b8ca48437/users/42599281e2ed44608de5da63266071d8/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:10.330961 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2396bf-9aac-4d41-a00a-3e32ee91a346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c397da9a54b34bdca26bac2b8ca48437, user_id=42599281e2ed44608de5da63266071d8, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:10.333675 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2396bf-9aac-4d41-a00a-3e32ee91a346 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:10.416333 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1334/2662] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:10 2022] PUT /identity/v3/projects/c397da9a54b34bdca26bac2b8ca48437/users/42599281e2ed44608de5da63266071d8/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:10.427844 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2daa40f-d5ca-4c44-a190-b797c2ba57fe None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:10.428396 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2daa40f-d5ca-4c44-a190-b797c2ba57fe None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:10.428744 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2daa40f-d5ca-4c44-a190-b797c2ba57fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:10.467390 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-e2daa40f-d5ca-4c44-a190-b797c2ba57fe None None] MFA Rules not processed for user `42599281e2ed44608de5da63266071d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:10.468865 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-e2daa40f-d5ca-4c44-a190-b797c2ba57fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:10.547033 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1329/2663] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:10.552065 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2396bf-9aac-4d41-a00a-3e32ee91a346 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:10.623071 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2396bf-9aac-4d41-a00a-3e32ee91a346 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:10.628758 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaeb7f2-7945-458a-945f-40b50064d88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:10.629395 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeb7f2-7945-458a-945f-40b50064d88f admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:10.629693 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeb7f2-7945-458a-945f-40b50064d88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:10.630330 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeb7f2-7945-458a-945f-40b50064d88f admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:10.630904 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaeb7f2-7945-458a-945f-40b50064d88f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:10.632866 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaeb7f2-7945-458a-945f-40b50064d88f admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:10.715386 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1335/2664] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:27:10 2022] POST /identity/v3/projects => generated 387 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:27:10.719624 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2daa40f-d5ca-4c44-a190-b797c2ba57fe None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:10.731259 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2daa40f-d5ca-4c44-a190-b797c2ba57fe None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:10.770804 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:10.789000 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561dc86-759f-4567-a359-7ba570337145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:10.809496 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561dc86-759f-4567-a359-7ba570337145 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:10.809496 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561dc86-759f-4567-a359-7ba570337145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:10.809496 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561dc86-759f-4567-a359-7ba570337145 admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:10.809496 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561dc86-759f-4567-a359-7ba570337145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:10.809496 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561dc86-759f-4567-a359-7ba570337145 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:10.890009 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1330/2665] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:27:10 2022] POST /identity/v3/users => generated 300 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:27:10.894679 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaeb7f2-7945-458a-945f-40b50064d88f admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:10.907129 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaeb7f2-7945-458a-945f-40b50064d88f admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:10.913503 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660aea37-c474-4073-8880-d87736520ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:10.914597 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660aea37-c474-4073-8880-d87736520ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:10.915121 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660aea37-c474-4073-8880-d87736520ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:10.915619 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660aea37-c474-4073-8880-d87736520ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:10.916601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660aea37-c474-4073-8880-d87736520ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:10.924851 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660aea37-c474-4073-8880-d87736520ab4 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:10.931495 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1336/2666] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:10.935881 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561dc86-759f-4567-a359-7ba570337145 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:10.977017 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561dc86-759f-4567-a359-7ba570337145 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:10.977017 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba2240-9084-4412-9a40-40e14bc75369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:10.977017 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba2240-9084-4412-9a40-40e14bc75369 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:10.977017 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba2240-9084-4412-9a40-40e14bc75369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:10.977538 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba2240-9084-4412-9a40-40e14bc75369 admin admin] PATH_INFO: `/v3/projects/e051b95b72d44ecdac9b269ac5344529/users/a45807edccaf4ac99b1fa8d67713c3b5/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:10.977538 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba2240-9084-4412-9a40-40e14bc75369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e051b95b72d44ecdac9b269ac5344529, user_id=a45807edccaf4ac99b1fa8d67713c3b5, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:10.977538 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba2240-9084-4412-9a40-40e14bc75369 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:11.200807 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1331/2667] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:10 2022] PUT /identity/v3/projects/e051b95b72d44ecdac9b269ac5344529/users/a45807edccaf4ac99b1fa8d67713c3b5/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:11.205657 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660aea37-c474-4073-8880-d87736520ab4 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:11.210863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:11.216031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660aea37-c474-4073-8880-d87736520ab4 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:11.271192 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317dbcd0-68d4-4c2b-8c31-9c3af85f60b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:11.271804 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dbcd0-68d4-4c2b-8c31-9c3af85f60b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:11.272083 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dbcd0-68d4-4c2b-8c31-9c3af85f60b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:11.272356 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dbcd0-68d4-4c2b-8c31-9c3af85f60b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:11.272989 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317dbcd0-68d4-4c2b-8c31-9c3af85f60b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:11.274611 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317dbcd0-68d4-4c2b-8c31-9c3af85f60b1 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:11.285013 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1337/2668] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:11.289208 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba2240-9084-4412-9a40-40e14bc75369 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:11.300693 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba2240-9084-4412-9a40-40e14bc75369 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:11.315607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea2b1d-6e80-4b2c-807e-e2ccf7848e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:11.315607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea2b1d-6e80-4b2c-807e-e2ccf7848e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:11.315607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea2b1d-6e80-4b2c-807e-e2ccf7848e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:11.315607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea2b1d-6e80-4b2c-807e-e2ccf7848e63 admin admin] PATH_INFO: `/v3/projects/e051b95b72d44ecdac9b269ac5344529/users/a45807edccaf4ac99b1fa8d67713c3b5/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:11.316057 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea2b1d-6e80-4b2c-807e-e2ccf7848e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e051b95b72d44ecdac9b269ac5344529, user_id=a45807edccaf4ac99b1fa8d67713c3b5, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:11.316057 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea2b1d-6e80-4b2c-807e-e2ccf7848e63 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:11.322825 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1332/2669] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:11 2022] PUT /identity/v3/projects/e051b95b72d44ecdac9b269ac5344529/users/a45807edccaf4ac99b1fa8d67713c3b5/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:11.344004 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dcd6f-373e-434c-9e8c-62def629f2a2 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:11.344250 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dcd6f-373e-434c-9e8c-62def629f2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:11.344537 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dcd6f-373e-434c-9e8c-62def629f2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:11.374850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-6d1dcd6f-373e-434c-9e8c-62def629f2a2 None None] MFA Rules not processed for user `a45807edccaf4ac99b1fa8d67713c3b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:11.376115 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-6d1dcd6f-373e-434c-9e8c-62def629f2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:11.457512 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1338/2670] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:11 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:11.465961 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea2b1d-6e80-4b2c-807e-e2ccf7848e63 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:11.467765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-d4ea2b1d-6e80-4b2c-807e-e2ccf7848e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:11.526901 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea2b1d-6e80-4b2c-807e-e2ccf7848e63 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:11.530541 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95aaec-98e4-4d29-978b-b47177a12633 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:11.531145 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95aaec-98e4-4d29-978b-b47177a12633 service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:11.531426 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95aaec-98e4-4d29-978b-b47177a12633 service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:11.531699 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95aaec-98e4-4d29-978b-b47177a12633 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:11.542089 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95aaec-98e4-4d29-978b-b47177a12633 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:11.543581 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95aaec-98e4-4d29-978b-b47177a12633 service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:11.553709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1333/2671] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:11 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:27:11.583185 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1dcd6f-373e-434c-9e8c-62def629f2a2 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:11.652700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1dcd6f-373e-434c-9e8c-62def629f2a2 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:11.658178 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a6fd2-e768-43d2-a65c-36217c8ad809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:11.659208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a6fd2-e768-43d2-a65c-36217c8ad809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:11.659642 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a6fd2-e768-43d2-a65c-36217c8ad809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:11.660083 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a6fd2-e768-43d2-a65c-36217c8ad809 admin admin] PATH_INFO: `/v3/users/42599281e2ed44608de5da63266071d8` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:11.661482 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a6fd2-e768-43d2-a65c-36217c8ad809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42599281e2ed44608de5da63266071d8)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:11.663451 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a6fd2-e768-43d2-a65c-36217c8ad809 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:11.895238 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2d1a6fd2-e768-43d2-a65c-36217c8ad809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42599281e2ed44608de5da63266071d8'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:11.895874 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2d1a6fd2-e768-43d2-a65c-36217c8ad809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42599281e2ed44608de5da63266071d8'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:11.896472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2d1a6fd2-e768-43d2-a65c-36217c8ad809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42599281e2ed44608de5da63266071d8'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:11.922095 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95aaec-98e4-4d29-978b-b47177a12633 service cinder] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:11.924404 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-7c95aaec-98e4-4d29-978b-b47177a12633 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:11.942981 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95aaec-98e4-4d29-978b-b47177a12633 service cinder] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:11.945379 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bd82c-ad9c-439c-af17-97acf6c8fcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:11.946007 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bd82c-ad9c-439c-af17-97acf6c8fcfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:11.946302 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bd82c-ad9c-439c-af17-97acf6c8fcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:11.946592 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bd82c-ad9c-439c-af17-97acf6c8fcfd admin admin] PATH_INFO: `/v3/users/e92d25c9ac6a42cb9a4e1ae5e35a2967` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:11.947709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4bd82c-ad9c-439c-af17-97acf6c8fcfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e92d25c9ac6a42cb9a4e1ae5e35a2967)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:11.949687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4bd82c-ad9c-439c-af17-97acf6c8fcfd admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:12.020085 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2d1a6fd2-e768-43d2-a65c-36217c8ad809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42599281e2ed44608de5da63266071d8'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:12.032351 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-2d1a6fd2-e768-43d2-a65c-36217c8ad809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42599281e2ed44608de5da63266071d8'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:12.044765 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1339/2672] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:27:11 2022] DELETE /identity/v3/users/42599281e2ed44608de5da63266071d8 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:12.049891 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215ee26-6b31-48d9-8e48-b8db7118c0ab None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:12.051087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215ee26-6b31-48d9-8e48-b8db7118c0ab None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:12.051087 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215ee26-6b31-48d9-8e48-b8db7118c0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:12.071238 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-2215ee26-6b31-48d9-8e48-b8db7118c0ab None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:12.072472 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-2215ee26-6b31-48d9-8e48-b8db7118c0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:12.103335 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:12.107903 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-7f4bd82c-ad9c-439c-af17-97acf6c8fcfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e92d25c9ac6a42cb9a4e1ae5e35a2967'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:12.108560 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-7f4bd82c-ad9c-439c-af17-97acf6c8fcfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e92d25c9ac6a42cb9a4e1ae5e35a2967'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:12.109169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-7f4bd82c-ad9c-439c-af17-97acf6c8fcfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e92d25c9ac6a42cb9a4e1ae5e35a2967'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:12.133938 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1340/2673] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:27:12.145165 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215ee26-6b31-48d9-8e48-b8db7118c0ab None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:12.146736 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-2215ee26-6b31-48d9-8e48-b8db7118c0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:12.175216 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-7f4bd82c-ad9c-439c-af17-97acf6c8fcfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e92d25c9ac6a42cb9a4e1ae5e35a2967'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:12.182814 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-7f4bd82c-ad9c-439c-af17-97acf6c8fcfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e92d25c9ac6a42cb9a4e1ae5e35a2967'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:12.201463 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1334/2674] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:27:11 2022] DELETE /identity/v3/users/e92d25c9ac6a42cb9a4e1ae5e35a2967 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:27:12.206537 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303011c-39dc-4edc-824c-b512f23567fa None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:12.206843 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303011c-39dc-4edc-824c-b512f23567fa None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:12.207119 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303011c-39dc-4edc-824c-b512f23567fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:12.208203 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215ee26-6b31-48d9-8e48-b8db7118c0ab None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:12.225213 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:12.231515 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-3303011c-39dc-4edc-824c-b512f23567fa None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:12.232758 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-3303011c-39dc-4edc-824c-b512f23567fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:12.259940 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0a4b4-86c4-42aa-af31-1079012daa1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:12.260571 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0a4b4-86c4-42aa-af31-1079012daa1c service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:12.261252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0a4b4-86c4-42aa-af31-1079012daa1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:12.262526 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0a4b4-86c4-42aa-af31-1079012daa1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:12.276124 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:12.297974 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1335/2675] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:12.308661 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303011c-39dc-4edc-824c-b512f23567fa None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:12.319306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303011c-39dc-4edc-824c-b512f23567fa None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:12.323074 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddfb0a2-3463-4d30-b2f5-a94b92810eec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:12.323687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfb0a2-3463-4d30-b2f5-a94b92810eec service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:12.323971 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfb0a2-3463-4d30-b2f5-a94b92810eec service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:12.324246 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfb0a2-3463-4d30-b2f5-a94b92810eec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:12.327860 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f0a4b4-86c4-42aa-af31-1079012daa1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:12.329375 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f0a4b4-86c4-42aa-af31-1079012daa1c service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:12.334812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddfb0a2-3463-4d30-b2f5-a94b92810eec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:12.336790 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddfb0a2-3463-4d30-b2f5-a94b92810eec service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:12.340182 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1341/2676] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:27:12.349872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1336/2677] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:27:13.062783 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0a4b4-86c4-42aa-af31-1079012daa1c service neutron] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:13.066727 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-58f0a4b4-86c4-42aa-af31-1079012daa1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:13.067643 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddfb0a2-3463-4d30-b2f5-a94b92810eec service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:13.069088 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-8ddfb0a2-3463-4d30-b2f5-a94b92810eec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:13.093963 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddfb0a2-3463-4d30-b2f5-a94b92810eec service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:13.094240 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0a4b4-86c4-42aa-af31-1079012daa1c service neutron] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:13.098997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005ac87-1d57-450a-9482-aac1c0c1022e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:13.099832 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005ac87-1d57-450a-9482-aac1c0c1022e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:13.100282 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005ac87-1d57-450a-9482-aac1c0c1022e admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:13.110443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efee6b9-49a5-46cc-bb06-58b519b54bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:13.111272 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005ac87-1d57-450a-9482-aac1c0c1022e admin admin] PATH_INFO: `/v3/projects/c397da9a54b34bdca26bac2b8ca48437` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:13.111373 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efee6b9-49a5-46cc-bb06-58b519b54bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:13.111373 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efee6b9-49a5-46cc-bb06-58b519b54bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:13.111373 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efee6b9-49a5-46cc-bb06-58b519b54bba admin admin] PATH_INFO: `/v3/projects/7013ecc2814e4dd2a86445cdb3519335` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:13.111631 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005ac87-1d57-450a-9482-aac1c0c1022e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c397da9a54b34bdca26bac2b8ca48437)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:13.111733 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efee6b9-49a5-46cc-bb06-58b519b54bba admin admin] RBAC: Authorizing `identity:delete_project(project_id=7013ecc2814e4dd2a86445cdb3519335)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:13.111836 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005ac87-1d57-450a-9482-aac1c0c1022e admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:13.111939 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efee6b9-49a5-46cc-bb06-58b519b54bba admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:13.302325 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-3efee6b9-49a5-46cc-bb06-58b519b54bba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7013ecc2814e4dd2a86445cdb3519335', 'request_id': 'req-3efee6b9-49a5-46cc-bb06-58b519b54bba'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:13.302645 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-e005ac87-1d57-450a-9482-aac1c0c1022e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c397da9a54b34bdca26bac2b8ca48437', 'request_id': 'req-e005ac87-1d57-450a-9482-aac1c0c1022e'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:13.308424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-3efee6b9-49a5-46cc-bb06-58b519b54bba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7013ecc2814e4dd2a86445cdb3519335', 'request_id': 'req-3efee6b9-49a5-46cc-bb06-58b519b54bba'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:13.308690 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-e005ac87-1d57-450a-9482-aac1c0c1022e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c397da9a54b34bdca26bac2b8ca48437', 'request_id': 'req-e005ac87-1d57-450a-9482-aac1c0c1022e'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:13.316767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-3efee6b9-49a5-46cc-bb06-58b519b54bba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7013ecc2814e4dd2a86445cdb3519335', 'request_id': 'req-3efee6b9-49a5-46cc-bb06-58b519b54bba'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:13.316978 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-e005ac87-1d57-450a-9482-aac1c0c1022e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c397da9a54b34bdca26bac2b8ca48437', 'request_id': 'req-e005ac87-1d57-450a-9482-aac1c0c1022e'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:13.362991 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-e005ac87-1d57-450a-9482-aac1c0c1022e admin admin] The token cache is being invalidate because project c397da9a54b34bdca26bac2b8ca48437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:27:13.363345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-e005ac87-1d57-450a-9482-aac1c0c1022e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:13.364049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-e005ac87-1d57-450a-9482-aac1c0c1022e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:13.365569 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1342/2678] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:27:13 2022] DELETE /identity/v3/projects/c397da9a54b34bdca26bac2b8ca48437 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:13.369436 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005ac87-1d57-450a-9482-aac1c0c1022e admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:13.370837 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-e005ac87-1d57-450a-9482-aac1c0c1022e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:13.397921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-3efee6b9-49a5-46cc-bb06-58b519b54bba admin admin] The token cache is being invalidate because project 7013ecc2814e4dd2a86445cdb3519335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:27:13.398408 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-3efee6b9-49a5-46cc-bb06-58b519b54bba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:13.399175 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-3efee6b9-49a5-46cc-bb06-58b519b54bba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:13.400697 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1337/2679] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:27:13 2022] DELETE /identity/v3/projects/7013ecc2814e4dd2a86445cdb3519335 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:13.404997 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efee6b9-49a5-46cc-bb06-58b519b54bba admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:13.406617 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-3efee6b9-49a5-46cc-bb06-58b519b54bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:13.447328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005ac87-1d57-450a-9482-aac1c0c1022e admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:13.482609 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efee6b9-49a5-46cc-bb06-58b519b54bba admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:13.489741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca71c16-dcde-4cb6-8b0e-31acc81029ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:13.490327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca71c16-dcde-4cb6-8b0e-31acc81029ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:13.490611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca71c16-dcde-4cb6-8b0e-31acc81029ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:13.491012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca71c16-dcde-4cb6-8b0e-31acc81029ae admin admin] PATH_INFO: `/v3/users/8ae0dd54a50248ff8f8ec4660d0313d3` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:13.492264 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca71c16-dcde-4cb6-8b0e-31acc81029ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ae0dd54a50248ff8f8ec4660d0313d3)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:13.493569 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:13.495024 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca71c16-dcde-4cb6-8b0e-31acc81029ae admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:13.512587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a149ff-952d-4868-8b86-cd18664670c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:13.513224 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a149ff-952d-4868-8b86-cd18664670c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:13.513511 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a149ff-952d-4868-8b86-cd18664670c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:13.513785 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a149ff-952d-4868-8b86-cd18664670c1 admin admin] PATH_INFO: `/v3/users/a45807edccaf4ac99b1fa8d67713c3b5` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:13.514943 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a149ff-952d-4868-8b86-cd18664670c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a45807edccaf4ac99b1fa8d67713c3b5)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:13.516925 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a149ff-952d-4868-8b86-cd18664670c1 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:13.521336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:13.738337 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-9ca71c16-dcde-4cb6-8b0e-31acc81029ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ae0dd54a50248ff8f8ec4660d0313d3'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:13.738915 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-9ca71c16-dcde-4cb6-8b0e-31acc81029ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ae0dd54a50248ff8f8ec4660d0313d3'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:13.739539 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-9ca71c16-dcde-4cb6-8b0e-31acc81029ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ae0dd54a50248ff8f8ec4660d0313d3'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:13.772251 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-00a149ff-952d-4868-8b86-cd18664670c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a45807edccaf4ac99b1fa8d67713c3b5'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:13.772834 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-00a149ff-952d-4868-8b86-cd18664670c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a45807edccaf4ac99b1fa8d67713c3b5'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:13.773437 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-00a149ff-952d-4868-8b86-cd18664670c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a45807edccaf4ac99b1fa8d67713c3b5'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:13.826058 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-9ca71c16-dcde-4cb6-8b0e-31acc81029ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ae0dd54a50248ff8f8ec4660d0313d3'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:13.834112 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-9ca71c16-dcde-4cb6-8b0e-31acc81029ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ae0dd54a50248ff8f8ec4660d0313d3'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:13.852192 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1338/2680] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:27:13 2022] DELETE /identity/v3/users/8ae0dd54a50248ff8f8ec4660d0313d3 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:27:13.884223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-00a149ff-952d-4868-8b86-cd18664670c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a45807edccaf4ac99b1fa8d67713c3b5'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:13.898839 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-00a149ff-952d-4868-8b86-cd18664670c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a45807edccaf4ac99b1fa8d67713c3b5'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:13.912441 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1343/2681] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:27:13 2022] DELETE /identity/v3/users/a45807edccaf4ac99b1fa8d67713c3b5 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:27:14.300243 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca71c16-dcde-4cb6-8b0e-31acc81029ae admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:14.301768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-9ca71c16-dcde-4cb6-8b0e-31acc81029ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:14.361832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca71c16-dcde-4cb6-8b0e-31acc81029ae admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:14.413142 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b099b16-d532-41a3-b006-198158cc056b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:14.413926 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b099b16-d532-41a3-b006-198158cc056b service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:14.414216 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b099b16-d532-41a3-b006-198158cc056b service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:14.414524 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b099b16-d532-41a3-b006-198158cc056b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:14.416662 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-5b099b16-d532-41a3-b006-198158cc056b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:14.416956 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a149ff-952d-4868-8b86-cd18664670c1 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:14.418563 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-00a149ff-952d-4868-8b86-cd18664670c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:14.505479 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b099b16-d532-41a3-b006-198158cc056b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:14.507319 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b099b16-d532-41a3-b006-198158cc056b service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:14.512887 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a149ff-952d-4868-8b86-cd18664670c1 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:14.519737 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9d043-fc4f-478d-bd47-08b705213c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:14.520506 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9d043-fc4f-478d-bd47-08b705213c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:14.520655 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1339/2682] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:27:14.520867 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9d043-fc4f-478d-bd47-08b705213c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:14.520982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9d043-fc4f-478d-bd47-08b705213c44 admin admin] PATH_INFO: `/v3/projects/ccf2969eff04449291ba6f86c832067e` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:14.521649 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b099b16-d532-41a3-b006-198158cc056b service cinder] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:14.522196 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9d043-fc4f-478d-bd47-08b705213c44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf2969eff04449291ba6f86c832067e)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:14.523145 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-5b099b16-d532-41a3-b006-198158cc056b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:14.524158 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9d043-fc4f-478d-bd47-08b705213c44 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:14.551528 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:14.551528 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b099b16-d532-41a3-b006-198158cc056b service cinder] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:14.555779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a687984-5eb2-4e97-9182-fe9eb4618d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:14.557119 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a687984-5eb2-4e97-9182-fe9eb4618d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:14.558903 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a687984-5eb2-4e97-9182-fe9eb4618d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:14.559311 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a687984-5eb2-4e97-9182-fe9eb4618d72 admin admin] PATH_INFO: `/v3/projects/e051b95b72d44ecdac9b269ac5344529` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:14.561141 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a687984-5eb2-4e97-9182-fe9eb4618d72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e051b95b72d44ecdac9b269ac5344529)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:14.563515 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a687984-5eb2-4e97-9182-fe9eb4618d72 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:14.639383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-34e9d043-fc4f-478d-bd47-08b705213c44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf2969eff04449291ba6f86c832067e', 'request_id': 'req-34e9d043-fc4f-478d-bd47-08b705213c44'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:14.654903 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-34e9d043-fc4f-478d-bd47-08b705213c44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf2969eff04449291ba6f86c832067e', 'request_id': 'req-34e9d043-fc4f-478d-bd47-08b705213c44'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:14.656780 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:14.661931 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-34e9d043-fc4f-478d-bd47-08b705213c44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf2969eff04449291ba6f86c832067e', 'request_id': 'req-34e9d043-fc4f-478d-bd47-08b705213c44'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:15.009781 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-9a687984-5eb2-4e97-9182-fe9eb4618d72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e051b95b72d44ecdac9b269ac5344529', 'request_id': 'req-9a687984-5eb2-4e97-9182-fe9eb4618d72'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:15.015777 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-9a687984-5eb2-4e97-9182-fe9eb4618d72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e051b95b72d44ecdac9b269ac5344529', 'request_id': 'req-9a687984-5eb2-4e97-9182-fe9eb4618d72'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:15.022710 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-34e9d043-fc4f-478d-bd47-08b705213c44 admin admin] The token cache is being invalidate because project ccf2969eff04449291ba6f86c832067e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:27:15.023385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-34e9d043-fc4f-478d-bd47-08b705213c44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:15.023868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-9a687984-5eb2-4e97-9182-fe9eb4618d72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e051b95b72d44ecdac9b269ac5344529', 'request_id': 'req-9a687984-5eb2-4e97-9182-fe9eb4618d72'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:15.024279 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-34e9d043-fc4f-478d-bd47-08b705213c44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:15.031223 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1344/2683] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:27:14 2022] DELETE /identity/v3/projects/ccf2969eff04449291ba6f86c832067e => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:27:15.032737 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e6478-efa8-46e6-a5d8-8053f7236b73 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:15.033018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e6478-efa8-46e6-a5d8-8053f7236b73 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:15.033443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e6478-efa8-46e6-a5d8-8053f7236b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:15.052925 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-153e6478-efa8-46e6-a5d8-8053f7236b73 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:15.056722 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-153e6478-efa8-46e6-a5d8-8053f7236b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:15.111768 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1345/2684] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:27:15.119833 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bd369-80c7-4fd2-a841-4d99d9c2f67c None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:15.120123 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bd369-80c7-4fd2-a841-4d99d9c2f67c None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:15.120399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bd369-80c7-4fd2-a841-4d99d9c2f67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:15.136775 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-9a687984-5eb2-4e97-9182-fe9eb4618d72 admin admin] The token cache is being invalidate because project e051b95b72d44ecdac9b269ac5344529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:27:15.137075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-9a687984-5eb2-4e97-9182-fe9eb4618d72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:15.137856 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-9a687984-5eb2-4e97-9182-fe9eb4618d72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:15.140020 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1340/2685] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:27:14 2022] DELETE /identity/v3/projects/e051b95b72d44ecdac9b269ac5344529 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:15.144303 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-c22bd369-80c7-4fd2-a841-4d99d9c2f67c None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:15.145060 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ffb0e-15c1-4fe7-a5e7-d0b1eb6c5fe8 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:15.145442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ffb0e-15c1-4fe7-a5e7-d0b1eb6c5fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:15.145556 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c22bd369-80c7-4fd2-a841-4d99d9c2f67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:15.145732 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ffb0e-15c1-4fe7-a5e7-d0b1eb6c5fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:15.153575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1346/2686] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:27:15.157906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22bd369-80c7-4fd2-a841-4d99d9c2f67c None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:15.166307 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-d20ffb0e-15c1-4fe7-a5e7-d0b1eb6c5fe8 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:15.167107 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22bd369-80c7-4fd2-a841-4d99d9c2f67c None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:15.167771 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-d20ffb0e-15c1-4fe7-a5e7-d0b1eb6c5fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:15.171813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa6f27-67fb-4199-9434-ec8b06c2db51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:15.172404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa6f27-67fb-4199-9434-ec8b06c2db51 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:15.172687 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa6f27-67fb-4199-9434-ec8b06c2db51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:15.172966 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa6f27-67fb-4199-9434-ec8b06c2db51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:15.174231 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa6f27-67fb-4199-9434-ec8b06c2db51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:27:15.174570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa6f27-67fb-4199-9434-ec8b06c2db51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:15.176170 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa6f27-67fb-4199-9434-ec8b06c2db51 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:15.177460 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1341/2687] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:27:15.185676 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c1137-208c-439b-8b42-1a236d7644d6 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:15.185962 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c1137-208c-439b-8b42-1a236d7644d6 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:15.186237 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c1137-208c-439b-8b42-1a236d7644d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:15.191599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1347/2688] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 08:27:15.196660 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa6f27-67fb-4199-9434-ec8b06c2db51 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:15.207547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa6f27-67fb-4199-9434-ec8b06c2db51 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:15.208309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-821c1137-208c-439b-8b42-1a236d7644d6 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:15.209585 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-821c1137-208c-439b-8b42-1a236d7644d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:15.212307 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b265f-fcd0-46fc-a6ab-1348e0678901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:15.212984 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b265f-fcd0-46fc-a6ab-1348e0678901 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:15.213293 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b265f-fcd0-46fc-a6ab-1348e0678901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:15.213571 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b265f-fcd0-46fc-a6ab-1348e0678901 admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:15.214201 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b265f-fcd0-46fc-a6ab-1348e0678901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:15.216309 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b265f-fcd0-46fc-a6ab-1348e0678901 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:15.226496 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1342/2689] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:27:15.229940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c1137-208c-439b-8b42-1a236d7644d6 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:15.240298 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c1137-208c-439b-8b42-1a236d7644d6 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:15.245296 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f779e1-ab19-4980-b851-6f917845621b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:15.246103 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f779e1-ab19-4980-b851-6f917845621b admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:15.246424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f779e1-ab19-4980-b851-6f917845621b admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:15.246708 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f779e1-ab19-4980-b851-6f917845621b admin admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:15.247340 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f779e1-ab19-4980-b851-6f917845621b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:27:15.247637 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f779e1-ab19-4980-b851-6f917845621b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:15.249423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f779e1-ab19-4980-b851-6f917845621b admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:15.262959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1343/2690] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 08:27:15.267594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f779e1-ab19-4980-b851-6f917845621b admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:15.281233 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f779e1-ab19-4980-b851-6f917845621b admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:15.290937 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3c5d3-7cf4-4d4a-8ffe-fab52a9fb332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:15.291546 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3c5d3-7cf4-4d4a-8ffe-fab52a9fb332 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:15.291852 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3c5d3-7cf4-4d4a-8ffe-fab52a9fb332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:15.292128 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3c5d3-7cf4-4d4a-8ffe-fab52a9fb332 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:15.292746 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3c5d3-7cf4-4d4a-8ffe-fab52a9fb332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:15.294699 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3c5d3-7cf4-4d4a-8ffe-fab52a9fb332 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:15.330828 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1348/2691] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:27:15 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:27:15.335158 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b265f-fcd0-46fc-a6ab-1348e0678901 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:15.397592 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b265f-fcd0-46fc-a6ab-1348e0678901 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:15.402550 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d320f58-9443-4aa8-b244-ac1804e6905d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:15.403153 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d320f58-9443-4aa8-b244-ac1804e6905d admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:15.403434 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d320f58-9443-4aa8-b244-ac1804e6905d admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:15.403706 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d320f58-9443-4aa8-b244-ac1804e6905d admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:15.404317 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d320f58-9443-4aa8-b244-ac1804e6905d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:15.406237 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d320f58-9443-4aa8-b244-ac1804e6905d admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:15.422494 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1344/2692] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:27:15 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:27:15.427179 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3c5d3-7cf4-4d4a-8ffe-fab52a9fb332 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:15.495689 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1349/2693] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:27:15 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:27:15.500090 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d320f58-9443-4aa8-b244-ac1804e6905d admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:15.500623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3c5d3-7cf4-4d4a-8ffe-fab52a9fb332 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:15.505628 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f1363-e62e-44c8-a9fd-49ab30790b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:15.506277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f1363-e62e-44c8-a9fd-49ab30790b3f admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:15.506840 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f1363-e62e-44c8-a9fd-49ab30790b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:15.507168 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f1363-e62e-44c8-a9fd-49ab30790b3f admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:15.507862 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f1363-e62e-44c8-a9fd-49ab30790b3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:15.509817 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f1363-e62e-44c8-a9fd-49ab30790b3f admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:15.511241 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d320f58-9443-4aa8-b244-ac1804e6905d admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:15.516340 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3b6c1-1c60-4edc-803a-2be9e90bc73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:15.516890 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3b6c1-1c60-4edc-803a-2be9e90bc73f admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:15.517380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3b6c1-1c60-4edc-803a-2be9e90bc73f admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:15.517635 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3b6c1-1c60-4edc-803a-2be9e90bc73f admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:15.518731 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3b6c1-1c60-4edc-803a-2be9e90bc73f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:15.521351 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3b6c1-1c60-4edc-803a-2be9e90bc73f admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:15.533654 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1350/2694] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:27:15.537670 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3b6c1-1c60-4edc-803a-2be9e90bc73f admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:15.551774 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3b6c1-1c60-4edc-803a-2be9e90bc73f admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:15.556905 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a74ab-cfe9-44ec-b018-d091c4a0b984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:15.557966 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a74ab-cfe9-44ec-b018-d091c4a0b984 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:15.558469 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a74ab-cfe9-44ec-b018-d091c4a0b984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:15.558766 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a74ab-cfe9-44ec-b018-d091c4a0b984 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:15.559406 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a74ab-cfe9-44ec-b018-d091c4a0b984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:15.561343 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a74ab-cfe9-44ec-b018-d091c4a0b984 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:15.576608 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1351/2695] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:27:15.581238 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a74ab-cfe9-44ec-b018-d091c4a0b984 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:15.591242 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a74ab-cfe9-44ec-b018-d091c4a0b984 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:15.597104 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb71d40-dd2c-4709-a2b0-1a53b85cdb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:15.597805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb71d40-dd2c-4709-a2b0-1a53b85cdb09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:15.598090 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb71d40-dd2c-4709-a2b0-1a53b85cdb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:15.598399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb71d40-dd2c-4709-a2b0-1a53b85cdb09 admin admin] PATH_INFO: `/v3/projects/b27da3ffebd449d99102a69015b5e1a7/users/0fdc609da23b46f8b22a5e2d21c2ca70/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:15.615190 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb71d40-dd2c-4709-a2b0-1a53b85cdb09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b27da3ffebd449d99102a69015b5e1a7, user_id=0fdc609da23b46f8b22a5e2d21c2ca70, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:15.617845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb71d40-dd2c-4709-a2b0-1a53b85cdb09 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:15.666128 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1345/2696] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:27:15 2022] POST /identity/v3/users => generated 289 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:27:15.667513 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f1363-e62e-44c8-a9fd-49ab30790b3f admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:15.677487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f1363-e62e-44c8-a9fd-49ab30790b3f admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:15.682203 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb24be-10b3-457c-9708-b5df3e3341cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:15.682886 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb24be-10b3-457c-9708-b5df3e3341cd admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:15.683177 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb24be-10b3-457c-9708-b5df3e3341cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:15.683454 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb24be-10b3-457c-9708-b5df3e3341cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:15.684216 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb24be-10b3-457c-9708-b5df3e3341cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:15.685816 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb24be-10b3-457c-9708-b5df3e3341cd admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:15.696376 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1346/2697] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:15.703232 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb24be-10b3-457c-9708-b5df3e3341cd admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:15.717566 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb24be-10b3-457c-9708-b5df3e3341cd admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:15.725220 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1352/2698] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:15 2022] PUT /identity/v3/projects/b27da3ffebd449d99102a69015b5e1a7/users/0fdc609da23b46f8b22a5e2d21c2ca70/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:27:15.728738 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:15.732127 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:15.735681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c3f8a-fc24-4872-8d2d-c5403e35d9b6 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:15.736074 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c3f8a-fc24-4872-8d2d-c5403e35d9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:15.736350 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c3f8a-fc24-4872-8d2d-c5403e35d9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:15.762800 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-444c3f8a-fc24-4872-8d2d-c5403e35d9b6 None None] MFA Rules not processed for user `0fdc609da23b46f8b22a5e2d21c2ca70`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:15.764019 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-444c3f8a-fc24-4872-8d2d-c5403e35d9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:15.779645 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ec545-f57b-45d9-abd6-056fafea1097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:15.780201 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ec545-f57b-45d9-abd6-056fafea1097 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:15.780486 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ec545-f57b-45d9-abd6-056fafea1097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:15.780889 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ec545-f57b-45d9-abd6-056fafea1097 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:15.781951 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ec545-f57b-45d9-abd6-056fafea1097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:15.784138 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ec545-f57b-45d9-abd6-056fafea1097 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:15.797154 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1347/2699] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:15.798130 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ec545-f57b-45d9-abd6-056fafea1097 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:15.807624 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ec545-f57b-45d9-abd6-056fafea1097 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:15.812271 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79b95d-4fa3-45ab-ba84-c9db2737c2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:15.812903 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79b95d-4fa3-45ab-ba84-c9db2737c2b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:15.813209 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79b95d-4fa3-45ab-ba84-c9db2737c2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:15.813489 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79b95d-4fa3-45ab-ba84-c9db2737c2b6 admin admin] PATH_INFO: `/v3/projects/81b0cbe2b5f74df88aaf153ef425573c/users/ebf1a773795a4210a4b4de14c1642a6b/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:15.827795 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79b95d-4fa3-45ab-ba84-c9db2737c2b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81b0cbe2b5f74df88aaf153ef425573c, user_id=ebf1a773795a4210a4b4de14c1642a6b, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:15.828329 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1353/2700] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:27:15.831342 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79b95d-4fa3-45ab-ba84-c9db2737c2b6 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:15.840843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c3f8a-fc24-4872-8d2d-c5403e35d9b6 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:15.842278 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-444c3f8a-fc24-4872-8d2d-c5403e35d9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:15.910937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c3f8a-fc24-4872-8d2d-c5403e35d9b6 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:15.914557 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cfa7b-075e-41b5-b613-d5951c921db4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f4ee9c3c5be48699a24dfce9b30bda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:15.915152 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cfa7b-075e-41b5-b613-d5951c921db4 service glance] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:15.915427 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cfa7b-075e-41b5-b613-d5951c921db4 service glance] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:15.915698 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cfa7b-075e-41b5-b613-d5951c921db4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:15.924464 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1348/2701] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:15 2022] PUT /identity/v3/projects/81b0cbe2b5f74df88aaf153ef425573c/users/ebf1a773795a4210a4b4de14c1642a6b/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:27:15.934665 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31cfa7b-075e-41b5-b613-d5951c921db4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:15.934665 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31cfa7b-075e-41b5-b613-d5951c921db4 service glance] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:15.935076 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497ee37-3e1f-4285-ad84-a71870272c5b None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:15.935361 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497ee37-3e1f-4285-ad84-a71870272c5b None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:15.935639 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497ee37-3e1f-4285-ad84-a71870272c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:15.935792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1354/2702] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:27:15.968355 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-a497ee37-3e1f-4285-ad84-a71870272c5b None None] MFA Rules not processed for user `ebf1a773795a4210a4b4de14c1642a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:15.969555 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a497ee37-3e1f-4285-ad84-a71870272c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:16.037917 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1349/2703] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:27:16.042633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cfa7b-075e-41b5-b613-d5951c921db4 service glance] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:16.056973 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cfa7b-075e-41b5-b613-d5951c921db4 service glance] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:16.112673 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca63cb2-3523-4e62-ad45-fb90e3fa146e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:16.113315 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca63cb2-3523-4e62-ad45-fb90e3fa146e admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:16.113594 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca63cb2-3523-4e62-ad45-fb90e3fa146e admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:16.113874 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca63cb2-3523-4e62-ad45-fb90e3fa146e admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:16.114538 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca63cb2-3523-4e62-ad45-fb90e3fa146e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:16.116654 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca63cb2-3523-4e62-ad45-fb90e3fa146e admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:16.210415 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1355/2704] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:27:16 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:27:16.211552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497ee37-3e1f-4285-ad84-a71870272c5b None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:16.223742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497ee37-3e1f-4285-ad84-a71870272c5b None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:16.283108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca56dc-1c5b-4220-a7f4-10fbcc8202b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:16.283839 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca56dc-1c5b-4220-a7f4-10fbcc8202b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:16.284173 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca56dc-1c5b-4220-a7f4-10fbcc8202b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:16.284394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca56dc-1c5b-4220-a7f4-10fbcc8202b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:16.285015 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca56dc-1c5b-4220-a7f4-10fbcc8202b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:16.287036 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca56dc-1c5b-4220-a7f4-10fbcc8202b7 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:16.381533 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1350/2705] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:27:16 2022] POST /identity/v3/users => generated 296 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:27:16.385670 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca63cb2-3523-4e62-ad45-fb90e3fa146e admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:16.397329 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca63cb2-3523-4e62-ad45-fb90e3fa146e admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:16.402115 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5f3fb-c792-46e3-b90f-ba5fa0498250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:16.402924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5f3fb-c792-46e3-b90f-ba5fa0498250 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:16.403157 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5f3fb-c792-46e3-b90f-ba5fa0498250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:16.403485 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5f3fb-c792-46e3-b90f-ba5fa0498250 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:16.404258 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5f3fb-c792-46e3-b90f-ba5fa0498250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:16.406031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5f3fb-c792-46e3-b90f-ba5fa0498250 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:16.408924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:16.419536 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1356/2706] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:16.424267 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca56dc-1c5b-4220-a7f4-10fbcc8202b7 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:16.434689 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca56dc-1c5b-4220-a7f4-10fbcc8202b7 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:16.439901 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283b72c-be7a-4a74-92b6-f3f063ac6bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:16.440813 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283b72c-be7a-4a74-92b6-f3f063ac6bee admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:16.441174 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283b72c-be7a-4a74-92b6-f3f063ac6bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:16.441416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283b72c-be7a-4a74-92b6-f3f063ac6bee admin admin] PATH_INFO: `/v3/projects/e622b73fe4824f608ce814c4cf87b0be/users/d815a17224e84982b956c3a99c6db456/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:16.443828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:16.457257 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283b72c-be7a-4a74-92b6-f3f063ac6bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=e622b73fe4824f608ce814c4cf87b0be, user_id=d815a17224e84982b956c3a99c6db456, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:16.462773 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283b72c-be7a-4a74-92b6-f3f063ac6bee admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:16.524667 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1351/2707] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:16 2022] PUT /identity/v3/projects/e622b73fe4824f608ce814c4cf87b0be/users/d815a17224e84982b956c3a99c6db456/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:16.528882 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5f3fb-c792-46e3-b90f-ba5fa0498250 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:16.541373 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5f3fb-c792-46e3-b90f-ba5fa0498250 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:16.605099 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7385f-0f45-4bdd-ac21-33355751a7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:16.605767 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7385f-0f45-4bdd-ac21-33355751a7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:16.606172 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7385f-0f45-4bdd-ac21-33355751a7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:16.606309 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7385f-0f45-4bdd-ac21-33355751a7a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:16.606964 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7385f-0f45-4bdd-ac21-33355751a7a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:16.608563 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7385f-0f45-4bdd-ac21-33355751a7a5 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:16.619645 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1357/2708] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:16.631228 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283b72c-be7a-4a74-92b6-f3f063ac6bee admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:16.643223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283b72c-be7a-4a74-92b6-f3f063ac6bee admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:16.651791 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65a6dd-47e5-4ed9-81db-52bb82ca3ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:16.652515 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65a6dd-47e5-4ed9-81db-52bb82ca3ec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:16.652741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65a6dd-47e5-4ed9-81db-52bb82ca3ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:16.653025 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65a6dd-47e5-4ed9-81db-52bb82ca3ec6 admin admin] PATH_INFO: `/v3/projects/e622b73fe4824f608ce814c4cf87b0be/users/d815a17224e84982b956c3a99c6db456/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:16.655014 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65a6dd-47e5-4ed9-81db-52bb82ca3ec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e622b73fe4824f608ce814c4cf87b0be, user_id=d815a17224e84982b956c3a99c6db456, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:16.658546 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65a6dd-47e5-4ed9-81db-52bb82ca3ec6 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:16.671854 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1352/2709] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:16 2022] PUT /identity/v3/projects/e622b73fe4824f608ce814c4cf87b0be/users/d815a17224e84982b956c3a99c6db456/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:16.683708 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d397ce-2ede-4e5d-8b4f-87cefa6bc1bb None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:16.684850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d397ce-2ede-4e5d-8b4f-87cefa6bc1bb None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:16.685273 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d397ce-2ede-4e5d-8b4f-87cefa6bc1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:16.722744 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-d5d397ce-2ede-4e5d-8b4f-87cefa6bc1bb None None] MFA Rules not processed for user `d815a17224e84982b956c3a99c6db456`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:16.723970 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-d5d397ce-2ede-4e5d-8b4f-87cefa6bc1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:16.808757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1358/2710] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:16 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:16.821166 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65a6dd-47e5-4ed9-81db-52bb82ca3ec6 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:16.823783 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-dd65a6dd-47e5-4ed9-81db-52bb82ca3ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:16.913301 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65a6dd-47e5-4ed9-81db-52bb82ca3ec6 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:16.919875 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3f21d-e3a6-4248-91c5-e0299a2c8e51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:16.920842 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3f21d-e3a6-4248-91c5-e0299a2c8e51 service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:16.922953 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3f21d-e3a6-4248-91c5-e0299a2c8e51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:16.922953 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3f21d-e3a6-4248-91c5-e0299a2c8e51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:16.986769 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3f21d-e3a6-4248-91c5-e0299a2c8e51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:16.988352 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3f21d-e3a6-4248-91c5-e0299a2c8e51 service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:16.997255 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1353/2711] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:27:18.628436 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d397ce-2ede-4e5d-8b4f-87cefa6bc1bb None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:18.638068 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d397ce-2ede-4e5d-8b4f-87cefa6bc1bb None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:18.641716 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da76992-4c53-4361-8d57-e3d15a6e733c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:18.642987 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da76992-4c53-4361-8d57-e3d15a6e733c service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:18.643273 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da76992-4c53-4361-8d57-e3d15a6e733c service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:18.643541 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da76992-4c53-4361-8d57-e3d15a6e733c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:18.653159 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da76992-4c53-4361-8d57-e3d15a6e733c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:18.654657 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da76992-4c53-4361-8d57-e3d15a6e733c service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:18.664300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1359/2712] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:27:20.413597 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3f21d-e3a6-4248-91c5-e0299a2c8e51 service cinder] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:20.415041 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-8cc3f21d-e3a6-4248-91c5-e0299a2c8e51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:20.475801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3f21d-e3a6-4248-91c5-e0299a2c8e51 service cinder] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:20.479581 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0508bb-57fc-49c4-ba26-7c8b5efd2445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:20.480196 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0508bb-57fc-49c4-ba26-7c8b5efd2445 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:20.480486 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0508bb-57fc-49c4-ba26-7c8b5efd2445 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:20.480753 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0508bb-57fc-49c4-ba26-7c8b5efd2445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:20.482590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-3e0508bb-57fc-49c4-ba26-7c8b5efd2445 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:20.524482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:20.545002 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0508bb-57fc-49c4-ba26-7c8b5efd2445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:20.546494 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0508bb-57fc-49c4-ba26-7c8b5efd2445 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:20.566213 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1354/2713] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:27:21.960023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da76992-4c53-4361-8d57-e3d15a6e733c service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:21.962427 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-8da76992-4c53-4361-8d57-e3d15a6e733c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:22.025388 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0508bb-57fc-49c4-ba26-7c8b5efd2445 service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:22.040554 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0508bb-57fc-49c4-ba26-7c8b5efd2445 service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:22.049195 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88009b75-b747-41e2-bec3-6c162c18ec58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:22.054310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88009b75-b747-41e2-bec3-6c162c18ec58 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:22.054611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88009b75-b747-41e2-bec3-6c162c18ec58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:22.054873 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88009b75-b747-41e2-bec3-6c162c18ec58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:22.056801 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-88009b75-b747-41e2-bec3-6c162c18ec58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:22.056936 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da76992-4c53-4361-8d57-e3d15a6e733c service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:22.062611 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0987af-7358-4ddf-9f4c-cca7f7678a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:22.064821 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0987af-7358-4ddf-9f4c-cca7f7678a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:22.065381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0987af-7358-4ddf-9f4c-cca7f7678a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:22.066012 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0987af-7358-4ddf-9f4c-cca7f7678a49 admin admin] PATH_INFO: `/v3/users/92725b0663bc4afb8bc63fbf14048d01` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:22.067854 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0987af-7358-4ddf-9f4c-cca7f7678a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92725b0663bc4afb8bc63fbf14048d01)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:22.070745 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0987af-7358-4ddf-9f4c-cca7f7678a49 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:22.083061 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=100 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:22.151023 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88009b75-b747-41e2-bec3-6c162c18ec58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:22.152482 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88009b75-b747-41e2-bec3-6c162c18ec58 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:22.165115 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1355/2714] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:27:22.324617 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-bb0987af-7358-4ddf-9f4c-cca7f7678a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92725b0663bc4afb8bc63fbf14048d01'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:22.325350 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-bb0987af-7358-4ddf-9f4c-cca7f7678a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92725b0663bc4afb8bc63fbf14048d01'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:22.325961 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-bb0987af-7358-4ddf-9f4c-cca7f7678a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92725b0663bc4afb8bc63fbf14048d01'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:22.410582 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-bb0987af-7358-4ddf-9f4c-cca7f7678a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92725b0663bc4afb8bc63fbf14048d01'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:22.443471 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-bb0987af-7358-4ddf-9f4c-cca7f7678a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92725b0663bc4afb8bc63fbf14048d01'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:22.459351 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1360/2715] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:27:21 2022] DELETE /identity/v3/users/92725b0663bc4afb8bc63fbf14048d01 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:22.463627 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60aa4d-f3a5-4816-a325-5033d274a0b2 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:22.463909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60aa4d-f3a5-4816-a325-5033d274a0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:22.464181 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60aa4d-f3a5-4816-a325-5033d274a0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:22.487005 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-df60aa4d-f3a5-4816-a325-5033d274a0b2 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:22.488678 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-df60aa4d-f3a5-4816-a325-5033d274a0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:22.563958 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1356/2716] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:27:22.584336 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0987af-7358-4ddf-9f4c-cca7f7678a49 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:22.584336 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-bb0987af-7358-4ddf-9f4c-cca7f7678a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:22.645891 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0987af-7358-4ddf-9f4c-cca7f7678a49 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:22.649693 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5189a7f-fe69-4a25-9830-7fa950048989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:22.650337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5189a7f-fe69-4a25-9830-7fa950048989 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:22.650618 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5189a7f-fe69-4a25-9830-7fa950048989 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:22.650970 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5189a7f-fe69-4a25-9830-7fa950048989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:22.664770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5189a7f-fe69-4a25-9830-7fa950048989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:22.667592 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5189a7f-fe69-4a25-9830-7fa950048989 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:22.678513 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1361/2717] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:27:23.228897 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60aa4d-f3a5-4816-a325-5033d274a0b2 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:23.230601 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-df60aa4d-f3a5-4816-a325-5033d274a0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:23.245564 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60aa4d-f3a5-4816-a325-5033d274a0b2 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:23.267779 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b5aca-0dca-4fe8-88a8-9779fcac151e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:23.268471 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b5aca-0dca-4fe8-88a8-9779fcac151e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:23.268753 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b5aca-0dca-4fe8-88a8-9779fcac151e admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:23.269058 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b5aca-0dca-4fe8-88a8-9779fcac151e admin admin] PATH_INFO: `/v3/projects/190f078f49ff40d8b5bf20955ca32739` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:23.270174 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b5aca-0dca-4fe8-88a8-9779fcac151e admin admin] RBAC: Authorizing `identity:delete_project(project_id=190f078f49ff40d8b5bf20955ca32739)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:23.272141 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b5aca-0dca-4fe8-88a8-9779fcac151e admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:23.400172 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-301b5aca-0dca-4fe8-88a8-9779fcac151e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '190f078f49ff40d8b5bf20955ca32739', 'request_id': 'req-301b5aca-0dca-4fe8-88a8-9779fcac151e'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:23.405688 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-301b5aca-0dca-4fe8-88a8-9779fcac151e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '190f078f49ff40d8b5bf20955ca32739', 'request_id': 'req-301b5aca-0dca-4fe8-88a8-9779fcac151e'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:23.406780 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:23.412775 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-301b5aca-0dca-4fe8-88a8-9779fcac151e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '190f078f49ff40d8b5bf20955ca32739', 'request_id': 'req-301b5aca-0dca-4fe8-88a8-9779fcac151e'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:23.524188 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-301b5aca-0dca-4fe8-88a8-9779fcac151e admin admin] The token cache is being invalidate because project 190f078f49ff40d8b5bf20955ca32739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:27:23.524758 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-301b5aca-0dca-4fe8-88a8-9779fcac151e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:23.525404 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-301b5aca-0dca-4fe8-88a8-9779fcac151e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:23.527281 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1357/2718] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:27:23 2022] DELETE /identity/v3/projects/190f078f49ff40d8b5bf20955ca32739 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:23.531247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5189a7f-fe69-4a25-9830-7fa950048989 service neutron] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:23.541705 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5189a7f-fe69-4a25-9830-7fa950048989 service neutron] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:23.603465 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a2673-04fe-4729-bd5e-427bebcd9217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:23.604117 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a2673-04fe-4729-bd5e-427bebcd9217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:23.604397 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a2673-04fe-4729-bd5e-427bebcd9217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:23.604674 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a2673-04fe-4729-bd5e-427bebcd9217 admin admin] PATH_INFO: `/v3/users/2dc19a0273e74da6b544b0b969cb3b2b` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:23.605800 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a2673-04fe-4729-bd5e-427bebcd9217 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dc19a0273e74da6b544b0b969cb3b2b)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:23.607760 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a2673-04fe-4729-bd5e-427bebcd9217 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:23.654183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b5aca-0dca-4fe8-88a8-9779fcac151e admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:23.655849 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-301b5aca-0dca-4fe8-88a8-9779fcac151e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:23.721246 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b5aca-0dca-4fe8-88a8-9779fcac151e admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:23.725281 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a262c6-ebfe-4cfc-a93c-2ac2f393bf9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:23.725895 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a262c6-ebfe-4cfc-a93c-2ac2f393bf9f service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:23.726171 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a262c6-ebfe-4cfc-a93c-2ac2f393bf9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:23.726473 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a262c6-ebfe-4cfc-a93c-2ac2f393bf9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:23.728276 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-43a262c6-ebfe-4cfc-a93c-2ac2f393bf9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:23.799652 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:23.806971 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a262c6-ebfe-4cfc-a93c-2ac2f393bf9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:23.808574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a262c6-ebfe-4cfc-a93c-2ac2f393bf9f service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:23.816965 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-982a2673-04fe-4729-bd5e-427bebcd9217 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dc19a0273e74da6b544b0b969cb3b2b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:23.817642 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-982a2673-04fe-4729-bd5e-427bebcd9217 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dc19a0273e74da6b544b0b969cb3b2b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:23.818251 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-982a2673-04fe-4729-bd5e-427bebcd9217 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dc19a0273e74da6b544b0b969cb3b2b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:23.821468 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1358/2719] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:27:23.907729 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-982a2673-04fe-4729-bd5e-427bebcd9217 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dc19a0273e74da6b544b0b969cb3b2b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:23.920685 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-982a2673-04fe-4729-bd5e-427bebcd9217 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dc19a0273e74da6b544b0b969cb3b2b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:23.936962 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1362/2720] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:27:23 2022] DELETE /identity/v3/users/2dc19a0273e74da6b544b0b969cb3b2b => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:24.456447 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a262c6-ebfe-4cfc-a93c-2ac2f393bf9f service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:24.460600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-43a262c6-ebfe-4cfc-a93c-2ac2f393bf9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:24.469873 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a2673-04fe-4729-bd5e-427bebcd9217 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:24.471942 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-982a2673-04fe-4729-bd5e-427bebcd9217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:24.478280 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a262c6-ebfe-4cfc-a93c-2ac2f393bf9f service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:24.557943 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a2673-04fe-4729-bd5e-427bebcd9217 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:24.564886 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac026f61-7c83-4cbe-988c-4e82b884ae82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:24.569923 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac026f61-7c83-4cbe-988c-4e82b884ae82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:24.570208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac026f61-7c83-4cbe-988c-4e82b884ae82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:24.570510 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac026f61-7c83-4cbe-988c-4e82b884ae82 admin admin] PATH_INFO: `/v3/users/ebf1a773795a4210a4b4de14c1642a6b` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:24.571839 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac026f61-7c83-4cbe-988c-4e82b884ae82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf1a773795a4210a4b4de14c1642a6b)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:24.574024 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac026f61-7c83-4cbe-988c-4e82b884ae82 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:24.585103 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed375c-480e-4a73-bb48-f4eac0cd4b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:24.585742 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed375c-480e-4a73-bb48-f4eac0cd4b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:24.586050 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed375c-480e-4a73-bb48-f4eac0cd4b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:24.586359 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed375c-480e-4a73-bb48-f4eac0cd4b88 admin admin] PATH_INFO: `/v3/projects/a0c62621bc1e41ebad4fc84f537ed8d4` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:24.587526 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed375c-480e-4a73-bb48-f4eac0cd4b88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0c62621bc1e41ebad4fc84f537ed8d4)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:24.589445 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed375c-480e-4a73-bb48-f4eac0cd4b88 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:24.684380 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:24.697945 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-d0ed375c-480e-4a73-bb48-f4eac0cd4b88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0c62621bc1e41ebad4fc84f537ed8d4', 'request_id': 'req-d0ed375c-480e-4a73-bb48-f4eac0cd4b88'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:24.703586 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-d0ed375c-480e-4a73-bb48-f4eac0cd4b88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0c62621bc1e41ebad4fc84f537ed8d4', 'request_id': 'req-d0ed375c-480e-4a73-bb48-f4eac0cd4b88'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:24.709916 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-d0ed375c-480e-4a73-bb48-f4eac0cd4b88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0c62621bc1e41ebad4fc84f537ed8d4', 'request_id': 'req-d0ed375c-480e-4a73-bb48-f4eac0cd4b88'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:24.785314 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-ac026f61-7c83-4cbe-988c-4e82b884ae82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf1a773795a4210a4b4de14c1642a6b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:24.785996 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-ac026f61-7c83-4cbe-988c-4e82b884ae82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf1a773795a4210a4b4de14c1642a6b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:24.786616 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-ac026f61-7c83-4cbe-988c-4e82b884ae82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf1a773795a4210a4b4de14c1642a6b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:24.807937 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-d0ed375c-480e-4a73-bb48-f4eac0cd4b88 admin admin] The token cache is being invalidate because project a0c62621bc1e41ebad4fc84f537ed8d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:27:24.808262 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-d0ed375c-480e-4a73-bb48-f4eac0cd4b88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:24.808909 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-d0ed375c-480e-4a73-bb48-f4eac0cd4b88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:24.816290 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1359/2721] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:27:24 2022] DELETE /identity/v3/projects/a0c62621bc1e41ebad4fc84f537ed8d4 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:24.817945 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0f14d-6ada-4bfc-8ed4-bf6ea435f876 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:24.818129 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0f14d-6ada-4bfc-8ed4-bf6ea435f876 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:24.818442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0f14d-6ada-4bfc-8ed4-bf6ea435f876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:24.840468 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-52f0f14d-6ada-4bfc-8ed4-bf6ea435f876 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:24.841712 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-52f0f14d-6ada-4bfc-8ed4-bf6ea435f876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:24.867006 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-ac026f61-7c83-4cbe-988c-4e82b884ae82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf1a773795a4210a4b4de14c1642a6b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:24.887866 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-ac026f61-7c83-4cbe-988c-4e82b884ae82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf1a773795a4210a4b4de14c1642a6b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:24.898885 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1363/2722] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:27:24 2022] DELETE /identity/v3/users/ebf1a773795a4210a4b4de14c1642a6b => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:24.903216 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9fd1d-b108-460e-a8e5-1abe4fe6619c None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:24.903518 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9fd1d-b108-460e-a8e5-1abe4fe6619c None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:24.903800 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9fd1d-b108-460e-a8e5-1abe4fe6619c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:24.915609 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1360/2723] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:27:24.927844 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d479ad7-efd6-4bea-a12b-23a0a89aeb6b None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:24.928234 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d479ad7-efd6-4bea-a12b-23a0a89aeb6b None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:24.928445 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d479ad7-efd6-4bea-a12b-23a0a89aeb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:24.930725 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-9fd9fd1d-b108-460e-a8e5-1abe4fe6619c None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:24.932119 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-9fd9fd1d-b108-460e-a8e5-1abe4fe6619c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:24.951289 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-7d479ad7-efd6-4bea-a12b-23a0a89aeb6b None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:24.953026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-7d479ad7-efd6-4bea-a12b-23a0a89aeb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:24.964542 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:25.022325 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1364/2724] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:25.027960 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9fd1d-b108-460e-a8e5-1abe4fe6619c None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:25.030103 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-9fd9fd1d-b108-460e-a8e5-1abe4fe6619c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:25.044621 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1361/2725] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:25.048924 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d479ad7-efd6-4bea-a12b-23a0a89aeb6b None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:25.058072 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d479ad7-efd6-4bea-a12b-23a0a89aeb6b None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:25.063040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da1181-82eb-4f2d-a88b-300d12b6d894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:25.064065 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da1181-82eb-4f2d-a88b-300d12b6d894 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:25.064065 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da1181-82eb-4f2d-a88b-300d12b6d894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:25.064834 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da1181-82eb-4f2d-a88b-300d12b6d894 admin admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:25.065463 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da1181-82eb-4f2d-a88b-300d12b6d894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:27:25.065652 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da1181-82eb-4f2d-a88b-300d12b6d894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:25.068200 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da1181-82eb-4f2d-a88b-300d12b6d894 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:25.087846 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1362/2726] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:27:25.094959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da1181-82eb-4f2d-a88b-300d12b6d894 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:25.100407 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9fd1d-b108-460e-a8e5-1abe4fe6619c None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:25.104250 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c400d-05be-402c-a337-e6a0533518cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:25.104919 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c400d-05be-402c-a337-e6a0533518cf service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:25.105437 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c400d-05be-402c-a337-e6a0533518cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:25.105609 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c400d-05be-402c-a337-e6a0533518cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:25.105761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da1181-82eb-4f2d-a88b-300d12b6d894 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:25.111094 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7559c71-2393-42dd-a914-dc6b9ccb3334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:25.112238 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7559c71-2393-42dd-a914-dc6b9ccb3334 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:25.112518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7559c71-2393-42dd-a914-dc6b9ccb3334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:25.112794 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7559c71-2393-42dd-a914-dc6b9ccb3334 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:25.113409 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7559c71-2393-42dd-a914-dc6b9ccb3334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:25.115519 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7559c71-2393-42dd-a914-dc6b9ccb3334 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:25.118959 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c400d-05be-402c-a337-e6a0533518cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:25.120416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c400d-05be-402c-a337-e6a0533518cf service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:25.134762 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1365/2727] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:27:25.244623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1363/2728] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:27:25 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:27:25.248992 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c400d-05be-402c-a337-e6a0533518cf service neutron] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:25.259312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c400d-05be-402c-a337-e6a0533518cf service neutron] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:25.324627 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cd576-9caa-4137-aedf-189e16b5d646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:25.325252 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cd576-9caa-4137-aedf-189e16b5d646 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:25.325520 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cd576-9caa-4137-aedf-189e16b5d646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:25.325792 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cd576-9caa-4137-aedf-189e16b5d646 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:25.326484 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cd576-9caa-4137-aedf-189e16b5d646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:25.328406 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cd576-9caa-4137-aedf-189e16b5d646 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:25.425305 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1366/2729] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:27:25 2022] POST /identity/v3/users => generated 287 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:27:25.427053 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7559c71-2393-42dd-a914-dc6b9ccb3334 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:25.442588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7559c71-2393-42dd-a914-dc6b9ccb3334 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:25.454116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c52d05-0968-4e2a-9310-a93041a6fa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:25.455479 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c52d05-0968-4e2a-9310-a93041a6fa8f admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:25.455832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c52d05-0968-4e2a-9310-a93041a6fa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:25.456188 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c52d05-0968-4e2a-9310-a93041a6fa8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:25.456888 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c52d05-0968-4e2a-9310-a93041a6fa8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:25.458563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c52d05-0968-4e2a-9310-a93041a6fa8f admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:25.468866 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1364/2730] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:25.474295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cd576-9caa-4137-aedf-189e16b5d646 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:25.485178 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cd576-9caa-4137-aedf-189e16b5d646 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:25.491475 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b97d1f-9de0-41d5-ad40-7b53ced603a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:25.492159 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b97d1f-9de0-41d5-ad40-7b53ced603a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:25.492435 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b97d1f-9de0-41d5-ad40-7b53ced603a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:25.492737 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b97d1f-9de0-41d5-ad40-7b53ced603a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:25.493439 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b97d1f-9de0-41d5-ad40-7b53ced603a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:25.495100 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b97d1f-9de0-41d5-ad40-7b53ced603a8 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:25.507201 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1367/2731] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:25.510950 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c52d05-0968-4e2a-9310-a93041a6fa8f admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:25.520807 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c52d05-0968-4e2a-9310-a93041a6fa8f admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:25.527162 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398eee0-eef7-4a77-8fe4-83110dcafdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:25.528220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398eee0-eef7-4a77-8fe4-83110dcafdf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:25.528769 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398eee0-eef7-4a77-8fe4-83110dcafdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:25.531212 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398eee0-eef7-4a77-8fe4-83110dcafdf9 admin admin] PATH_INFO: `/v3/projects/7ddee9faf5e44e318ea389b8479d5fbe/users/1646fd54408d43d98d75e33963066ce7/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:25.543495 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:25.547486 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398eee0-eef7-4a77-8fe4-83110dcafdf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ddee9faf5e44e318ea389b8479d5fbe, user_id=1646fd54408d43d98d75e33963066ce7, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:25.550773 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398eee0-eef7-4a77-8fe4-83110dcafdf9 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:25.572474 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b97d1f-9de0-41d5-ad40-7b53ced603a8 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:25.574268 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-e5b97d1f-9de0-41d5-ad40-7b53ced603a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:25.588294 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b97d1f-9de0-41d5-ad40-7b53ced603a8 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:25.593350 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc95bf-dafb-4d4e-8166-4515236ec932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:25.595229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc95bf-dafb-4d4e-8166-4515236ec932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:25.595229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc95bf-dafb-4d4e-8166-4515236ec932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:25.595229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc95bf-dafb-4d4e-8166-4515236ec932 admin admin] PATH_INFO: `/v3/projects/81b0cbe2b5f74df88aaf153ef425573c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:25.596521 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc95bf-dafb-4d4e-8166-4515236ec932 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81b0cbe2b5f74df88aaf153ef425573c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:25.598225 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc95bf-dafb-4d4e-8166-4515236ec932 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:25.686590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1365/2732] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:25 2022] PUT /identity/v3/projects/7ddee9faf5e44e318ea389b8479d5fbe/users/1646fd54408d43d98d75e33963066ce7/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:25.697745 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762026e1-3351-4457-9b09-b0d9156b20ad None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:25.698232 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762026e1-3351-4457-9b09-b0d9156b20ad None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:25.698551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762026e1-3351-4457-9b09-b0d9156b20ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:25.723160 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:25.729237 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-90fc95bf-dafb-4d4e-8166-4515236ec932 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81b0cbe2b5f74df88aaf153ef425573c', 'request_id': 'req-90fc95bf-dafb-4d4e-8166-4515236ec932'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:25.730112 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-762026e1-3351-4457-9b09-b0d9156b20ad None None] MFA Rules not processed for user `1646fd54408d43d98d75e33963066ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:25.731473 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-762026e1-3351-4457-9b09-b0d9156b20ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:25.737991 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-90fc95bf-dafb-4d4e-8166-4515236ec932 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81b0cbe2b5f74df88aaf153ef425573c', 'request_id': 'req-90fc95bf-dafb-4d4e-8166-4515236ec932'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:25.746798 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-90fc95bf-dafb-4d4e-8166-4515236ec932 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81b0cbe2b5f74df88aaf153ef425573c', 'request_id': 'req-90fc95bf-dafb-4d4e-8166-4515236ec932'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:25.803738 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1366/2733] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:27:25.815542 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762026e1-3351-4457-9b09-b0d9156b20ad None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:25.817186 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-762026e1-3351-4457-9b09-b0d9156b20ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:25.855973 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-90fc95bf-dafb-4d4e-8166-4515236ec932 admin admin] The token cache is being invalidate because project 81b0cbe2b5f74df88aaf153ef425573c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:27:25.856272 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-90fc95bf-dafb-4d4e-8166-4515236ec932 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:25.856932 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-90fc95bf-dafb-4d4e-8166-4515236ec932 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:25.859018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1368/2734] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:27:25 2022] DELETE /identity/v3/projects/81b0cbe2b5f74df88aaf153ef425573c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:27:25.863447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc95bf-dafb-4d4e-8166-4515236ec932 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:25.865302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-90fc95bf-dafb-4d4e-8166-4515236ec932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:25.874820 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762026e1-3351-4457-9b09-b0d9156b20ad None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:25.878841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e390a-9fa6-4bb2-a05f-0b3171c0dc6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:25.879520 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e390a-9fa6-4bb2-a05f-0b3171c0dc6d service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:25.885479 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e390a-9fa6-4bb2-a05f-0b3171c0dc6d service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:25.885479 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e390a-9fa6-4bb2-a05f-0b3171c0dc6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:25.885479 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-8b0e390a-9fa6-4bb2-a05f-0b3171c0dc6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:25.893354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e390a-9fa6-4bb2-a05f-0b3171c0dc6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:25.894858 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e390a-9fa6-4bb2-a05f-0b3171c0dc6d service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:25.913196 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1367/2735] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:27:25.933210 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc95bf-dafb-4d4e-8166-4515236ec932 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:25.938885 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bb47c-4b0c-4810-a842-24ead46daad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:25.938885 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bb47c-4b0c-4810-a842-24ead46daad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:25.939143 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bb47c-4b0c-4810-a842-24ead46daad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:25.939345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bb47c-4b0c-4810-a842-24ead46daad7 admin admin] PATH_INFO: `/v3/users/d815a17224e84982b956c3a99c6db456` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:25.940455 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168bb47c-4b0c-4810-a842-24ead46daad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d815a17224e84982b956c3a99c6db456)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:25.942776 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168bb47c-4b0c-4810-a842-24ead46daad7 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:26.240945 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-168bb47c-4b0c-4810-a842-24ead46daad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd815a17224e84982b956c3a99c6db456'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:26.241614 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-168bb47c-4b0c-4810-a842-24ead46daad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd815a17224e84982b956c3a99c6db456'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:26.242271 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-168bb47c-4b0c-4810-a842-24ead46daad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd815a17224e84982b956c3a99c6db456'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:26.318547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-168bb47c-4b0c-4810-a842-24ead46daad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd815a17224e84982b956c3a99c6db456'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:26.331994 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-168bb47c-4b0c-4810-a842-24ead46daad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd815a17224e84982b956c3a99c6db456'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:26.343907 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1369/2736] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:27:25 2022] DELETE /identity/v3/users/d815a17224e84982b956c3a99c6db456 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:26.831242 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e390a-9fa6-4bb2-a05f-0b3171c0dc6d service cinder] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:26.844230 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e390a-9fa6-4bb2-a05f-0b3171c0dc6d service cinder] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:26.904347 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c5cbf-8749-49c7-aadc-655780377c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:26.904973 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c5cbf-8749-49c7-aadc-655780377c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:26.905251 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c5cbf-8749-49c7-aadc-655780377c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:26.905523 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c5cbf-8749-49c7-aadc-655780377c14 admin admin] PATH_INFO: `/v3/projects/e622b73fe4824f608ce814c4cf87b0be` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:26.906659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c5cbf-8749-49c7-aadc-655780377c14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e622b73fe4824f608ce814c4cf87b0be)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:26.908653 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c5cbf-8749-49c7-aadc-655780377c14 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:26.932808 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:27.050440 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ed8c5cbf-8749-49c7-aadc-655780377c14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e622b73fe4824f608ce814c4cf87b0be', 'request_id': 'req-ed8c5cbf-8749-49c7-aadc-655780377c14'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:27.056217 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ed8c5cbf-8749-49c7-aadc-655780377c14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e622b73fe4824f608ce814c4cf87b0be', 'request_id': 'req-ed8c5cbf-8749-49c7-aadc-655780377c14'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:27.067922 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ed8c5cbf-8749-49c7-aadc-655780377c14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e622b73fe4824f608ce814c4cf87b0be', 'request_id': 'req-ed8c5cbf-8749-49c7-aadc-655780377c14'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:27.175256 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ed8c5cbf-8749-49c7-aadc-655780377c14 admin admin] The token cache is being invalidate because project e622b73fe4824f608ce814c4cf87b0be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:27:27.175545 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ed8c5cbf-8749-49c7-aadc-655780377c14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:27.176245 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ed8c5cbf-8749-49c7-aadc-655780377c14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:27.177652 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1368/2737] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:27:26 2022] DELETE /identity/v3/projects/e622b73fe4824f608ce814c4cf87b0be => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:27.182567 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64a9c3-ff68-49d4-9321-c271220b0b4c None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:27.183013 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64a9c3-ff68-49d4-9321-c271220b0b4c None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:27.183131 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64a9c3-ff68-49d4-9321-c271220b0b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:27.204960 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-1e64a9c3-ff68-49d4-9321-c271220b0b4c None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:27.206184 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-1e64a9c3-ff68-49d4-9321-c271220b0b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:27.387565 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:27.403301 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1370/2738] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:27.411858 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff2d01-a534-47f5-83dc-f0334ac3d469 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:27.412151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff2d01-a534-47f5-83dc-f0334ac3d469 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:27.412432 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff2d01-a534-47f5-83dc-f0334ac3d469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:27.439753 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-99ff2d01-a534-47f5-83dc-f0334ac3d469 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:27.441363 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-99ff2d01-a534-47f5-83dc-f0334ac3d469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:27.449587 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1369/2739] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:27.453901 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64a9c3-ff68-49d4-9321-c271220b0b4c None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:27.466772 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64a9c3-ff68-49d4-9321-c271220b0b4c None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:27.472686 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea9d3e-325f-40b1-9cd2-3c7aaafdc909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:27.473283 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea9d3e-325f-40b1-9cd2-3c7aaafdc909 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:27.473559 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea9d3e-325f-40b1-9cd2-3c7aaafdc909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:27.473827 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea9d3e-325f-40b1-9cd2-3c7aaafdc909 admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:27.474568 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea9d3e-325f-40b1-9cd2-3c7aaafdc909 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:27:27.474866 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea9d3e-325f-40b1-9cd2-3c7aaafdc909 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:27.476475 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea9d3e-325f-40b1-9cd2-3c7aaafdc909 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:27.488928 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1371/2740] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:27:27.493437 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff2d01-a534-47f5-83dc-f0334ac3d469 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:27.503470 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff2d01-a534-47f5-83dc-f0334ac3d469 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:27.508776 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabd6e6-13b4-40b0-83ab-3cb994719c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:27.509354 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabd6e6-13b4-40b0-83ab-3cb994719c4a admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:27.509637 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabd6e6-13b4-40b0-83ab-3cb994719c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:27.509910 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabd6e6-13b4-40b0-83ab-3cb994719c4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:27.510564 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabd6e6-13b4-40b0-83ab-3cb994719c4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:27.512481 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabd6e6-13b4-40b0-83ab-3cb994719c4a admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:27.612984 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1370/2741] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:27:27 2022] POST /identity/v3/projects => generated 401 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:27:27.616718 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea9d3e-325f-40b1-9cd2-3c7aaafdc909 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:27.628791 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea9d3e-325f-40b1-9cd2-3c7aaafdc909 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:27.665097 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabd6e6-13b4-40b0-83ab-3cb994719c4a admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:27.668996 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-6cabd6e6-13b4-40b0-83ab-3cb994719c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:27.718438 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f24e65-98c6-4d9e-8e1e-053b6f5c245e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:27.718438 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f24e65-98c6-4d9e-8e1e-053b6f5c245e admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:27.718438 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f24e65-98c6-4d9e-8e1e-053b6f5c245e admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:27.718438 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f24e65-98c6-4d9e-8e1e-053b6f5c245e admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:27.719050 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f24e65-98c6-4d9e-8e1e-053b6f5c245e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:27.721972 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f24e65-98c6-4d9e-8e1e-053b6f5c245e admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:27.731204 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabd6e6-13b4-40b0-83ab-3cb994719c4a admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:27.740130 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05094286-f52e-4838-a36d-d62a54cd8ef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:27.740942 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05094286-f52e-4838-a36d-d62a54cd8ef9 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:27.741233 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05094286-f52e-4838-a36d-d62a54cd8ef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:27.741515 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05094286-f52e-4838-a36d-d62a54cd8ef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:27.743784 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-05094286-f52e-4838-a36d-d62a54cd8ef9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:27.757658 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05094286-f52e-4838-a36d-d62a54cd8ef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:27.759198 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05094286-f52e-4838-a36d-d62a54cd8ef9 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:27.769817 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1371/2742] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:27:27.825734 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1372/2743] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:27:27 2022] POST /identity/v3/users => generated 301 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:27:27.826662 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05094286-f52e-4838-a36d-d62a54cd8ef9 service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:27.837415 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05094286-f52e-4838-a36d-d62a54cd8ef9 service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:27.842216 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fd0dc-5665-42d4-907e-3db693cfda90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:27.842849 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fd0dc-5665-42d4-907e-3db693cfda90 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:27.843126 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fd0dc-5665-42d4-907e-3db693cfda90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:27.843400 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fd0dc-5665-42d4-907e-3db693cfda90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:27.844071 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fd0dc-5665-42d4-907e-3db693cfda90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:27.846448 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fd0dc-5665-42d4-907e-3db693cfda90 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:27.856582 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1372/2744] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:27.861111 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f24e65-98c6-4d9e-8e1e-053b6f5c245e admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:27.874003 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f24e65-98c6-4d9e-8e1e-053b6f5c245e admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:27.879389 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396d2cd-2677-4ce7-936b-ac5ece442e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:27.879992 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396d2cd-2677-4ce7-936b-ac5ece442e29 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:27.881463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396d2cd-2677-4ce7-936b-ac5ece442e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:27.881463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396d2cd-2677-4ce7-936b-ac5ece442e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:27.881463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b396d2cd-2677-4ce7-936b-ac5ece442e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:27.882783 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b396d2cd-2677-4ce7-936b-ac5ece442e29 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:27.894114 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1373/2745] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:27.898386 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fd0dc-5665-42d4-907e-3db693cfda90 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:27.910739 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fd0dc-5665-42d4-907e-3db693cfda90 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:27.921183 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0384d-6dcc-4888-a0a1-9ed0b4c40c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:27.921871 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0384d-6dcc-4888-a0a1-9ed0b4c40c38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:27.922156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0384d-6dcc-4888-a0a1-9ed0b4c40c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:27.922516 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0384d-6dcc-4888-a0a1-9ed0b4c40c38 admin admin] PATH_INFO: `/v3/projects/63d17b4162cd4c54ae2ca65b43648e3c/users/196ca2516a8b4be78529898edf2b12c3/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:27.942036 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0384d-6dcc-4888-a0a1-9ed0b4c40c38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63d17b4162cd4c54ae2ca65b43648e3c, user_id=196ca2516a8b4be78529898edf2b12c3, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:27.948116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0384d-6dcc-4888-a0a1-9ed0b4c40c38 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:28.038678 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1373/2746] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:27 2022] PUT /identity/v3/projects/63d17b4162cd4c54ae2ca65b43648e3c/users/196ca2516a8b4be78529898edf2b12c3/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:28.051059 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e136a-af7a-431b-8353-7f9a40b26b63 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:28.051353 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e136a-af7a-431b-8353-7f9a40b26b63 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:28.051638 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e136a-af7a-431b-8353-7f9a40b26b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:28.083421 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-021e136a-af7a-431b-8353-7f9a40b26b63 None None] MFA Rules not processed for user `196ca2516a8b4be78529898edf2b12c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:28.084603 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-021e136a-af7a-431b-8353-7f9a40b26b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:28.169968 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1374/2747] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:28 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:28.175378 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0384d-6dcc-4888-a0a1-9ed0b4c40c38 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:28.235472 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:28.254425 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0384d-6dcc-4888-a0a1-9ed0b4c40c38 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:28.261110 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9702f-3a55-43ec-8a2e-11c744c108be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:28.261747 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9702f-3a55-43ec-8a2e-11c744c108be admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:28.262172 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9702f-3a55-43ec-8a2e-11c744c108be admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:28.262385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9702f-3a55-43ec-8a2e-11c744c108be admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:28.263022 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9702f-3a55-43ec-8a2e-11c744c108be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:28.265442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9702f-3a55-43ec-8a2e-11c744c108be admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:28.435915 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1374/2748] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:27:28 2022] POST /identity/v3/projects => generated 399 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:27:28.441902 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e136a-af7a-431b-8353-7f9a40b26b63 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:28.453298 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e136a-af7a-431b-8353-7f9a40b26b63 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:28.501391 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:28.514702 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc71e6-54a2-43ab-a176-0889dcbe73f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:28.516110 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc71e6-54a2-43ab-a176-0889dcbe73f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:28.516263 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc71e6-54a2-43ab-a176-0889dcbe73f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:28.516524 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc71e6-54a2-43ab-a176-0889dcbe73f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:28.517147 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc71e6-54a2-43ab-a176-0889dcbe73f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:28.519258 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc71e6-54a2-43ab-a176-0889dcbe73f1 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:28.641431 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1375/2749] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:27:28 2022] POST /identity/v3/users => generated 306 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:27:28.645912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9702f-3a55-43ec-8a2e-11c744c108be admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:28.656487 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9702f-3a55-43ec-8a2e-11c744c108be admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:28.661981 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec828ab6-3dac-491a-a71f-9af4e07d1efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:28.662796 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec828ab6-3dac-491a-a71f-9af4e07d1efe admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:28.663157 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec828ab6-3dac-491a-a71f-9af4e07d1efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:28.663520 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec828ab6-3dac-491a-a71f-9af4e07d1efe admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:28.664228 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec828ab6-3dac-491a-a71f-9af4e07d1efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:28.666079 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec828ab6-3dac-491a-a71f-9af4e07d1efe admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:28.677334 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1375/2750] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:28.681570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc71e6-54a2-43ab-a176-0889dcbe73f1 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:28.692514 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc71e6-54a2-43ab-a176-0889dcbe73f1 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:28.697362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2b6f8-836e-46b3-a807-b327e4e4be20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:28.698035 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2b6f8-836e-46b3-a807-b327e4e4be20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:28.698349 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2b6f8-836e-46b3-a807-b327e4e4be20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:28.698630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2b6f8-836e-46b3-a807-b327e4e4be20 admin admin] PATH_INFO: `/v3/projects/2c34fb3b58f54466a1606d75a28fbeee/users/1586dd5b390642f18a0c80be8b383b47/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:28.713678 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2b6f8-836e-46b3-a807-b327e4e4be20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c34fb3b58f54466a1606d75a28fbeee, user_id=1586dd5b390642f18a0c80be8b383b47, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:28.716399 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2b6f8-836e-46b3-a807-b327e4e4be20 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:28.806402 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1376/2751] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:28 2022] PUT /identity/v3/projects/2c34fb3b58f54466a1606d75a28fbeee/users/1586dd5b390642f18a0c80be8b383b47/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:28.810320 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec828ab6-3dac-491a-a71f-9af4e07d1efe admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:28.821490 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec828ab6-3dac-491a-a71f-9af4e07d1efe admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:28.888590 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303f8d6-57f9-4004-a3b8-5950e1abab6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:28.889288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303f8d6-57f9-4004-a3b8-5950e1abab6d admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:28.889475 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303f8d6-57f9-4004-a3b8-5950e1abab6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:28.889748 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303f8d6-57f9-4004-a3b8-5950e1abab6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:28.890432 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303f8d6-57f9-4004-a3b8-5950e1abab6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:28.892125 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303f8d6-57f9-4004-a3b8-5950e1abab6d admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:28.903466 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1376/2752] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:27:28.907634 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2b6f8-836e-46b3-a807-b327e4e4be20 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:28.920385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2b6f8-836e-46b3-a807-b327e4e4be20 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:28.926491 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e200918-bbd4-430c-8e7d-b803762e352a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:28.933900 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e200918-bbd4-430c-8e7d-b803762e352a admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:28.933900 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e200918-bbd4-430c-8e7d-b803762e352a admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:28.933900 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e200918-bbd4-430c-8e7d-b803762e352a admin admin] PATH_INFO: `/v3/projects/2c34fb3b58f54466a1606d75a28fbeee/users/1586dd5b390642f18a0c80be8b383b47/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:28.933900 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e200918-bbd4-430c-8e7d-b803762e352a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c34fb3b58f54466a1606d75a28fbeee, user_id=1586dd5b390642f18a0c80be8b383b47, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:28.933900 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e200918-bbd4-430c-8e7d-b803762e352a admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:28.951290 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1377/2753] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:28 2022] PUT /identity/v3/projects/2c34fb3b58f54466a1606d75a28fbeee/users/1586dd5b390642f18a0c80be8b383b47/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:28.961789 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a95f8-38f5-4a21-a4fa-02aeeba467b5 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:28.968220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a95f8-38f5-4a21-a4fa-02aeeba467b5 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:28.968220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a95f8-38f5-4a21-a4fa-02aeeba467b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:28.997051 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-8b8a95f8-38f5-4a21-a4fa-02aeeba467b5 None None] MFA Rules not processed for user `1586dd5b390642f18a0c80be8b383b47`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:28.997768 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-8b8a95f8-38f5-4a21-a4fa-02aeeba467b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:29.071510 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1377/2754] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:28 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:29.082138 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e200918-bbd4-430c-8e7d-b803762e352a admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:29.083831 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-9e200918-bbd4-430c-8e7d-b803762e352a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:29.148539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e200918-bbd4-430c-8e7d-b803762e352a admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:29.152131 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ef172-f0fe-4e5b-bfe7-24a70d08e881 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:29.152739 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ef172-f0fe-4e5b-bfe7-24a70d08e881 service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:29.153018 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ef172-f0fe-4e5b-bfe7-24a70d08e881 service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:29.153290 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ef172-f0fe-4e5b-bfe7-24a70d08e881 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:29.163565 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ef172-f0fe-4e5b-bfe7-24a70d08e881 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:29.165049 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ef172-f0fe-4e5b-bfe7-24a70d08e881 service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:29.178791 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1378/2755] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:29 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:27:29.420129 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a95f8-38f5-4a21-a4fa-02aeeba467b5 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:29.423704 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-8b8a95f8-38f5-4a21-a4fa-02aeeba467b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:29.436073 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a95f8-38f5-4a21-a4fa-02aeeba467b5 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:29.440174 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe904b-bf2e-433c-ab4c-03ce86424f0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:29.441019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe904b-bf2e-433c-ab4c-03ce86424f0a service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:29.441823 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe904b-bf2e-433c-ab4c-03ce86424f0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:29.442112 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe904b-bf2e-433c-ab4c-03ce86424f0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:29.499702 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:29.525275 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe904b-bf2e-433c-ab4c-03ce86424f0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:29.526912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe904b-bf2e-433c-ab4c-03ce86424f0a service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:29.537313 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1378/2756] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:29 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:27:35.902479 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ef172-f0fe-4e5b-bfe7-24a70d08e881 service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:35.904038 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-8e9ef172-f0fe-4e5b-bfe7-24a70d08e881 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:35.977958 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ef172-f0fe-4e5b-bfe7-24a70d08e881 service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:35.982571 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccac006-2661-48f2-bee9-bce2516e4028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:35.983194 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccac006-2661-48f2-bee9-bce2516e4028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:35.983468 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccac006-2661-48f2-bee9-bce2516e4028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:35.983735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccac006-2661-48f2-bee9-bce2516e4028 admin admin] PATH_INFO: `/v3/users/ff5b35df95de4ffcbb2e9a17e8b7844a` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:35.984850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccac006-2661-48f2-bee9-bce2516e4028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff5b35df95de4ffcbb2e9a17e8b7844a)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:35.986922 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccac006-2661-48f2-bee9-bce2516e4028 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:36.117151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe904b-bf2e-433c-ab4c-03ce86424f0a service cinder] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:36.129843 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe904b-bf2e-433c-ab4c-03ce86424f0a service cinder] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:36.134556 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e4c38-1104-423b-b698-e4845bed86c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:36.135311 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e4c38-1104-423b-b698-e4845bed86c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:36.135664 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e4c38-1104-423b-b698-e4845bed86c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:36.135937 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e4c38-1104-423b-b698-e4845bed86c4 admin admin] PATH_INFO: `/v3/users/196ca2516a8b4be78529898edf2b12c3` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:36.137042 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e4c38-1104-423b-b698-e4845bed86c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=196ca2516a8b4be78529898edf2b12c3)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:36.138996 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e4c38-1104-423b-b698-e4845bed86c4 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:36.252659 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:36.255277 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9ccac006-2661-48f2-bee9-bce2516e4028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff5b35df95de4ffcbb2e9a17e8b7844a'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:36.255916 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9ccac006-2661-48f2-bee9-bce2516e4028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff5b35df95de4ffcbb2e9a17e8b7844a'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:36.256508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9ccac006-2661-48f2-bee9-bce2516e4028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff5b35df95de4ffcbb2e9a17e8b7844a'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:36.326897 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-2d7e4c38-1104-423b-b698-e4845bed86c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '196ca2516a8b4be78529898edf2b12c3'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:36.327558 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-2d7e4c38-1104-423b-b698-e4845bed86c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '196ca2516a8b4be78529898edf2b12c3'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:36.328164 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-2d7e4c38-1104-423b-b698-e4845bed86c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '196ca2516a8b4be78529898edf2b12c3'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:36.341362 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9ccac006-2661-48f2-bee9-bce2516e4028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff5b35df95de4ffcbb2e9a17e8b7844a'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:36.354502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9ccac006-2661-48f2-bee9-bce2516e4028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff5b35df95de4ffcbb2e9a17e8b7844a'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:36.366554 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1379/2757] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:27:35 2022] DELETE /identity/v3/users/ff5b35df95de4ffcbb2e9a17e8b7844a => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:36.449311 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-2d7e4c38-1104-423b-b698-e4845bed86c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '196ca2516a8b4be78529898edf2b12c3'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:36.457529 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-2d7e4c38-1104-423b-b698-e4845bed86c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '196ca2516a8b4be78529898edf2b12c3'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:36.479881 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1379/2758] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:27:36 2022] DELETE /identity/v3/users/196ca2516a8b4be78529898edf2b12c3 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:27:36.484943 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd66e3-18cd-4f7c-b615-a44011956075 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:36.485240 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd66e3-18cd-4f7c-b615-a44011956075 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:36.485520 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd66e3-18cd-4f7c-b615-a44011956075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:36.508618 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-febd66e3-18cd-4f7c-b615-a44011956075 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:36.509727 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-febd66e3-18cd-4f7c-b615-a44011956075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:36.572404 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1380/2759] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:27:36.582868 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e4c38-1104-423b-b698-e4845bed86c4 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:36.584535 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-2d7e4c38-1104-423b-b698-e4845bed86c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:36.660752 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e4c38-1104-423b-b698-e4845bed86c4 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:36.665411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdb520-79cd-430a-a6e5-39297cc84d49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:36.666723 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd66e3-18cd-4f7c-b615-a44011956075 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:36.666935 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdb520-79cd-430a-a6e5-39297cc84d49 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:36.667393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdb520-79cd-430a-a6e5-39297cc84d49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:36.667912 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdb520-79cd-430a-a6e5-39297cc84d49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:36.668353 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-febd66e3-18cd-4f7c-b615-a44011956075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:36.680966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcdb520-79cd-430a-a6e5-39297cc84d49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:36.683164 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcdb520-79cd-430a-a6e5-39297cc84d49 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:36.684374 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd66e3-18cd-4f7c-b615-a44011956075 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:36.697283 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f47c5a-460b-474d-8ea5-141fbd081dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:36.697731 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1380/2760] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:27:36.697927 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f47c5a-460b-474d-8ea5-141fbd081dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:36.698206 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f47c5a-460b-474d-8ea5-141fbd081dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:36.698509 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f47c5a-460b-474d-8ea5-141fbd081dc2 admin admin] PATH_INFO: `/v3/projects/1d5c6ac98d7848cd9ad36530e88ed716` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:36.699644 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f47c5a-460b-474d-8ea5-141fbd081dc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d5c6ac98d7848cd9ad36530e88ed716)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:36.701571 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f47c5a-460b-474d-8ea5-141fbd081dc2 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:36.849251 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-c9f47c5a-460b-474d-8ea5-141fbd081dc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d5c6ac98d7848cd9ad36530e88ed716', 'request_id': 'req-c9f47c5a-460b-474d-8ea5-141fbd081dc2'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:36.854744 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-c9f47c5a-460b-474d-8ea5-141fbd081dc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d5c6ac98d7848cd9ad36530e88ed716', 'request_id': 'req-c9f47c5a-460b-474d-8ea5-141fbd081dc2'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:36.860988 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-c9f47c5a-460b-474d-8ea5-141fbd081dc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d5c6ac98d7848cd9ad36530e88ed716', 'request_id': 'req-c9f47c5a-460b-474d-8ea5-141fbd081dc2'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:36.994044 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-c9f47c5a-460b-474d-8ea5-141fbd081dc2 admin admin] The token cache is being invalidate because project 1d5c6ac98d7848cd9ad36530e88ed716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:27:36.994627 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-c9f47c5a-460b-474d-8ea5-141fbd081dc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:36.995142 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-c9f47c5a-460b-474d-8ea5-141fbd081dc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:36.997277 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1381/2761] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:27:36 2022] DELETE /identity/v3/projects/1d5c6ac98d7848cd9ad36530e88ed716 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:27:37.001107 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdb520-79cd-430a-a6e5-39297cc84d49 service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:37.012660 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdb520-79cd-430a-a6e5-39297cc84d49 service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:37.069704 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ece069-9013-4744-a22b-c958d31bc7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:37.070359 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ece069-9013-4744-a22b-c958d31bc7ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:37.070644 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ece069-9013-4744-a22b-c958d31bc7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:37.070919 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ece069-9013-4744-a22b-c958d31bc7ba admin admin] PATH_INFO: `/v3/users/7c2d7329818445b981f620706ca4a7f6` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:37.072068 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ece069-9013-4744-a22b-c958d31bc7ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c2d7329818445b981f620706ca4a7f6)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:37.073979 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ece069-9013-4744-a22b-c958d31bc7ba admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:37.075579 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:37.143164 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f47c5a-460b-474d-8ea5-141fbd081dc2 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:37.144908 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-c9f47c5a-460b-474d-8ea5-141fbd081dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:37.159791 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f47c5a-460b-474d-8ea5-141fbd081dc2 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:37.164515 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1eb936-08a2-4a2d-91e2-2e922958e48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:37.165142 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eb936-08a2-4a2d-91e2-2e922958e48a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:37.165477 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eb936-08a2-4a2d-91e2-2e922958e48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:37.165747 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1eb936-08a2-4a2d-91e2-2e922958e48a admin admin] PATH_INFO: `/v3/projects/63d17b4162cd4c54ae2ca65b43648e3c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:37.166839 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1eb936-08a2-4a2d-91e2-2e922958e48a admin admin] RBAC: Authorizing `identity:delete_project(project_id=63d17b4162cd4c54ae2ca65b43648e3c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:37.168763 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1eb936-08a2-4a2d-91e2-2e922958e48a admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:37.271754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-97ece069-9013-4744-a22b-c958d31bc7ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c2d7329818445b981f620706ca4a7f6'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:37.272450 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-97ece069-9013-4744-a22b-c958d31bc7ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c2d7329818445b981f620706ca4a7f6'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:37.273083 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-97ece069-9013-4744-a22b-c958d31bc7ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c2d7329818445b981f620706ca4a7f6'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:37.324695 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:37.331417 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0e1eb936-08a2-4a2d-91e2-2e922958e48a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63d17b4162cd4c54ae2ca65b43648e3c', 'request_id': 'req-0e1eb936-08a2-4a2d-91e2-2e922958e48a'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:37.336733 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0e1eb936-08a2-4a2d-91e2-2e922958e48a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63d17b4162cd4c54ae2ca65b43648e3c', 'request_id': 'req-0e1eb936-08a2-4a2d-91e2-2e922958e48a'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:37.343247 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0e1eb936-08a2-4a2d-91e2-2e922958e48a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63d17b4162cd4c54ae2ca65b43648e3c', 'request_id': 'req-0e1eb936-08a2-4a2d-91e2-2e922958e48a'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:37.348114 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-97ece069-9013-4744-a22b-c958d31bc7ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c2d7329818445b981f620706ca4a7f6'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:37.355461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-97ece069-9013-4744-a22b-c958d31bc7ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c2d7329818445b981f620706ca4a7f6'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:37.373272 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1381/2762] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:27:37 2022] DELETE /identity/v3/users/7c2d7329818445b981f620706ca4a7f6 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:37.438878 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0e1eb936-08a2-4a2d-91e2-2e922958e48a admin admin] The token cache is being invalidate because project 63d17b4162cd4c54ae2ca65b43648e3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:27:37.439200 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0e1eb936-08a2-4a2d-91e2-2e922958e48a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:37.440390 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-0e1eb936-08a2-4a2d-91e2-2e922958e48a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:37.444693 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1382/2763] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:27:37 2022] DELETE /identity/v3/projects/63d17b4162cd4c54ae2ca65b43648e3c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:27:37.447434 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ece069-9013-4744-a22b-c958d31bc7ba admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:37.448898 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-97ece069-9013-4744-a22b-c958d31bc7ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:37.516540 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ece069-9013-4744-a22b-c958d31bc7ba admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:37.521792 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb6c72-f70f-46e1-a29d-cdf9641bca9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:37.522453 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb6c72-f70f-46e1-a29d-cdf9641bca9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:37.522730 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb6c72-f70f-46e1-a29d-cdf9641bca9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:37.523169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb6c72-f70f-46e1-a29d-cdf9641bca9c admin admin] PATH_INFO: `/v3/users/1586dd5b390642f18a0c80be8b383b47` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:37.524256 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb6c72-f70f-46e1-a29d-cdf9641bca9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1586dd5b390642f18a0c80be8b383b47)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:37.526174 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb6c72-f70f-46e1-a29d-cdf9641bca9c admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:37.652237 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1eb936-08a2-4a2d-91e2-2e922958e48a admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:37.653766 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-0e1eb936-08a2-4a2d-91e2-2e922958e48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:37.720481 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1eb936-08a2-4a2d-91e2-2e922958e48a admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:37.725714 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba5e9d-6a49-423a-b21e-6d91cbc07085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:37.726383 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba5e9d-6a49-423a-b21e-6d91cbc07085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:37.726650 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba5e9d-6a49-423a-b21e-6d91cbc07085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:37.726924 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba5e9d-6a49-423a-b21e-6d91cbc07085 admin admin] PATH_INFO: `/v3/projects/b874dfccdd68402cad95d303a9ccf7cd` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:37.728024 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba5e9d-6a49-423a-b21e-6d91cbc07085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b874dfccdd68402cad95d303a9ccf7cd)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:37.729955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba5e9d-6a49-423a-b21e-6d91cbc07085 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:37.794169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-a2cb6c72-f70f-46e1-a29d-cdf9641bca9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1586dd5b390642f18a0c80be8b383b47'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:37.794860 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-a2cb6c72-f70f-46e1-a29d-cdf9641bca9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1586dd5b390642f18a0c80be8b383b47'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:37.795469 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-a2cb6c72-f70f-46e1-a29d-cdf9641bca9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1586dd5b390642f18a0c80be8b383b47'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:37.907067 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-a2cb6c72-f70f-46e1-a29d-cdf9641bca9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1586dd5b390642f18a0c80be8b383b47'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:37.914270 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9fba5e9d-6a49-423a-b21e-6d91cbc07085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b874dfccdd68402cad95d303a9ccf7cd', 'request_id': 'req-9fba5e9d-6a49-423a-b21e-6d91cbc07085'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:37.915085 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-a2cb6c72-f70f-46e1-a29d-cdf9641bca9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1586dd5b390642f18a0c80be8b383b47'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:37.919933 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9fba5e9d-6a49-423a-b21e-6d91cbc07085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b874dfccdd68402cad95d303a9ccf7cd', 'request_id': 'req-9fba5e9d-6a49-423a-b21e-6d91cbc07085'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:37.926699 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9fba5e9d-6a49-423a-b21e-6d91cbc07085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b874dfccdd68402cad95d303a9ccf7cd', 'request_id': 'req-9fba5e9d-6a49-423a-b21e-6d91cbc07085'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:37.932839 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1382/2764] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:27:37 2022] DELETE /identity/v3/users/1586dd5b390642f18a0c80be8b383b47 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:38.077720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9fba5e9d-6a49-423a-b21e-6d91cbc07085 admin admin] The token cache is being invalidate because project b874dfccdd68402cad95d303a9ccf7cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:27:38.078332 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9fba5e9d-6a49-423a-b21e-6d91cbc07085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:38.078640 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-9fba5e9d-6a49-423a-b21e-6d91cbc07085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:38.080246 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1383/2765] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:27:37 2022] DELETE /identity/v3/projects/b874dfccdd68402cad95d303a9ccf7cd => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:27:38.268423 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:38.446427 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb6c72-f70f-46e1-a29d-cdf9641bca9c admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:38.448075 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-a2cb6c72-f70f-46e1-a29d-cdf9641bca9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:38.515364 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb6c72-f70f-46e1-a29d-cdf9641bca9c admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:38.520730 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72644748-b4b5-418c-af3d-83fbc9a3e67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:38.521349 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72644748-b4b5-418c-af3d-83fbc9a3e67f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:38.521635 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72644748-b4b5-418c-af3d-83fbc9a3e67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:38.521916 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72644748-b4b5-418c-af3d-83fbc9a3e67f admin admin] PATH_INFO: `/v3/projects/2c34fb3b58f54466a1606d75a28fbeee` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:38.523192 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72644748-b4b5-418c-af3d-83fbc9a3e67f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c34fb3b58f54466a1606d75a28fbeee)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:38.525168 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72644748-b4b5-418c-af3d-83fbc9a3e67f admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:38.668038 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-72644748-b4b5-418c-af3d-83fbc9a3e67f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c34fb3b58f54466a1606d75a28fbeee', 'request_id': 'req-72644748-b4b5-418c-af3d-83fbc9a3e67f'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:38.673725 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-72644748-b4b5-418c-af3d-83fbc9a3e67f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c34fb3b58f54466a1606d75a28fbeee', 'request_id': 'req-72644748-b4b5-418c-af3d-83fbc9a3e67f'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:38.680095 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-72644748-b4b5-418c-af3d-83fbc9a3e67f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c34fb3b58f54466a1606d75a28fbeee', 'request_id': 'req-72644748-b4b5-418c-af3d-83fbc9a3e67f'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:38.742245 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-72644748-b4b5-418c-af3d-83fbc9a3e67f admin admin] The token cache is being invalidate because project 2c34fb3b58f54466a1606d75a28fbeee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:27:38.742574 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-72644748-b4b5-418c-af3d-83fbc9a3e67f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:38.743254 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-72644748-b4b5-418c-af3d-83fbc9a3e67f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:38.744776 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1383/2766] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:27:38 2022] DELETE /identity/v3/projects/2c34fb3b58f54466a1606d75a28fbeee => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:38.758552 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c803f32-75f3-4b06-9c64-c7a9baf4d32b None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:38.758747 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c803f32-75f3-4b06-9c64-c7a9baf4d32b None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:38.759029 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c803f32-75f3-4b06-9c64-c7a9baf4d32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:38.778826 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-5c803f32-75f3-4b06-9c64-c7a9baf4d32b None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:38.780628 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-5c803f32-75f3-4b06-9c64-c7a9baf4d32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:38.832061 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:38.841622 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1384/2767] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:38.850673 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9012f-2e69-4999-9349-dee1deeecb43 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:38.851035 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9012f-2e69-4999-9349-dee1deeecb43 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:38.851378 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9012f-2e69-4999-9349-dee1deeecb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:38.872393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-ffc9012f-2e69-4999-9349-dee1deeecb43 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:38.873603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-ffc9012f-2e69-4999-9349-dee1deeecb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:38.882308 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1384/2768] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:38.886534 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c803f32-75f3-4b06-9c64-c7a9baf4d32b None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:38.896736 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c803f32-75f3-4b06-9c64-c7a9baf4d32b None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:38.901319 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d8cb4-c827-45ad-b2ad-ced187947053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:38.901950 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d8cb4-c827-45ad-b2ad-ced187947053 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:38.902233 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d8cb4-c827-45ad-b2ad-ced187947053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:38.902539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d8cb4-c827-45ad-b2ad-ced187947053 admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:38.903171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d8cb4-c827-45ad-b2ad-ced187947053 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:27:38.903469 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d8cb4-c827-45ad-b2ad-ced187947053 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:38.905057 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d8cb4-c827-45ad-b2ad-ced187947053 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:38.916972 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1385/2769] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:27:38.921541 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9012f-2e69-4999-9349-dee1deeecb43 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:38.931389 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9012f-2e69-4999-9349-dee1deeecb43 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:38.936097 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23904441-f34b-40a3-9d4d-31429f05e691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:38.936683 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23904441-f34b-40a3-9d4d-31429f05e691 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:38.937010 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23904441-f34b-40a3-9d4d-31429f05e691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:38.937281 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23904441-f34b-40a3-9d4d-31429f05e691 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:38.937896 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23904441-f34b-40a3-9d4d-31429f05e691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:38.939873 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23904441-f34b-40a3-9d4d-31429f05e691 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:39.074458 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1385/2770] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:27:38 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:27:39.078823 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d8cb4-c827-45ad-b2ad-ced187947053 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:39.089896 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d8cb4-c827-45ad-b2ad-ced187947053 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:39.147669 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1abd6-39ee-4be3-9385-48cdc5aafe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:39.148266 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1abd6-39ee-4be3-9385-48cdc5aafe2a admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:39.148547 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1abd6-39ee-4be3-9385-48cdc5aafe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:39.148817 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1abd6-39ee-4be3-9385-48cdc5aafe2a admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:39.149424 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1abd6-39ee-4be3-9385-48cdc5aafe2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:39.151377 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1abd6-39ee-4be3-9385-48cdc5aafe2a admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:39.261838 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1386/2771] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:27:39 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:27:39.266004 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23904441-f34b-40a3-9d4d-31429f05e691 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:39.277182 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23904441-f34b-40a3-9d4d-31429f05e691 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:39.281754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5647f-3201-433f-92f4-dddda1d77288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:39.282375 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5647f-3201-433f-92f4-dddda1d77288 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:39.282660 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5647f-3201-433f-92f4-dddda1d77288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:39.282940 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5647f-3201-433f-92f4-dddda1d77288 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:39.284158 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5647f-3201-433f-92f4-dddda1d77288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:39.285758 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5647f-3201-433f-92f4-dddda1d77288 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:39.295533 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1386/2772] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:39.299864 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1abd6-39ee-4be3-9385-48cdc5aafe2a admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:39.309730 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1abd6-39ee-4be3-9385-48cdc5aafe2a admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:39.314884 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e3c23-58b4-4cd6-9c8b-be1f25d83c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:39.315522 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e3c23-58b4-4cd6-9c8b-be1f25d83c6c admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:39.315801 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e3c23-58b4-4cd6-9c8b-be1f25d83c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:39.316074 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e3c23-58b4-4cd6-9c8b-be1f25d83c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:39.316709 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e3c23-58b4-4cd6-9c8b-be1f25d83c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:39.318575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e3c23-58b4-4cd6-9c8b-be1f25d83c6c admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:39.328957 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1387/2773] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:39.333532 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5647f-3201-433f-92f4-dddda1d77288 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:39.343568 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5647f-3201-433f-92f4-dddda1d77288 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:39.348393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc26e9-7593-4555-8ba5-b447bb2ddd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:39.349048 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc26e9-7593-4555-8ba5-b447bb2ddd87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:39.351891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc26e9-7593-4555-8ba5-b447bb2ddd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:39.351891 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc26e9-7593-4555-8ba5-b447bb2ddd87 admin admin] PATH_INFO: `/v3/projects/2e3d1230dea64876b0c0ecc1ab44410b/users/d7cfb25ea3464fe1be53dbeacbbba931/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:39.364129 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc26e9-7593-4555-8ba5-b447bb2ddd87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e3d1230dea64876b0c0ecc1ab44410b, user_id=d7cfb25ea3464fe1be53dbeacbbba931, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:39.366865 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc26e9-7593-4555-8ba5-b447bb2ddd87 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:39.452246 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1387/2774] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:39 2022] PUT /identity/v3/projects/2e3d1230dea64876b0c0ecc1ab44410b/users/d7cfb25ea3464fe1be53dbeacbbba931/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:39.453960 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28035183-3d88-4fc3-96b5-553b3939b870 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:39.454271 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28035183-3d88-4fc3-96b5-553b3939b870 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:39.456946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28035183-3d88-4fc3-96b5-553b3939b870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:39.475311 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-28035183-3d88-4fc3-96b5-553b3939b870 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:39.476615 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-28035183-3d88-4fc3-96b5-553b3939b870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:39.544480 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1388/2775] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:39.554259 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc26e9-7593-4555-8ba5-b447bb2ddd87 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:39.558679 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-9edc26e9-7593-4555-8ba5-b447bb2ddd87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:39.584305 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:39.612556 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc26e9-7593-4555-8ba5-b447bb2ddd87 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:39.616552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68267f-15c1-4b5b-855a-a22066d491d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:39.617161 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68267f-15c1-4b5b-855a-a22066d491d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:39.617442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68267f-15c1-4b5b-855a-a22066d491d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:39.617734 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68267f-15c1-4b5b-855a-a22066d491d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:39.627704 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68267f-15c1-4b5b-855a-a22066d491d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:39.629255 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68267f-15c1-4b5b-855a-a22066d491d4 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:39.639395 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1388/2776] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:27:41.667846 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3442f5d-ca1e-47aa-b826-91ef15948e0c None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:41.668426 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3442f5d-ca1e-47aa-b826-91ef15948e0c None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:41.668590 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3442f5d-ca1e-47aa-b826-91ef15948e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:41.696853 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-e3442f5d-ca1e-47aa-b826-91ef15948e0c None None] MFA Rules not processed for user `d7cfb25ea3464fe1be53dbeacbbba931`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:41.698137 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-e3442f5d-ca1e-47aa-b826-91ef15948e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:41.761819 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:41.763738 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1389/2777] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:41.768256 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68267f-15c1-4b5b-855a-a22066d491d4 service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:41.778665 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68267f-15c1-4b5b-855a-a22066d491d4 service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:41.783246 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae4a61-5586-4a26-9b22-f3b6900334d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:41.783842 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae4a61-5586-4a26-9b22-f3b6900334d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:41.784125 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae4a61-5586-4a26-9b22-f3b6900334d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:41.784700 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae4a61-5586-4a26-9b22-f3b6900334d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:41.785001 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae4a61-5586-4a26-9b22-f3b6900334d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:41.786937 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae4a61-5586-4a26-9b22-f3b6900334d9 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:41.916667 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1389/2778] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:27:41 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:27:41.922309 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3442f5d-ca1e-47aa-b826-91ef15948e0c None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:41.932358 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3442f5d-ca1e-47aa-b826-91ef15948e0c None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:41.988843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc12f9-e301-4b2c-82b7-e75ef23816e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:41.989455 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc12f9-e301-4b2c-82b7-e75ef23816e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:41.989735 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc12f9-e301-4b2c-82b7-e75ef23816e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:41.990039 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc12f9-e301-4b2c-82b7-e75ef23816e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:41.990715 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc12f9-e301-4b2c-82b7-e75ef23816e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:41.992674 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc12f9-e301-4b2c-82b7-e75ef23816e9 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:42.090319 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1390/2779] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:27:41 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:27:42.094308 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae4a61-5586-4a26-9b22-f3b6900334d9 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:42.104921 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae4a61-5586-4a26-9b22-f3b6900334d9 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:42.109506 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f538aa-3be7-4682-8a99-8dcceccd38fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:42.110098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f538aa-3be7-4682-8a99-8dcceccd38fb admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:42.110420 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f538aa-3be7-4682-8a99-8dcceccd38fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:42.110696 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f538aa-3be7-4682-8a99-8dcceccd38fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:42.111352 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f538aa-3be7-4682-8a99-8dcceccd38fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:42.113578 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f538aa-3be7-4682-8a99-8dcceccd38fb admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:42.125193 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1390/2780] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:42.130137 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc12f9-e301-4b2c-82b7-e75ef23816e9 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:42.141072 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc12f9-e301-4b2c-82b7-e75ef23816e9 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:42.146469 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439030c-ab33-4050-b0fe-fc9f4061abb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:42.147133 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439030c-ab33-4050-b0fe-fc9f4061abb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:42.147414 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439030c-ab33-4050-b0fe-fc9f4061abb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:42.147689 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439030c-ab33-4050-b0fe-fc9f4061abb7 admin admin] PATH_INFO: `/v3/projects/cfce43cd6e324ad3aa33794e56e03028/users/451456fe011f4644a401f394b9c23fc0/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:42.163233 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439030c-ab33-4050-b0fe-fc9f4061abb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfce43cd6e324ad3aa33794e56e03028, user_id=451456fe011f4644a401f394b9c23fc0, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:42.165981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439030c-ab33-4050-b0fe-fc9f4061abb7 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:42.261881 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1391/2781] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:42 2022] PUT /identity/v3/projects/cfce43cd6e324ad3aa33794e56e03028/users/451456fe011f4644a401f394b9c23fc0/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:27:42.263240 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f538aa-3be7-4682-8a99-8dcceccd38fb admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:42.276772 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f538aa-3be7-4682-8a99-8dcceccd38fb admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:42.339117 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89508c2e-b91e-42e3-a0ca-e0ef81aac557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:42.339726 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89508c2e-b91e-42e3-a0ca-e0ef81aac557 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:42.340012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89508c2e-b91e-42e3-a0ca-e0ef81aac557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:42.340409 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89508c2e-b91e-42e3-a0ca-e0ef81aac557 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:42.341001 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89508c2e-b91e-42e3-a0ca-e0ef81aac557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:42.342640 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89508c2e-b91e-42e3-a0ca-e0ef81aac557 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:42.353312 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1391/2782] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:42.358014 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439030c-ab33-4050-b0fe-fc9f4061abb7 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:42.369030 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439030c-ab33-4050-b0fe-fc9f4061abb7 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:42.373720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41568944-8fd4-4703-bc0e-6e13dc6cc9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:42.374392 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41568944-8fd4-4703-bc0e-6e13dc6cc9f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:42.374746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41568944-8fd4-4703-bc0e-6e13dc6cc9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:42.382559 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41568944-8fd4-4703-bc0e-6e13dc6cc9f8 admin admin] PATH_INFO: `/v3/projects/cfce43cd6e324ad3aa33794e56e03028/users/451456fe011f4644a401f394b9c23fc0/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:42.382559 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41568944-8fd4-4703-bc0e-6e13dc6cc9f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfce43cd6e324ad3aa33794e56e03028, user_id=451456fe011f4644a401f394b9c23fc0, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:42.382559 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41568944-8fd4-4703-bc0e-6e13dc6cc9f8 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:42.389913 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1392/2783] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:42 2022] PUT /identity/v3/projects/cfce43cd6e324ad3aa33794e56e03028/users/451456fe011f4644a401f394b9c23fc0/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:44.148563 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3822c2-fb88-4093-8deb-5028a1708262 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:44.149054 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3822c2-fb88-4093-8deb-5028a1708262 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:44.151671 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3822c2-fb88-4093-8deb-5028a1708262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:44.177699 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-7d3822c2-fb88-4093-8deb-5028a1708262 None None] MFA Rules not processed for user `451456fe011f4644a401f394b9c23fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:44.179136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-7d3822c2-fb88-4093-8deb-5028a1708262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:44.247761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1392/2784] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:44.258105 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcec56-9ede-462a-875b-5bd83500f96a None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:44.258633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcec56-9ede-462a-875b-5bd83500f96a None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:44.258733 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcec56-9ede-462a-875b-5bd83500f96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:44.277590 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-abfcec56-9ede-462a-875b-5bd83500f96a None None] MFA Rules not processed for user `d7cfb25ea3464fe1be53dbeacbbba931`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:44.278836 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-abfcec56-9ede-462a-875b-5bd83500f96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:44.332154 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1393/2785] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:27:44.344673 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3822c2-fb88-4093-8deb-5028a1708262 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:44.346114 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-7d3822c2-fb88-4093-8deb-5028a1708262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:44.364979 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:44.418767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3822c2-fb88-4093-8deb-5028a1708262 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:44.424213 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11802a3-1f39-4cf7-ba13-b98c57cf268d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:44.424846 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11802a3-1f39-4cf7-ba13-b98c57cf268d service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:44.425127 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11802a3-1f39-4cf7-ba13-b98c57cf268d service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:44.425402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11802a3-1f39-4cf7-ba13-b98c57cf268d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:44.433827 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11802a3-1f39-4cf7-ba13-b98c57cf268d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:44.435446 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11802a3-1f39-4cf7-ba13-b98c57cf268d service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:44.444607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1393/2786] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:27:44.677926 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcec56-9ede-462a-875b-5bd83500f96a None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:44.749145 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcec56-9ede-462a-875b-5bd83500f96a None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:44.753460 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1ec32-4c34-4116-a78a-406d0b235c88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:44.754026 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1ec32-4c34-4116-a78a-406d0b235c88 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:44.754425 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1ec32-4c34-4116-a78a-406d0b235c88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:44.754708 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1ec32-4c34-4116-a78a-406d0b235c88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:44.756616 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-4fb1ec32-4c34-4116-a78a-406d0b235c88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:44.763085 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:44.766797 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1ec32-4c34-4116-a78a-406d0b235c88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:44.768207 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1ec32-4c34-4116-a78a-406d0b235c88 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:44.777328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1394/2787] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:27:45.199546 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11802a3-1f39-4cf7-ba13-b98c57cf268d service nova] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:45.201513 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-f11802a3-1f39-4cf7-ba13-b98c57cf268d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:45.281252 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11802a3-1f39-4cf7-ba13-b98c57cf268d service nova] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:45.287117 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2611df-f2ed-4b0c-a1ce-da04cf855b63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e92560dd9da4c7cbcac5a84bcaca483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:45.287749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2611df-f2ed-4b0c-a1ce-da04cf855b63 service placement] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:45.288028 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2611df-f2ed-4b0c-a1ce-da04cf855b63 service placement] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:45.288330 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2611df-f2ed-4b0c-a1ce-da04cf855b63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:45.290050 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-0f2611df-f2ed-4b0c-a1ce-da04cf855b63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:45.302087 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2611df-f2ed-4b0c-a1ce-da04cf855b63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:45.303690 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2611df-f2ed-4b0c-a1ce-da04cf855b63 service placement] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:45.313714 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1394/2788] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:27:48.636631 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1ec32-4c34-4116-a78a-406d0b235c88 service neutron] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:48.638060 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-4fb1ec32-4c34-4116-a78a-406d0b235c88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:48.710889 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1ec32-4c34-4116-a78a-406d0b235c88 service neutron] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:48.715623 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6414f-ead4-45d8-9995-ab0ee60805a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:48.716263 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6414f-ead4-45d8-9995-ab0ee60805a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:48.716539 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6414f-ead4-45d8-9995-ab0ee60805a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:48.717416 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6414f-ead4-45d8-9995-ab0ee60805a8 admin admin] PATH_INFO: `/v3/users/1646fd54408d43d98d75e33963066ce7` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:48.718102 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c6414f-ead4-45d8-9995-ab0ee60805a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1646fd54408d43d98d75e33963066ce7)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:48.720072 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c6414f-ead4-45d8-9995-ab0ee60805a8 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:48.910117 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-a8c6414f-ead4-45d8-9995-ab0ee60805a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1646fd54408d43d98d75e33963066ce7'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:48.910872 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-a8c6414f-ead4-45d8-9995-ab0ee60805a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1646fd54408d43d98d75e33963066ce7'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:48.911483 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-a8c6414f-ead4-45d8-9995-ab0ee60805a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1646fd54408d43d98d75e33963066ce7'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:48.927007 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2611df-f2ed-4b0c-a1ce-da04cf855b63 service placement] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:48.936631 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2611df-f2ed-4b0c-a1ce-da04cf855b63 service placement] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:48.940229 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452ff29-f63a-47c8-b232-336bd3a15768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:48.941449 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452ff29-f63a-47c8-b232-336bd3a15768 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:48.941726 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452ff29-f63a-47c8-b232-336bd3a15768 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:48.941998 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452ff29-f63a-47c8-b232-336bd3a15768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:48.944061 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-9452ff29-f63a-47c8-b232-336bd3a15768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:48.953514 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452ff29-f63a-47c8-b232-336bd3a15768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:48.955950 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452ff29-f63a-47c8-b232-336bd3a15768 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:48.963322 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1395/2789] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:27:49.085074 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-a8c6414f-ead4-45d8-9995-ab0ee60805a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1646fd54408d43d98d75e33963066ce7'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:49.098314 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-a8c6414f-ead4-45d8-9995-ab0ee60805a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1646fd54408d43d98d75e33963066ce7'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:49.114843 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1395/2790] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:27:48 2022] DELETE /identity/v3/users/1646fd54408d43d98d75e33963066ce7 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:49.116757 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe7d0a-626d-4fe9-9fc6-37f8bb91f3fa None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:49.117044 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe7d0a-626d-4fe9-9fc6-37f8bb91f3fa None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:49.117489 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe7d0a-626d-4fe9-9fc6-37f8bb91f3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:49.137518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-19fe7d0a-626d-4fe9-9fc6-37f8bb91f3fa None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:49.138847 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-19fe7d0a-626d-4fe9-9fc6-37f8bb91f3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:49.203161 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1396/2791] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:49.214599 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6414f-ead4-45d8-9995-ab0ee60805a8 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:49.216092 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-a8c6414f-ead4-45d8-9995-ab0ee60805a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:49.276917 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6414f-ead4-45d8-9995-ab0ee60805a8 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:49.280563 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c35cb2-e823-463b-9d49-08589f9ba47c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:49.281168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c35cb2-e823-463b-9d49-08589f9ba47c service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:49.281451 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c35cb2-e823-463b-9d49-08589f9ba47c service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:49.281724 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c35cb2-e823-463b-9d49-08589f9ba47c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:49.291493 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c35cb2-e823-463b-9d49-08589f9ba47c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:49.292927 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c35cb2-e823-463b-9d49-08589f9ba47c service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:49.304036 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1396/2792] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:27:49.559062 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe7d0a-626d-4fe9-9fc6-37f8bb91f3fa None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:49.560406 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-19fe7d0a-626d-4fe9-9fc6-37f8bb91f3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:49.575673 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe7d0a-626d-4fe9-9fc6-37f8bb91f3fa None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:49.580528 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8668b-3588-488a-a4df-beb1f8480b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:49.581357 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8668b-3588-488a-a4df-beb1f8480b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:49.581735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8668b-3588-488a-a4df-beb1f8480b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:49.582112 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8668b-3588-488a-a4df-beb1f8480b00 admin admin] PATH_INFO: `/v3/users/0fdc609da23b46f8b22a5e2d21c2ca70` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:49.583395 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8668b-3588-488a-a4df-beb1f8480b00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fdc609da23b46f8b22a5e2d21c2ca70)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:49.585677 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8668b-3588-488a-a4df-beb1f8480b00 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:49.605247 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:49.780265 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c35cb2-e823-463b-9d49-08589f9ba47c service neutron] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:49.781796 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-a3c35cb2-e823-463b-9d49-08589f9ba47c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:49.796044 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c35cb2-e823-463b-9d49-08589f9ba47c service neutron] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:49.801229 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b6fcd-6157-4b53-a20d-b00526bb77a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:49.802117 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b6fcd-6157-4b53-a20d-b00526bb77a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:49.802504 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b6fcd-6157-4b53-a20d-b00526bb77a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:49.802850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b6fcd-6157-4b53-a20d-b00526bb77a2 admin admin] PATH_INFO: `/v3/projects/7ddee9faf5e44e318ea389b8479d5fbe` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:49.804044 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b6fcd-6157-4b53-a20d-b00526bb77a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ddee9faf5e44e318ea389b8479d5fbe)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:49.806277 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b6fcd-6157-4b53-a20d-b00526bb77a2 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:49.813064 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-b8b8668b-3588-488a-a4df-beb1f8480b00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fdc609da23b46f8b22a5e2d21c2ca70'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:49.813761 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-b8b8668b-3588-488a-a4df-beb1f8480b00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fdc609da23b46f8b22a5e2d21c2ca70'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:49.820526 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:49.824051 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-b8b8668b-3588-488a-a4df-beb1f8480b00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fdc609da23b46f8b22a5e2d21c2ca70'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:49.885810 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-b8b8668b-3588-488a-a4df-beb1f8480b00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fdc609da23b46f8b22a5e2d21c2ca70'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:49.894762 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-b8b8668b-3588-488a-a4df-beb1f8480b00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fdc609da23b46f8b22a5e2d21c2ca70'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:49.904052 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-8c1b6fcd-6157-4b53-a20d-b00526bb77a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ddee9faf5e44e318ea389b8479d5fbe', 'request_id': 'req-8c1b6fcd-6157-4b53-a20d-b00526bb77a2'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:49.910893 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-8c1b6fcd-6157-4b53-a20d-b00526bb77a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ddee9faf5e44e318ea389b8479d5fbe', 'request_id': 'req-8c1b6fcd-6157-4b53-a20d-b00526bb77a2'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:49.916981 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1397/2793] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:27:49 2022] DELETE /identity/v3/users/0fdc609da23b46f8b22a5e2d21c2ca70 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:27:49.918441 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af14f5-9ecb-4145-8684-53014e2f22b1 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:49.918568 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-8c1b6fcd-6157-4b53-a20d-b00526bb77a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ddee9faf5e44e318ea389b8479d5fbe', 'request_id': 'req-8c1b6fcd-6157-4b53-a20d-b00526bb77a2'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:49.918836 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af14f5-9ecb-4145-8684-53014e2f22b1 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:49.923887 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af14f5-9ecb-4145-8684-53014e2f22b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:49.938864 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-e5af14f5-9ecb-4145-8684-53014e2f22b1 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:49.941592 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-e5af14f5-9ecb-4145-8684-53014e2f22b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:50.005024 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1398/2794] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:50.014599 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af14f5-9ecb-4145-8684-53014e2f22b1 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:50.015977 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-e5af14f5-9ecb-4145-8684-53014e2f22b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:50.041055 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-8c1b6fcd-6157-4b53-a20d-b00526bb77a2 admin admin] The token cache is being invalidate because project 7ddee9faf5e44e318ea389b8479d5fbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:27:50.041055 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-8c1b6fcd-6157-4b53-a20d-b00526bb77a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:50.041863 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-8c1b6fcd-6157-4b53-a20d-b00526bb77a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:50.047036 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1397/2795] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:27:49 2022] DELETE /identity/v3/projects/7ddee9faf5e44e318ea389b8479d5fbe => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:27:50.048522 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb73205-cf48-4cf6-9f6c-8173abb0084b None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:50.048870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb73205-cf48-4cf6-9f6c-8173abb0084b None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:50.049568 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb73205-cf48-4cf6-9f6c-8173abb0084b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:50.073721 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-0cb73205-cf48-4cf6-9f6c-8173abb0084b None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:50.074782 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-0cb73205-cf48-4cf6-9f6c-8173abb0084b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:50.090984 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1398/2796] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:50.091218 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af14f5-9ecb-4145-8684-53014e2f22b1 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:50.092710 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9ccd7-8b40-4efd-ab36-b66aea1512c8 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:50.093119 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9ccd7-8b40-4efd-ab36-b66aea1512c8 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:50.093421 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9ccd7-8b40-4efd-ab36-b66aea1512c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:50.095534 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116feb2c-1e36-43c6-9543-b286d9e6dbc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:50.102229 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116feb2c-1e36-43c6-9543-b286d9e6dbc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:50.102229 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116feb2c-1e36-43c6-9543-b286d9e6dbc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:50.102229 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116feb2c-1e36-43c6-9543-b286d9e6dbc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:50.102229 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-116feb2c-1e36-43c6-9543-b286d9e6dbc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:50.111431 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116feb2c-1e36-43c6-9543-b286d9e6dbc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:50.112983 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116feb2c-1e36-43c6-9543-b286d9e6dbc5 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:50.114955 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-cae9ccd7-8b40-4efd-ab36-b66aea1512c8 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:50.116246 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-cae9ccd7-8b40-4efd-ab36-b66aea1512c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:50.124039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1399/2797] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:27:50.128848 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1399/2798] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:50.130737 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116feb2c-1e36-43c6-9543-b286d9e6dbc5 service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:50.141399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116feb2c-1e36-43c6-9543-b286d9e6dbc5 service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:50.146986 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6953e-944d-440a-8f17-59534441b74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:50.147587 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6953e-944d-440a-8f17-59534441b74a admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:50.147865 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6953e-944d-440a-8f17-59534441b74a admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:50.148137 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6953e-944d-440a-8f17-59534441b74a admin admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:50.148824 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6953e-944d-440a-8f17-59534441b74a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:27:50.149120 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6953e-944d-440a-8f17-59534441b74a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:50.150753 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6953e-944d-440a-8f17-59534441b74a admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:50.166984 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1400/2799] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 08:27:50.171060 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9ccd7-8b40-4efd-ab36-b66aea1512c8 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:50.181948 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9ccd7-8b40-4efd-ab36-b66aea1512c8 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:50.189088 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a3813-7785-4cbe-a887-c53841bc473f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:50.189917 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a3813-7785-4cbe-a887-c53841bc473f admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:50.190338 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a3813-7785-4cbe-a887-c53841bc473f admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:50.193533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a3813-7785-4cbe-a887-c53841bc473f admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:50.193533 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a3813-7785-4cbe-a887-c53841bc473f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:50.195209 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a3813-7785-4cbe-a887-c53841bc473f admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:50.280844 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1400/2800] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:27:50 2022] POST /identity/v3/projects => generated 391 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:27:50.285280 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6953e-944d-440a-8f17-59534441b74a admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:50.295303 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6953e-944d-440a-8f17-59534441b74a admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:50.315379 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:50.373469 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d073d-615a-4152-9265-3a1b86d872ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:50.373469 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d073d-615a-4152-9265-3a1b86d872ce admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:50.373469 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d073d-615a-4152-9265-3a1b86d872ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:50.373469 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d073d-615a-4152-9265-3a1b86d872ce admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:50.373822 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d073d-615a-4152-9265-3a1b86d872ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:50.390379 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d073d-615a-4152-9265-3a1b86d872ce admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:50.520256 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1401/2801] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:27:50 2022] POST /identity/v3/users => generated 296 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:27:50.524258 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a3813-7785-4cbe-a887-c53841bc473f admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:50.535544 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a3813-7785-4cbe-a887-c53841bc473f admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:50.541094 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bb7dc-8d63-4e9f-8489-0b3869c9e45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:50.543636 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bb7dc-8d63-4e9f-8489-0b3869c9e45b admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:50.543636 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bb7dc-8d63-4e9f-8489-0b3869c9e45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:50.543636 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bb7dc-8d63-4e9f-8489-0b3869c9e45b admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:50.543636 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3bb7dc-8d63-4e9f-8489-0b3869c9e45b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:50.544498 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3bb7dc-8d63-4e9f-8489-0b3869c9e45b admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:50.548491 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d073d-615a-4152-9265-3a1b86d872ce admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:50.552536 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-af1d073d-615a-4152-9265-3a1b86d872ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:50.564712 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1401/2802] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:50.571736 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bb7dc-8d63-4e9f-8489-0b3869c9e45b admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:50.583374 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bb7dc-8d63-4e9f-8489-0b3869c9e45b admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:50.589838 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802311e5-8469-4b1d-a721-2f0c8b475372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:50.590598 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802311e5-8469-4b1d-a721-2f0c8b475372 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:50.590873 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802311e5-8469-4b1d-a721-2f0c8b475372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:50.591197 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802311e5-8469-4b1d-a721-2f0c8b475372 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:50.592583 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802311e5-8469-4b1d-a721-2f0c8b475372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:50.594320 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802311e5-8469-4b1d-a721-2f0c8b475372 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:50.598019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d073d-615a-4152-9265-3a1b86d872ce admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:50.604787 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96b507-7ce9-45e6-9de7-8ff0b327053d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:50.605624 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96b507-7ce9-45e6-9de7-8ff0b327053d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:50.606017 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96b507-7ce9-45e6-9de7-8ff0b327053d admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:50.606509 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1402/2803] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:27:50.606619 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96b507-7ce9-45e6-9de7-8ff0b327053d admin admin] PATH_INFO: `/v3/projects/b27da3ffebd449d99102a69015b5e1a7` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:50.608388 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96b507-7ce9-45e6-9de7-8ff0b327053d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b27da3ffebd449d99102a69015b5e1a7)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:50.611819 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96b507-7ce9-45e6-9de7-8ff0b327053d admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:50.612295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802311e5-8469-4b1d-a721-2f0c8b475372 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:50.623552 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802311e5-8469-4b1d-a721-2f0c8b475372 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:50.628531 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8291b6-a0ff-42c4-9b3c-b52ed4ecd920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:50.629174 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8291b6-a0ff-42c4-9b3c-b52ed4ecd920 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:50.629475 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8291b6-a0ff-42c4-9b3c-b52ed4ecd920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:50.629759 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8291b6-a0ff-42c4-9b3c-b52ed4ecd920 admin admin] PATH_INFO: `/v3/projects/dfcd44a8f10d48569ebe86525d7bc30c/users/d2c6d9983fe44595a9ae6b2f87741adb/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:50.645562 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8291b6-a0ff-42c4-9b3c-b52ed4ecd920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfcd44a8f10d48569ebe86525d7bc30c, user_id=d2c6d9983fe44595a9ae6b2f87741adb, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:50.648470 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8291b6-a0ff-42c4-9b3c-b52ed4ecd920 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:50.726652 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1403/2804] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:50 2022] PUT /identity/v3/projects/dfcd44a8f10d48569ebe86525d7bc30c/users/d2c6d9983fe44595a9ae6b2f87741adb/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:27:50.741731 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-0b96b507-7ce9-45e6-9de7-8ff0b327053d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b27da3ffebd449d99102a69015b5e1a7', 'request_id': 'req-0b96b507-7ce9-45e6-9de7-8ff0b327053d'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:50.748551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-0b96b507-7ce9-45e6-9de7-8ff0b327053d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b27da3ffebd449d99102a69015b5e1a7', 'request_id': 'req-0b96b507-7ce9-45e6-9de7-8ff0b327053d'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:50.757169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-0b96b507-7ce9-45e6-9de7-8ff0b327053d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b27da3ffebd449d99102a69015b5e1a7', 'request_id': 'req-0b96b507-7ce9-45e6-9de7-8ff0b327053d'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:50.794536 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64964d25-b953-4c70-a9a9-283d58ef4708 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:50.795107 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64964d25-b953-4c70-a9a9-283d58ef4708 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:50.795107 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64964d25-b953-4c70-a9a9-283d58ef4708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:50.805540 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-0b96b507-7ce9-45e6-9de7-8ff0b327053d admin admin] The token cache is being invalidate because project b27da3ffebd449d99102a69015b5e1a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:27:50.805828 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-0b96b507-7ce9-45e6-9de7-8ff0b327053d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:50.806539 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-0b96b507-7ce9-45e6-9de7-8ff0b327053d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:27:50.808294 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1402/2805] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:27:50 2022] DELETE /identity/v3/projects/b27da3ffebd449d99102a69015b5e1a7 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:50.812965 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28b902-5e88-4247-960f-500adbae426c None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:50.813249 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28b902-5e88-4247-960f-500adbae426c None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:50.813519 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28b902-5e88-4247-960f-500adbae426c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:50.824226 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-64964d25-b953-4c70-a9a9-283d58ef4708 None None] MFA Rules not processed for user `d2c6d9983fe44595a9ae6b2f87741adb`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:50.825427 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-64964d25-b953-4c70-a9a9-283d58ef4708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:50.833136 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-0f28b902-5e88-4247-960f-500adbae426c None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:50.834356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-0f28b902-5e88-4247-960f-500adbae426c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:50.899502 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1404/2806] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:27:50.907208 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64964d25-b953-4c70-a9a9-283d58ef4708 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:50.913767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1403/2807] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:27:50.914906 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-64964d25-b953-4c70-a9a9-283d58ef4708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:50.916360 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c89c94-a419-4293-ac6e-96d26fe2ee6c None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:50.916651 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c89c94-a419-4293-ac6e-96d26fe2ee6c None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:50.916924 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c89c94-a419-4293-ac6e-96d26fe2ee6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:50.925604 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:50.941417 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-99c89c94-a419-4293-ac6e-96d26fe2ee6c None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:50.943156 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-99c89c94-a419-4293-ac6e-96d26fe2ee6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:50.952765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1404/2808] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:50.957709 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c89c94-a419-4293-ac6e-96d26fe2ee6c None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:50.969077 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c89c94-a419-4293-ac6e-96d26fe2ee6c None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:50.975030 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c426f-20a1-4ee5-af34-08a2ae81662f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:50.975796 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c426f-20a1-4ee5-af34-08a2ae81662f admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:50.976231 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c426f-20a1-4ee5-af34-08a2ae81662f admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:50.976596 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c426f-20a1-4ee5-af34-08a2ae81662f admin admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:50.977410 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c426f-20a1-4ee5-af34-08a2ae81662f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:27:50.977813 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c426f-20a1-4ee5-af34-08a2ae81662f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:50.979581 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c426f-20a1-4ee5-af34-08a2ae81662f admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:50.982207 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64964d25-b953-4c70-a9a9-283d58ef4708 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:50.986585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5ca2c-28c6-427a-b15d-0ff7a3492403 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:50.987636 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5ca2c-28c6-427a-b15d-0ff7a3492403 service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:50.987783 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5ca2c-28c6-427a-b15d-0ff7a3492403 service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:50.987995 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5ca2c-28c6-427a-b15d-0ff7a3492403 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:50.994513 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1405/2809] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:27:50.999342 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c426f-20a1-4ee5-af34-08a2ae81662f admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:51.003674 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5ca2c-28c6-427a-b15d-0ff7a3492403 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:51.005809 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5ca2c-28c6-427a-b15d-0ff7a3492403 service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:51.012078 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c426f-20a1-4ee5-af34-08a2ae81662f admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:51.017126 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb4108-676c-45d8-828e-089fd3be7087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:51.035682 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb4108-676c-45d8-828e-089fd3be7087 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:51.035682 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb4108-676c-45d8-828e-089fd3be7087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:51.035682 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb4108-676c-45d8-828e-089fd3be7087 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:51.036625 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1405/2810] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:50 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:27:51.036783 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb4108-676c-45d8-828e-089fd3be7087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:51.036783 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb4108-676c-45d8-828e-089fd3be7087 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:51.043363 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:51.252185 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1406/2811] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:27:50 2022] POST /identity/v3/projects => generated 385 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:27:51.256949 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5ca2c-28c6-427a-b15d-0ff7a3492403 service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:51.267622 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5ca2c-28c6-427a-b15d-0ff7a3492403 service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:51.326414 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac4cb2-b692-4455-8836-c1f3403c6c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:51.326934 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac4cb2-b692-4455-8836-c1f3403c6c8a admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:51.327216 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac4cb2-b692-4455-8836-c1f3403c6c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:51.327482 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac4cb2-b692-4455-8836-c1f3403c6c8a admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:51.328085 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac4cb2-b692-4455-8836-c1f3403c6c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:51.330026 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac4cb2-b692-4455-8836-c1f3403c6c8a admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:51.428011 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1406/2812] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:27:51 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:27:51.432197 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb4108-676c-45d8-828e-089fd3be7087 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:51.443384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb4108-676c-45d8-828e-089fd3be7087 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:51.448838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd4a44-5577-46bc-bfd6-11f1831df91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:51.449541 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd4a44-5577-46bc-bfd6-11f1831df91a admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:51.449859 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd4a44-5577-46bc-bfd6-11f1831df91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:51.450111 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd4a44-5577-46bc-bfd6-11f1831df91a admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:51.450786 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd4a44-5577-46bc-bfd6-11f1831df91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:51.453065 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd4a44-5577-46bc-bfd6-11f1831df91a admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:51.463869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1407/2813] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:51.467927 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac4cb2-b692-4455-8836-c1f3403c6c8a admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:51.477976 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac4cb2-b692-4455-8836-c1f3403c6c8a admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:51.482697 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb98b0-8428-4728-b980-71f6bf2ed287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:51.483291 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb98b0-8428-4728-b980-71f6bf2ed287 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:51.483570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb98b0-8428-4728-b980-71f6bf2ed287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:51.483841 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb98b0-8428-4728-b980-71f6bf2ed287 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:51.484473 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb98b0-8428-4728-b980-71f6bf2ed287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:51.486054 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb98b0-8428-4728-b980-71f6bf2ed287 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:51.495939 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1407/2814] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:51.500050 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd4a44-5577-46bc-bfd6-11f1831df91a admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:51.510587 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd4a44-5577-46bc-bfd6-11f1831df91a admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:51.515162 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d901154-9973-4b93-96e5-d3d94d8b2b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:51.515798 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d901154-9973-4b93-96e5-d3d94d8b2b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:51.516073 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d901154-9973-4b93-96e5-d3d94d8b2b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:51.516345 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d901154-9973-4b93-96e5-d3d94d8b2b95 admin admin] PATH_INFO: `/v3/projects/33e9aef48ee94f5a9ee5086c708d4bb5/users/f8b31aefa153498e99c11f325838f96b/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:51.531981 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d901154-9973-4b93-96e5-d3d94d8b2b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33e9aef48ee94f5a9ee5086c708d4bb5, user_id=f8b31aefa153498e99c11f325838f96b, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:51.534655 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d901154-9973-4b93-96e5-d3d94d8b2b95 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:51.639477 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1408/2815] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:51 2022] PUT /identity/v3/projects/33e9aef48ee94f5a9ee5086c708d4bb5/users/f8b31aefa153498e99c11f325838f96b/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:51.649398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7206e09-8feb-432a-abec-f9ca2838ed0c None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:51.649398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7206e09-8feb-432a-abec-f9ca2838ed0c None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:51.649398 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7206e09-8feb-432a-abec-f9ca2838ed0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:51.666823 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-b7206e09-8feb-432a-abec-f9ca2838ed0c None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:51.668023 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-b7206e09-8feb-432a-abec-f9ca2838ed0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:51.730601 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1408/2816] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:51.740677 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d901154-9973-4b93-96e5-d3d94d8b2b95 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:51.742417 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-4d901154-9973-4b93-96e5-d3d94d8b2b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:51.798115 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d901154-9973-4b93-96e5-d3d94d8b2b95 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:51.802633 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77306f92-a83f-4854-ac7b-303d98037d68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:51.803235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77306f92-a83f-4854-ac7b-303d98037d68 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:51.803562 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77306f92-a83f-4854-ac7b-303d98037d68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:51.803838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77306f92-a83f-4854-ac7b-303d98037d68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:51.813322 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77306f92-a83f-4854-ac7b-303d98037d68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:51.814766 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77306f92-a83f-4854-ac7b-303d98037d68 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:51.825396 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1409/2817] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:27:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:27:57.484175 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb0a7c-4c00-4a04-9fe4-68e28a8a14f2 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:57.485171 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb0a7c-4c00-4a04-9fe4-68e28a8a14f2 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:57.485678 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb0a7c-4c00-4a04-9fe4-68e28a8a14f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:57.529997 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-94fb0a7c-4c00-4a04-9fe4-68e28a8a14f2 None None] MFA Rules not processed for user `f8b31aefa153498e99c11f325838f96b`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:27:57.531269 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-94fb0a7c-4c00-4a04-9fe4-68e28a8a14f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:27:57.556080 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:57.632927 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1409/2818] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:27:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:27:57.637559 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77306f92-a83f-4854-ac7b-303d98037d68 service neutron] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:57.657023 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77306f92-a83f-4854-ac7b-303d98037d68 service neutron] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:57.667226 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3364bd-b7e2-4676-9088-1f9d3e3a8f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:57.667845 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3364bd-b7e2-4676-9088-1f9d3e3a8f6b admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:57.668125 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3364bd-b7e2-4676-9088-1f9d3e3a8f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:57.668399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3364bd-b7e2-4676-9088-1f9d3e3a8f6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:57.669039 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3364bd-b7e2-4676-9088-1f9d3e3a8f6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:57.671187 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3364bd-b7e2-4676-9088-1f9d3e3a8f6b admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:57.844728 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1410/2819] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:27:57 2022] POST /identity/v3/projects => generated 385 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:27:57.846031 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb0a7c-4c00-4a04-9fe4-68e28a8a14f2 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:57.861360 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb0a7c-4c00-4a04-9fe4-68e28a8a14f2 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:57.933090 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780fea5-319f-4a9d-874e-b3bd2a6ef71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:57.933806 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780fea5-319f-4a9d-874e-b3bd2a6ef71b admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:57.934150 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780fea5-319f-4a9d-874e-b3bd2a6ef71b admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:57.934527 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780fea5-319f-4a9d-874e-b3bd2a6ef71b admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:57.935321 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780fea5-319f-4a9d-874e-b3bd2a6ef71b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:57.937299 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780fea5-319f-4a9d-874e-b3bd2a6ef71b admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:58.082754 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1410/2820] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:27:57 2022] POST /identity/v3/users => generated 299 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 08:27:58.084355 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3364bd-b7e2-4676-9088-1f9d3e3a8f6b admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:58.095547 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3364bd-b7e2-4676-9088-1f9d3e3a8f6b admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:58.101266 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee37f9-d76c-44d3-965b-09635f0bc334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:58.102026 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee37f9-d76c-44d3-965b-09635f0bc334 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:58.102365 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee37f9-d76c-44d3-965b-09635f0bc334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:58.102620 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee37f9-d76c-44d3-965b-09635f0bc334 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:58.103834 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee37f9-d76c-44d3-965b-09635f0bc334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:58.108040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee37f9-d76c-44d3-965b-09635f0bc334 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:58.122697 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1411/2821] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:58.127036 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780fea5-319f-4a9d-874e-b3bd2a6ef71b admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:58.138974 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780fea5-319f-4a9d-874e-b3bd2a6ef71b admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:58.159553 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263d961-4ae4-49d4-88d5-6b7bd386d3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:58.159553 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263d961-4ae4-49d4-88d5-6b7bd386d3b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:58.159553 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263d961-4ae4-49d4-88d5-6b7bd386d3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:58.159553 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263d961-4ae4-49d4-88d5-6b7bd386d3b6 admin admin] PATH_INFO: `/v3/projects/8530ab1308dd41ddb8caf8f8215eda24/users/e4da8ab9406b495483e170f0dc2b7076/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:58.182359 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263d961-4ae4-49d4-88d5-6b7bd386d3b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8530ab1308dd41ddb8caf8f8215eda24, user_id=e4da8ab9406b495483e170f0dc2b7076, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:58.182359 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263d961-4ae4-49d4-88d5-6b7bd386d3b6 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:58.260805 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1411/2822] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:58 2022] PUT /identity/v3/projects/8530ab1308dd41ddb8caf8f8215eda24/users/e4da8ab9406b495483e170f0dc2b7076/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:27:58.265484 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee37f9-d76c-44d3-965b-09635f0bc334 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:58.281297 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee37f9-d76c-44d3-965b-09635f0bc334 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:58.379488 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8106e-33ee-4733-a770-c01a95d12ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:58.379488 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8106e-33ee-4733-a770-c01a95d12ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:58.379488 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8106e-33ee-4733-a770-c01a95d12ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:58.379488 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8106e-33ee-4733-a770-c01a95d12ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:58.380010 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8106e-33ee-4733-a770-c01a95d12ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:58.380010 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8106e-33ee-4733-a770-c01a95d12ba1 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:58.382917 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1412/2823] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:27:58.387406 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263d961-4ae4-49d4-88d5-6b7bd386d3b6 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:27:58.400835 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263d961-4ae4-49d4-88d5-6b7bd386d3b6 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:27:58.405987 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60aae1f-b531-4695-af1d-57b47692c194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:27:58.406804 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60aae1f-b531-4695-af1d-57b47692c194 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:27:58.407149 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60aae1f-b531-4695-af1d-57b47692c194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:27:58.407492 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60aae1f-b531-4695-af1d-57b47692c194 admin admin] PATH_INFO: `/v3/projects/8530ab1308dd41ddb8caf8f8215eda24/users/e4da8ab9406b495483e170f0dc2b7076/roles/e905040849d04aadbb8da8b0d216c92c` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:27:58.410193 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60aae1f-b531-4695-af1d-57b47692c194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8530ab1308dd41ddb8caf8f8215eda24, user_id=e4da8ab9406b495483e170f0dc2b7076, role_id=e905040849d04aadbb8da8b0d216c92c)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:27:58.412879 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60aae1f-b531-4695-af1d-57b47692c194 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:27:58.423336 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1412/2824] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:27:58 2022] PUT /identity/v3/projects/8530ab1308dd41ddb8caf8f8215eda24/users/e4da8ab9406b495483e170f0dc2b7076/roles/e905040849d04aadbb8da8b0d216c92c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:28:02.151301 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8106e-33ee-4733-a770-c01a95d12ba1 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:02.180336 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:28:02.213184 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8106e-33ee-4733-a770-c01a95d12ba1 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:02.276957 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ae3fa-45d7-4d08-91b5-1d497dc79388 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:02.277824 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ae3fa-45d7-4d08-91b5-1d497dc79388 service cinder] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:02.278018 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ae3fa-45d7-4d08-91b5-1d497dc79388 service cinder] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:02.278514 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ae3fa-45d7-4d08-91b5-1d497dc79388 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:02.282529 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-487ae3fa-45d7-4d08-91b5-1d497dc79388 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:02.357771 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ae3fa-45d7-4d08-91b5-1d497dc79388 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:02.359512 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ae3fa-45d7-4d08-91b5-1d497dc79388 service cinder] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:02.382353 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1413/2825] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:28:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:28:03.196242 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60aae1f-b531-4695-af1d-57b47692c194 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:03.198385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-b60aae1f-b531-4695-af1d-57b47692c194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:03.308754 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60aae1f-b531-4695-af1d-57b47692c194 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:03.314994 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c0967-c10f-4543-9350-ce2634b95d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:03.316430 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c0967-c10f-4543-9350-ce2634b95d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:03.316705 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c0967-c10f-4543-9350-ce2634b95d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:03.316984 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c0967-c10f-4543-9350-ce2634b95d6c admin admin] PATH_INFO: `/v3/users/d2c6d9983fe44595a9ae6b2f87741adb` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:03.319099 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c0967-c10f-4543-9350-ce2634b95d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2c6d9983fe44595a9ae6b2f87741adb)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:03.320988 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c0967-c10f-4543-9350-ce2634b95d6c admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:03.353649 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:28:03.561436 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-692c0967-c10f-4543-9350-ce2634b95d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2c6d9983fe44595a9ae6b2f87741adb'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:03.562304 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-692c0967-c10f-4543-9350-ce2634b95d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2c6d9983fe44595a9ae6b2f87741adb'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:03.563153 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-692c0967-c10f-4543-9350-ce2634b95d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2c6d9983fe44595a9ae6b2f87741adb'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:03.668525 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-692c0967-c10f-4543-9350-ce2634b95d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2c6d9983fe44595a9ae6b2f87741adb'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:03.685825 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-692c0967-c10f-4543-9350-ce2634b95d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2c6d9983fe44595a9ae6b2f87741adb'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:03.705667 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1413/2826] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:28:03 2022] DELETE /identity/v3/users/d2c6d9983fe44595a9ae6b2f87741adb => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:28:03.710623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe8dd2-d9f5-4455-bdab-a66dc3a1c212 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:03.711165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe8dd2-d9f5-4455-bdab-a66dc3a1c212 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:03.711165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe8dd2-d9f5-4455-bdab-a66dc3a1c212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:03.737165 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-3dfe8dd2-d9f5-4455-bdab-a66dc3a1c212 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:28:03.739164 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-3dfe8dd2-d9f5-4455-bdab-a66dc3a1c212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:03.820220 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1414/2827] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:28:03.831256 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c0967-c10f-4543-9350-ce2634b95d6c admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:03.834815 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-692c0967-c10f-4543-9350-ce2634b95d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:03.954699 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c0967-c10f-4543-9350-ce2634b95d6c admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:03.959593 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a262f-759b-492b-b264-c63b97bf591e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:03.960374 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a262f-759b-492b-b264-c63b97bf591e service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:03.960684 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a262f-759b-492b-b264-c63b97bf591e service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:03.960962 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a262f-759b-492b-b264-c63b97bf591e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:03.971721 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a262f-759b-492b-b264-c63b97bf591e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:03.973750 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a262f-759b-492b-b264-c63b97bf591e service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:03.984544 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1414/2828] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:28:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:28:04.500260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe8dd2-d9f5-4455-bdab-a66dc3a1c212 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:04.501726 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-3dfe8dd2-d9f5-4455-bdab-a66dc3a1c212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:04.523896 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe8dd2-d9f5-4455-bdab-a66dc3a1c212 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:04.529139 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5c540-5879-4552-921a-d421ec53b556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:04.530003 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5c540-5879-4552-921a-d421ec53b556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:04.530366 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5c540-5879-4552-921a-d421ec53b556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:04.532222 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5c540-5879-4552-921a-d421ec53b556 admin admin] PATH_INFO: `/v3/projects/dfcd44a8f10d48569ebe86525d7bc30c` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:04.532222 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb5c540-5879-4552-921a-d421ec53b556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfcd44a8f10d48569ebe86525d7bc30c)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:04.533721 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb5c540-5879-4552-921a-d421ec53b556 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:04.556853 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890c12f-d372-421b-bfe6-5d8771d36068 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:04.557330 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890c12f-d372-421b-bfe6-5d8771d36068 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:04.557594 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890c12f-d372-421b-bfe6-5d8771d36068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:04.580545 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:28:04.590524 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-2890c12f-d372-421b-bfe6-5d8771d36068 None None] MFA Rules not processed for user `e4da8ab9406b495483e170f0dc2b7076`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:28:04.593635 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-2890c12f-d372-421b-bfe6-5d8771d36068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:04.642335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-bdb5c540-5879-4552-921a-d421ec53b556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfcd44a8f10d48569ebe86525d7bc30c', 'request_id': 'req-bdb5c540-5879-4552-921a-d421ec53b556'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:04.648968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-bdb5c540-5879-4552-921a-d421ec53b556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfcd44a8f10d48569ebe86525d7bc30c', 'request_id': 'req-bdb5c540-5879-4552-921a-d421ec53b556'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:04.657167 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-bdb5c540-5879-4552-921a-d421ec53b556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfcd44a8f10d48569ebe86525d7bc30c', 'request_id': 'req-bdb5c540-5879-4552-921a-d421ec53b556'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:04.677465 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1415/2829] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:28:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:28:04.690630 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890c12f-d372-421b-bfe6-5d8771d36068 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:04.692465 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-2890c12f-d372-421b-bfe6-5d8771d36068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:04.719102 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:28:04.727154 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-bdb5c540-5879-4552-921a-d421ec53b556 admin admin] The token cache is being invalidate because project dfcd44a8f10d48569ebe86525d7bc30c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:28:04.727629 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-bdb5c540-5879-4552-921a-d421ec53b556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:04.728116 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-bdb5c540-5879-4552-921a-d421ec53b556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:04.729950 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1415/2830] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:28:04 2022] DELETE /identity/v3/projects/dfcd44a8f10d48569ebe86525d7bc30c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:28:04.735069 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a6b4b-53c9-42fd-85ba-2642e042ae7a None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:04.736442 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a6b4b-53c9-42fd-85ba-2642e042ae7a None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:04.736946 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a6b4b-53c9-42fd-85ba-2642e042ae7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:04.759869 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-b34a6b4b-53c9-42fd-85ba-2642e042ae7a None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:28:04.760880 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890c12f-d372-421b-bfe6-5d8771d36068 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:04.761221 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-b34a6b4b-53c9-42fd-85ba-2642e042ae7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:04.818485 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e7a10-8d18-44ab-a60a-a1e5b1ab2483 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f4ee9c3c5be48699a24dfce9b30bda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:04.820159 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e7a10-8d18-44ab-a60a-a1e5b1ab2483 service glance] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:04.820441 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e7a10-8d18-44ab-a60a-a1e5b1ab2483 service glance] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:04.820716 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e7a10-8d18-44ab-a60a-a1e5b1ab2483 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:04.822579 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-439e7a10-8d18-44ab-a60a-a1e5b1ab2483 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:04.838361 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1416/2831] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:28:04.843594 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae41de-bd87-4ebb-a9d7-a9615ba8849f None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:04.843882 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae41de-bd87-4ebb-a9d7-a9615ba8849f None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:04.844159 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae41de-bd87-4ebb-a9d7-a9615ba8849f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:04.868572 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-6fae41de-bd87-4ebb-a9d7-a9615ba8849f None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:28:04.870035 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-6fae41de-bd87-4ebb-a9d7-a9615ba8849f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:04.878245 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1417/2832] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:28:04.883337 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae41de-bd87-4ebb-a9d7-a9615ba8849f None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:04.895935 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae41de-bd87-4ebb-a9d7-a9615ba8849f None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:04.901684 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9bbc7-231a-4f7f-a34a-ed9dbc8c1818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:04.902036 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e7a10-8d18-44ab-a60a-a1e5b1ab2483 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:04.902481 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9bbc7-231a-4f7f-a34a-ed9dbc8c1818 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:04.902841 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9bbc7-231a-4f7f-a34a-ed9dbc8c1818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:04.903179 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9bbc7-231a-4f7f-a34a-ed9dbc8c1818 admin admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:04.903528 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e7a10-8d18-44ab-a60a-a1e5b1ab2483 service glance] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:04.904143 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9bbc7-231a-4f7f-a34a-ed9dbc8c1818 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:28:04.904518 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9bbc7-231a-4f7f-a34a-ed9dbc8c1818 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:04.906223 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9bbc7-231a-4f7f-a34a-ed9dbc8c1818 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:04.914365 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1416/2833] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:28:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:28:04.921679 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1418/2834] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 08:28:04.923188 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e7a10-8d18-44ab-a60a-a1e5b1ab2483 service glance] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:04.934468 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e7a10-8d18-44ab-a60a-a1e5b1ab2483 service glance] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:04.939212 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22256db0-c65c-4cda-a453-00c484af2658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:04.939807 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22256db0-c65c-4cda-a453-00c484af2658 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:04.940089 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22256db0-c65c-4cda-a453-00c484af2658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:04.940364 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22256db0-c65c-4cda-a453-00c484af2658 admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:04.941521 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22256db0-c65c-4cda-a453-00c484af2658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:04.943470 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22256db0-c65c-4cda-a453-00c484af2658 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:05.046443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1417/2835] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:28:04 2022] POST /identity/v3/projects => generated 399 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:28:05.051318 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9bbc7-231a-4f7f-a34a-ed9dbc8c1818 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:05.061968 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9bbc7-231a-4f7f-a34a-ed9dbc8c1818 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:05.137056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd5a4f-4b46-41a4-9d71-9453da602e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:05.137679 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd5a4f-4b46-41a4-9d71-9453da602e03 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:05.138029 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd5a4f-4b46-41a4-9d71-9453da602e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:05.138394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd5a4f-4b46-41a4-9d71-9453da602e03 admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:05.138954 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd5a4f-4b46-41a4-9d71-9453da602e03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:05.141327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd5a4f-4b46-41a4-9d71-9453da602e03 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:05.267705 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20635a1a-0fe8-4738-8a11-4889fbca26e8 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:05.282412 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20635a1a-0fe8-4738-8a11-4889fbca26e8 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:05.282412 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20635a1a-0fe8-4738-8a11-4889fbca26e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:05.283274 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1419/2836] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:28:05 2022] POST /identity/v3/users => generated 300 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:28:05.283274 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd5a4f-4b46-41a4-9d71-9453da602e03 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:05.299716 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd5a4f-4b46-41a4-9d71-9453da602e03 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:05.305277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad17d14-533f-49a0-9369-e97ef5faf676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:05.305957 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad17d14-533f-49a0-9369-e97ef5faf676 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:05.306347 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad17d14-533f-49a0-9369-e97ef5faf676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:05.307128 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad17d14-533f-49a0-9369-e97ef5faf676 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:05.307405 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad17d14-533f-49a0-9369-e97ef5faf676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:05.309093 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad17d14-533f-49a0-9369-e97ef5faf676 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:05.323421 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1420/2837] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:28:05.333803 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad17d14-533f-49a0-9369-e97ef5faf676 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:05.340368 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-20635a1a-0fe8-4738-8a11-4889fbca26e8 None None] MFA Rules not processed for user `970300b51d504a2bbc48158855f02f34`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:28:05.341685 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-20635a1a-0fe8-4738-8a11-4889fbca26e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:05.344763 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad17d14-533f-49a0-9369-e97ef5faf676 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:05.349979 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c6174-f454-420a-8fa6-f929cc3bf07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:05.350683 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c6174-f454-420a-8fa6-f929cc3bf07a admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:05.351033 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c6174-f454-420a-8fa6-f929cc3bf07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:05.351376 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c6174-f454-420a-8fa6-f929cc3bf07a admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:05.352108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c6174-f454-420a-8fa6-f929cc3bf07a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:05.353759 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c6174-f454-420a-8fa6-f929cc3bf07a admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:05.361520 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:28:05.377397 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1421/2838] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 08:28:05.381611 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c6174-f454-420a-8fa6-f929cc3bf07a admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:05.391417 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:28:05.392495 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c6174-f454-420a-8fa6-f929cc3bf07a admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:05.400587 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53355863-8162-4a35-89e9-87a80f7a0047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:05.401376 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53355863-8162-4a35-89e9-87a80f7a0047 admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:05.401941 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53355863-8162-4a35-89e9-87a80f7a0047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:05.402332 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53355863-8162-4a35-89e9-87a80f7a0047 admin admin] PATH_INFO: `/v3/projects/c2565b3c7a2d4a289da27d08988d8dd9/users/ffa1a714eb28410aa40b0747d29b27aa/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:05.421906 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53355863-8162-4a35-89e9-87a80f7a0047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2565b3c7a2d4a289da27d08988d8dd9, user_id=ffa1a714eb28410aa40b0747d29b27aa, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:05.435036 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1418/2839] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 23 08:28:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:28:05.435178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53355863-8162-4a35-89e9-87a80f7a0047 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:05.540006 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1422/2840] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:28:05 2022] PUT /identity/v3/projects/c2565b3c7a2d4a289da27d08988d8dd9/users/ffa1a714eb28410aa40b0747d29b27aa/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:28:05.552345 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e27ae-f463-40b4-a902-4022de687061 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:05.555527 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e27ae-f463-40b4-a902-4022de687061 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:05.555527 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e27ae-f463-40b4-a902-4022de687061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:05.576028 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53355863-8162-4a35-89e9-87a80f7a0047 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:05.578923 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-53355863-8162-4a35-89e9-87a80f7a0047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:05.621527 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-354e27ae-f463-40b4-a902-4022de687061 None None] MFA Rules not processed for user `ffa1a714eb28410aa40b0747d29b27aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:28:05.623352 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-354e27ae-f463-40b4-a902-4022de687061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:05.708089 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53355863-8162-4a35-89e9-87a80f7a0047 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:05.715884 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eebb23-c1ff-4f3c-9b90-49101fa2a7c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4718cad0c0b9461d9c4152d7ea4b385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:05.716642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eebb23-c1ff-4f3c-9b90-49101fa2a7c4 service swift] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:05.717019 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eebb23-c1ff-4f3c-9b90-49101fa2a7c4 service swift] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:05.717389 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eebb23-c1ff-4f3c-9b90-49101fa2a7c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:05.718324 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1419/2841] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:28:05 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:28:05.732287 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e27ae-f463-40b4-a902-4022de687061 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:05.733895 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-354e27ae-f463-40b4-a902-4022de687061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:05.784147 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eebb23-c1ff-4f3c-9b90-49101fa2a7c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:05.786385 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eebb23-c1ff-4f3c-9b90-49101fa2a7c4 service swift] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:05.801017 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1423/2842] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 23 08:28:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 08:28:05.819811 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e27ae-f463-40b4-a902-4022de687061 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:05.823943 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e46b66-5192-41bd-bb72-3daa7bbb8b56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:05.824655 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e46b66-5192-41bd-bb72-3daa7bbb8b56 service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:05.824940 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e46b66-5192-41bd-bb72-3daa7bbb8b56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:05.825301 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e46b66-5192-41bd-bb72-3daa7bbb8b56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:05.860743 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e46b66-5192-41bd-bb72-3daa7bbb8b56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:05.862584 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e46b66-5192-41bd-bb72-3daa7bbb8b56 service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:05.889665 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1420/2843] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:28:05 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:28:06.267108 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eebb23-c1ff-4f3c-9b90-49101fa2a7c4 service swift] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:06.268609 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-b3eebb23-c1ff-4f3c-9b90-49101fa2a7c4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:06.389067 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:28:06.431884 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eebb23-c1ff-4f3c-9b90-49101fa2a7c4 service swift] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:06.446013 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f910b-205e-4ff2-bf56-47370a021666 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:06.446342 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f910b-205e-4ff2-bf56-47370a021666 service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:06.447337 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f910b-205e-4ff2-bf56-47370a021666 service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:06.447337 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f910b-205e-4ff2-bf56-47370a021666 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:06.451031 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-053f910b-205e-4ff2-bf56-47370a021666 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:06.465344 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f910b-205e-4ff2-bf56-47370a021666 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:06.467048 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f910b-205e-4ff2-bf56-47370a021666 service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:06.482469 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1424/2844] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:28:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:28:13.563754 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e46b66-5192-41bd-bb72-3daa7bbb8b56 service cinder] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:13.641937 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e46b66-5192-41bd-bb72-3daa7bbb8b56 service cinder] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:13.648176 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d84e0b-c428-4c6a-a2d2-4f4cc4389a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:13.648833 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d84e0b-c428-4c6a-a2d2-4f4cc4389a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:13.649139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d84e0b-c428-4c6a-a2d2-4f4cc4389a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:13.649366 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d84e0b-c428-4c6a-a2d2-4f4cc4389a58 admin admin] PATH_INFO: `/v3/users/ffa1a714eb28410aa40b0747d29b27aa` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:13.650541 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d84e0b-c428-4c6a-a2d2-4f4cc4389a58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffa1a714eb28410aa40b0747d29b27aa)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:13.652558 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d84e0b-c428-4c6a-a2d2-4f4cc4389a58 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:13.676407 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:28:13.889112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-28d84e0b-c428-4c6a-a2d2-4f4cc4389a58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffa1a714eb28410aa40b0747d29b27aa'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:13.889839 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-28d84e0b-c428-4c6a-a2d2-4f4cc4389a58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffa1a714eb28410aa40b0747d29b27aa'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:13.890520 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-28d84e0b-c428-4c6a-a2d2-4f4cc4389a58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffa1a714eb28410aa40b0747d29b27aa'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:13.947988 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-28d84e0b-c428-4c6a-a2d2-4f4cc4389a58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffa1a714eb28410aa40b0747d29b27aa'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:13.963724 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-28d84e0b-c428-4c6a-a2d2-4f4cc4389a58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffa1a714eb28410aa40b0747d29b27aa'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:13.980323 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1421/2845] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:28:13 2022] DELETE /identity/v3/users/ffa1a714eb28410aa40b0747d29b27aa => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:28:13.984875 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2fcbe-764c-4528-af6b-fa4e8f6ae9c0 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:13.985544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2fcbe-764c-4528-af6b-fa4e8f6ae9c0 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:13.985681 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2fcbe-764c-4528-af6b-fa4e8f6ae9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:14.007977 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-c6c2fcbe-764c-4528-af6b-fa4e8f6ae9c0 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:28:14.009278 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-c6c2fcbe-764c-4528-af6b-fa4e8f6ae9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:14.121190 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1425/2846] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:28:14.129563 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d84e0b-c428-4c6a-a2d2-4f4cc4389a58 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:14.133468 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-28d84e0b-c428-4c6a-a2d2-4f4cc4389a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:14.220946 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d84e0b-c428-4c6a-a2d2-4f4cc4389a58 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:14.225633 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca930b-120f-4adf-b7c7-cfa11759cdc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:14.226309 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca930b-120f-4adf-b7c7-cfa11759cdc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:14.226640 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca930b-120f-4adf-b7c7-cfa11759cdc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:14.226921 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca930b-120f-4adf-b7c7-cfa11759cdc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:14.237222 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca930b-120f-4adf-b7c7-cfa11759cdc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:14.239659 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca930b-120f-4adf-b7c7-cfa11759cdc6 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:14.250724 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1422/2847] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:28:14.747277 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2fcbe-764c-4528-af6b-fa4e8f6ae9c0 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:14.748794 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-c6c2fcbe-764c-4528-af6b-fa4e8f6ae9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:14.787142 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2fcbe-764c-4528-af6b-fa4e8f6ae9c0 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:14.794056 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b40629-c2b9-4f6a-9fc2-c90005502438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:14.795823 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b40629-c2b9-4f6a-9fc2-c90005502438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:14.795823 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b40629-c2b9-4f6a-9fc2-c90005502438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:14.795823 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b40629-c2b9-4f6a-9fc2-c90005502438 admin admin] PATH_INFO: `/v3/projects/c2565b3c7a2d4a289da27d08988d8dd9` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:14.796957 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b40629-c2b9-4f6a-9fc2-c90005502438 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2565b3c7a2d4a289da27d08988d8dd9)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:14.799144 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b40629-c2b9-4f6a-9fc2-c90005502438 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:14.927595 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-84b40629-c2b9-4f6a-9fc2-c90005502438 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2565b3c7a2d4a289da27d08988d8dd9', 'request_id': 'req-84b40629-c2b9-4f6a-9fc2-c90005502438'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:14.945127 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-84b40629-c2b9-4f6a-9fc2-c90005502438 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2565b3c7a2d4a289da27d08988d8dd9', 'request_id': 'req-84b40629-c2b9-4f6a-9fc2-c90005502438'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:14.952310 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-84b40629-c2b9-4f6a-9fc2-c90005502438 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2565b3c7a2d4a289da27d08988d8dd9', 'request_id': 'req-84b40629-c2b9-4f6a-9fc2-c90005502438'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:15.005952 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-84b40629-c2b9-4f6a-9fc2-c90005502438 admin admin] The token cache is being invalidate because project c2565b3c7a2d4a289da27d08988d8dd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:28:15.006656 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-84b40629-c2b9-4f6a-9fc2-c90005502438 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:15.006905 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-84b40629-c2b9-4f6a-9fc2-c90005502438 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:15.021985 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1426/2848] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:28:14 2022] DELETE /identity/v3/projects/c2565b3c7a2d4a289da27d08988d8dd9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:28:16.914073 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f30e74-e1b3-4144-aeb3-3679b40d6fc8 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:16.914666 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f30e74-e1b3-4144-aeb3-3679b40d6fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:16.914666 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f30e74-e1b3-4144-aeb3-3679b40d6fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:16.935467 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-a0f30e74-e1b3-4144-aeb3-3679b40d6fc8 None None] MFA Rules not processed for user `f8b31aefa153498e99c11f325838f96b`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:28:16.936721 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-a0f30e74-e1b3-4144-aeb3-3679b40d6fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:16.991605 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1423/2849] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:28:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:28:20.586639 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe86c1-a3f4-4b76-9ca1-178514c0b48f None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:20.587171 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe86c1-a3f4-4b76-9ca1-178514c0b48f None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:20.587171 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe86c1-a3f4-4b76-9ca1-178514c0b48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:20.606799 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-dabe86c1-a3f4-4b76-9ca1-178514c0b48f None None] MFA Rules not processed for user `970300b51d504a2bbc48158855f02f34`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:28:20.608025 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-dabe86c1-a3f4-4b76-9ca1-178514c0b48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:20.675125 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1427/2850] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 23 08:28:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:28:20.683381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f30e74-e1b3-4144-aeb3-3679b40d6fc8 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:20.685219 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-a0f30e74-e1b3-4144-aeb3-3679b40d6fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:20.738835 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:28:20.767911 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f30e74-e1b3-4144-aeb3-3679b40d6fc8 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:20.773659 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bbff35-06f8-4a5b-a82f-26853675c861 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4718cad0c0b9461d9c4152d7ea4b385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:20.774263 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbff35-06f8-4a5b-a82f-26853675c861 service swift] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:20.774575 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbff35-06f8-4a5b-a82f-26853675c861 service swift] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:20.774850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbff35-06f8-4a5b-a82f-26853675c861 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:20.782941 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bbff35-06f8-4a5b-a82f-26853675c861 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:20.784589 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bbff35-06f8-4a5b-a82f-26853675c861 service swift] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:20.792477 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1424/2851] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 23 08:28:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 08:28:29.398608 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe86c1-a3f4-4b76-9ca1-178514c0b48f None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:29.400335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-dabe86c1-a3f4-4b76-9ca1-178514c0b48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:29.415976 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:28:29.473292 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe86c1-a3f4-4b76-9ca1-178514c0b48f None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:29.479007 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634387e-e8af-46e6-9453-737be736a970 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e92560dd9da4c7cbcac5a84bcaca483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:29.479609 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634387e-e8af-46e6-9453-737be736a970 service placement] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:29.479892 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634387e-e8af-46e6-9453-737be736a970 service placement] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:29.480166 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634387e-e8af-46e6-9453-737be736a970 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:29.481871 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-f634387e-e8af-46e6-9453-737be736a970 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:29.497375 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f634387e-e8af-46e6-9453-737be736a970 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:29.499068 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f634387e-e8af-46e6-9453-737be736a970 service placement] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:29.510642 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1428/2852] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:28:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:28:30.271355 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bbff35-06f8-4a5b-a82f-26853675c861 service swift] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:30.273628 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-a1bbff35-06f8-4a5b-a82f-26853675c861 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:30.344230 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bbff35-06f8-4a5b-a82f-26853675c861 service swift] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:30.348893 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976af86-4fe1-41a5-beeb-95e4b7bab6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:30.350207 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976af86-4fe1-41a5-beeb-95e4b7bab6e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:30.350522 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976af86-4fe1-41a5-beeb-95e4b7bab6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:30.350747 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976af86-4fe1-41a5-beeb-95e4b7bab6e2 admin admin] PATH_INFO: `/v3/users/d7cfb25ea3464fe1be53dbeacbbba931` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:30.351689 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976af86-4fe1-41a5-beeb-95e4b7bab6e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7cfb25ea3464fe1be53dbeacbbba931)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:30.353607 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976af86-4fe1-41a5-beeb-95e4b7bab6e2 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:30.563515 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-4976af86-4fe1-41a5-beeb-95e4b7bab6e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7cfb25ea3464fe1be53dbeacbbba931'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:30.564187 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-4976af86-4fe1-41a5-beeb-95e4b7bab6e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7cfb25ea3464fe1be53dbeacbbba931'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:30.564786 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-4976af86-4fe1-41a5-beeb-95e4b7bab6e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7cfb25ea3464fe1be53dbeacbbba931'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:30.675349 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-4976af86-4fe1-41a5-beeb-95e4b7bab6e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7cfb25ea3464fe1be53dbeacbbba931'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:30.688059 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-4976af86-4fe1-41a5-beeb-95e4b7bab6e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7cfb25ea3464fe1be53dbeacbbba931'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:30.700495 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1425/2853] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:28:30 2022] DELETE /identity/v3/users/d7cfb25ea3464fe1be53dbeacbbba931 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:28:30.946134 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634387e-e8af-46e6-9453-737be736a970 service placement] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:30.960617 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634387e-e8af-46e6-9453-737be736a970 service placement] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:31.020246 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41063cc9-96f5-41b3-8386-ba3f63dfc557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:31.020876 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41063cc9-96f5-41b3-8386-ba3f63dfc557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:31.021155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41063cc9-96f5-41b3-8386-ba3f63dfc557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:31.021571 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41063cc9-96f5-41b3-8386-ba3f63dfc557 admin admin] PATH_INFO: `/v3/projects/2e3d1230dea64876b0c0ecc1ab44410b` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:31.023384 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41063cc9-96f5-41b3-8386-ba3f63dfc557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e3d1230dea64876b0c0ecc1ab44410b)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:31.025288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41063cc9-96f5-41b3-8386-ba3f63dfc557 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:31.127155 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-41063cc9-96f5-41b3-8386-ba3f63dfc557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e3d1230dea64876b0c0ecc1ab44410b', 'request_id': 'req-41063cc9-96f5-41b3-8386-ba3f63dfc557'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:31.133341 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-41063cc9-96f5-41b3-8386-ba3f63dfc557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e3d1230dea64876b0c0ecc1ab44410b', 'request_id': 'req-41063cc9-96f5-41b3-8386-ba3f63dfc557'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:31.139450 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-41063cc9-96f5-41b3-8386-ba3f63dfc557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e3d1230dea64876b0c0ecc1ab44410b', 'request_id': 'req-41063cc9-96f5-41b3-8386-ba3f63dfc557'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:31.234151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-41063cc9-96f5-41b3-8386-ba3f63dfc557 admin admin] The token cache is being invalidate because project 2e3d1230dea64876b0c0ecc1ab44410b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:28:31.234476 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-41063cc9-96f5-41b3-8386-ba3f63dfc557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:31.235091 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-41063cc9-96f5-41b3-8386-ba3f63dfc557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:31.236591 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1429/2854] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:28:30 2022] DELETE /identity/v3/projects/2e3d1230dea64876b0c0ecc1ab44410b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 08:28:31.240559 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976af86-4fe1-41a5-beeb-95e4b7bab6e2 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:31.245748 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-4976af86-4fe1-41a5-beeb-95e4b7bab6e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:31.254901 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976af86-4fe1-41a5-beeb-95e4b7bab6e2 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:31.300336 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:28:31.313408 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24547c8-e75c-46f9-9c82-5b40a522d580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:31.314062 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24547c8-e75c-46f9-9c82-5b40a522d580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:31.314381 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24547c8-e75c-46f9-9c82-5b40a522d580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:31.314658 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24547c8-e75c-46f9-9c82-5b40a522d580 admin admin] PATH_INFO: `/v3/users/451456fe011f4644a401f394b9c23fc0` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:31.315811 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24547c8-e75c-46f9-9c82-5b40a522d580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=451456fe011f4644a401f394b9c23fc0)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:31.317721 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24547c8-e75c-46f9-9c82-5b40a522d580 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:31.516769 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f24547c8-e75c-46f9-9c82-5b40a522d580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '451456fe011f4644a401f394b9c23fc0'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:31.517331 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f24547c8-e75c-46f9-9c82-5b40a522d580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '451456fe011f4644a401f394b9c23fc0'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:31.517931 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f24547c8-e75c-46f9-9c82-5b40a522d580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '451456fe011f4644a401f394b9c23fc0'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:31.594933 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f24547c8-e75c-46f9-9c82-5b40a522d580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '451456fe011f4644a401f394b9c23fc0'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:31.607500 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-f24547c8-e75c-46f9-9c82-5b40a522d580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '451456fe011f4644a401f394b9c23fc0'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:31.620999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1426/2855] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:28:31 2022] DELETE /identity/v3/users/451456fe011f4644a401f394b9c23fc0 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:28:31.899812 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41063cc9-96f5-41b3-8386-ba3f63dfc557 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:31.901263 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-41063cc9-96f5-41b3-8386-ba3f63dfc557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:31.915164 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41063cc9-96f5-41b3-8386-ba3f63dfc557 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:31.949379 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:28:31.976393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a0e75-74fc-4552-bb8f-fc0974f35e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:31.977068 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a0e75-74fc-4552-bb8f-fc0974f35e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:31.977366 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a0e75-74fc-4552-bb8f-fc0974f35e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:31.977753 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a0e75-74fc-4552-bb8f-fc0974f35e5c admin admin] PATH_INFO: `/v3/projects/cfce43cd6e324ad3aa33794e56e03028` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:31.978893 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a0e75-74fc-4552-bb8f-fc0974f35e5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfce43cd6e324ad3aa33794e56e03028)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:31.982151 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a0e75-74fc-4552-bb8f-fc0974f35e5c admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:32.138266 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ff6a0e75-74fc-4552-bb8f-fc0974f35e5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfce43cd6e324ad3aa33794e56e03028', 'request_id': 'req-ff6a0e75-74fc-4552-bb8f-fc0974f35e5c'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:32.143729 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ff6a0e75-74fc-4552-bb8f-fc0974f35e5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfce43cd6e324ad3aa33794e56e03028', 'request_id': 'req-ff6a0e75-74fc-4552-bb8f-fc0974f35e5c'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:32.149739 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ff6a0e75-74fc-4552-bb8f-fc0974f35e5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfce43cd6e324ad3aa33794e56e03028', 'request_id': 'req-ff6a0e75-74fc-4552-bb8f-fc0974f35e5c'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:32.218117 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ff6a0e75-74fc-4552-bb8f-fc0974f35e5c admin admin] The token cache is being invalidate because project cfce43cd6e324ad3aa33794e56e03028 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:28:32.218466 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ff6a0e75-74fc-4552-bb8f-fc0974f35e5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:32.219112 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-ff6a0e75-74fc-4552-bb8f-fc0974f35e5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:32.220796 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1430/2856] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:28:31 2022] DELETE /identity/v3/projects/cfce43cd6e324ad3aa33794e56e03028 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:28:32.226136 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156babc-4dca-483a-807e-487860d78b2f None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:32.226447 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156babc-4dca-483a-807e-487860d78b2f None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:32.226696 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156babc-4dca-483a-807e-487860d78b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:32.246884 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-0156babc-4dca-483a-807e-487860d78b2f None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:28:32.248134 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-0156babc-4dca-483a-807e-487860d78b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:32.307057 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1427/2857] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:28:32.314715 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d685e-6d33-40aa-9dfe-5f2b4ccaef60 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:32.315006 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d685e-6d33-40aa-9dfe-5f2b4ccaef60 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:32.315287 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d685e-6d33-40aa-9dfe-5f2b4ccaef60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:32.335637 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-805d685e-6d33-40aa-9dfe-5f2b4ccaef60 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:28:32.336836 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-805d685e-6d33-40aa-9dfe-5f2b4ccaef60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:32.344618 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1431/2858] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:28:32.348720 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156babc-4dca-483a-807e-487860d78b2f None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:32.358216 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156babc-4dca-483a-807e-487860d78b2f None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:32.362726 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd26abb-d8ba-4dc3-b86f-502427e369c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:32.363310 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd26abb-d8ba-4dc3-b86f-502427e369c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:32.363588 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd26abb-d8ba-4dc3-b86f-502427e369c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:32.363858 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd26abb-d8ba-4dc3-b86f-502427e369c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:32.364490 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd26abb-d8ba-4dc3-b86f-502427e369c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81771) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:28:32.364789 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd26abb-d8ba-4dc3-b86f-502427e369c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:32.366950 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd26abb-d8ba-4dc3-b86f-502427e369c6 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:32.378184 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1428/2859] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:28:32.383178 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d685e-6d33-40aa-9dfe-5f2b4ccaef60 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:32.392309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d685e-6d33-40aa-9dfe-5f2b4ccaef60 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:32.396994 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5438e-9ef8-419b-8f37-1d6dda29a171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:32.397524 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5438e-9ef8-419b-8f37-1d6dda29a171 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:32.397805 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5438e-9ef8-419b-8f37-1d6dda29a171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:32.398077 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5438e-9ef8-419b-8f37-1d6dda29a171 admin admin] PATH_INFO: `/v3/projects` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:32.398730 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5438e-9ef8-419b-8f37-1d6dda29a171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:32.400623 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5438e-9ef8-419b-8f37-1d6dda29a171 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:33.134810 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1432/2860] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:28:32 2022] POST /identity/v3/projects => generated 375 bytes in 752 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:28:33.155094 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd26abb-d8ba-4dc3-b86f-502427e369c6 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:33.155094 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd26abb-d8ba-4dc3-b86f-502427e369c6 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:33.205419 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:28:33.215513 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645313d5-3f1c-4d8a-87d2-cdcb70cbc08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:33.216355 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645313d5-3f1c-4d8a-87d2-cdcb70cbc08b admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:33.216641 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645313d5-3f1c-4d8a-87d2-cdcb70cbc08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:33.216944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645313d5-3f1c-4d8a-87d2-cdcb70cbc08b admin admin] PATH_INFO: `/v3/users` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:33.217591 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645313d5-3f1c-4d8a-87d2-cdcb70cbc08b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:33.219548 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645313d5-3f1c-4d8a-87d2-cdcb70cbc08b admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:33.390042 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1429/2861] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:28:33 2022] POST /identity/v3/users => generated 288 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:28:33.394036 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5438e-9ef8-419b-8f37-1d6dda29a171 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:33.404890 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5438e-9ef8-419b-8f37-1d6dda29a171 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:33.409466 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fc259-87da-4825-8f61-8910ec866e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:33.410058 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fc259-87da-4825-8f61-8910ec866e88 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:33.410372 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fc259-87da-4825-8f61-8910ec866e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:33.410720 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fc259-87da-4825-8f61-8910ec866e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:33.411372 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7fc259-87da-4825-8f61-8910ec866e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:33.413037 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7fc259-87da-4825-8f61-8910ec866e88 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:33.423115 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1433/2862] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:28:33.427204 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645313d5-3f1c-4d8a-87d2-cdcb70cbc08b admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:33.437212 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645313d5-3f1c-4d8a-87d2-cdcb70cbc08b admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:33.441758 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2acf5-f5d1-471b-a157-b54e16f291ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:33.442373 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2acf5-f5d1-471b-a157-b54e16f291ee admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:33.442663 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2acf5-f5d1-471b-a157-b54e16f291ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:33.442939 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2acf5-f5d1-471b-a157-b54e16f291ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:33.444113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2acf5-f5d1-471b-a157-b54e16f291ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:33.446009 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2acf5-f5d1-471b-a157-b54e16f291ee admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:33.457431 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1430/2863] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:28:33.462219 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fc259-87da-4825-8f61-8910ec866e88 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:33.472433 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fc259-87da-4825-8f61-8910ec866e88 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:33.477137 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c3651-e4d9-4a9c-83bc-be369dae2fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:33.477816 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c3651-e4d9-4a9c-83bc-be369dae2fff admin admin] REQUEST_METHOD: `PUT` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:33.478124 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c3651-e4d9-4a9c-83bc-be369dae2fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:33.478443 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c3651-e4d9-4a9c-83bc-be369dae2fff admin admin] PATH_INFO: `/v3/projects/4f74925a477e4561bdf1c111f63c17a9/users/6aed1e504e324e74b5ca082cb5226e83/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:33.493209 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c3651-e4d9-4a9c-83bc-be369dae2fff admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f74925a477e4561bdf1c111f63c17a9, user_id=6aed1e504e324e74b5ca082cb5226e83, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:33.495886 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c3651-e4d9-4a9c-83bc-be369dae2fff admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:33.578261 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1434/2864] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:28:33 2022] PUT /identity/v3/projects/4f74925a477e4561bdf1c111f63c17a9/users/6aed1e504e324e74b5ca082cb5226e83/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:28:33.590930 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384e4e0-f146-4906-a120-c1e8b09017db None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:33.591242 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384e4e0-f146-4906-a120-c1e8b09017db None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:33.591512 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384e4e0-f146-4906-a120-c1e8b09017db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:33.619002 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-b384e4e0-f146-4906-a120-c1e8b09017db None None] MFA Rules not processed for user `6aed1e504e324e74b5ca082cb5226e83`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:28:33.620210 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-b384e4e0-f146-4906-a120-c1e8b09017db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:33.683847 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1431/2865] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:28:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:28:33.695524 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c3651-e4d9-4a9c-83bc-be369dae2fff admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:33.697468 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-5a5c3651-e4d9-4a9c-83bc-be369dae2fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:33.753008 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c3651-e4d9-4a9c-83bc-be369dae2fff admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:33.757437 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c81e2e-b321-48d6-9661-fb7b98088bcb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f4ee9c3c5be48699a24dfce9b30bda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:33.758038 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c81e2e-b321-48d6-9661-fb7b98088bcb service glance] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:33.758342 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c81e2e-b321-48d6-9661-fb7b98088bcb service glance] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:33.758621 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c81e2e-b321-48d6-9661-fb7b98088bcb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:33.766741 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c81e2e-b321-48d6-9661-fb7b98088bcb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:33.768170 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c81e2e-b321-48d6-9661-fb7b98088bcb service glance] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:33.772853 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:28:33.777627 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1435/2866] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:28:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:28:43.681012 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:28:48.670167 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384e4e0-f146-4906-a120-c1e8b09017db None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:48.671602 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-b384e4e0-f146-4906-a120-c1e8b09017db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:48.727970 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384e4e0-f146-4906-a120-c1e8b09017db None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:48.731486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be247999-198e-49d3-b93a-911e63074baa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:48.732080 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be247999-198e-49d3-b93a-911e63074baa service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:48.732359 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be247999-198e-49d3-b93a-911e63074baa service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:48.732632 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be247999-198e-49d3-b93a-911e63074baa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:48.734337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-be247999-198e-49d3-b93a-911e63074baa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:48.795756 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be247999-198e-49d3-b93a-911e63074baa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:48.797194 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be247999-198e-49d3-b93a-911e63074baa service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:48.806654 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1432/2867] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:28:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:28:54.129500 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c81e2e-b321-48d6-9661-fb7b98088bcb service glance] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:54.206565 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c81e2e-b321-48d6-9661-fb7b98088bcb service glance] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:54.211453 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327b854-be77-41a1-8ada-dab2e7b3e931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:54.212090 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327b854-be77-41a1-8ada-dab2e7b3e931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:54.213043 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327b854-be77-41a1-8ada-dab2e7b3e931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:54.213315 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327b854-be77-41a1-8ada-dab2e7b3e931 admin admin] PATH_INFO: `/v3/users/6aed1e504e324e74b5ca082cb5226e83` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:54.214983 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327b854-be77-41a1-8ada-dab2e7b3e931 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aed1e504e324e74b5ca082cb5226e83)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:54.217198 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327b854-be77-41a1-8ada-dab2e7b3e931 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:54.405653 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-0327b854-be77-41a1-8ada-dab2e7b3e931 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aed1e504e324e74b5ca082cb5226e83'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:54.406335 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-0327b854-be77-41a1-8ada-dab2e7b3e931 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aed1e504e324e74b5ca082cb5226e83'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:54.406951 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-0327b854-be77-41a1-8ada-dab2e7b3e931 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aed1e504e324e74b5ca082cb5226e83'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:54.492824 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-0327b854-be77-41a1-8ada-dab2e7b3e931 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aed1e504e324e74b5ca082cb5226e83'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:54.500529 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-0327b854-be77-41a1-8ada-dab2e7b3e931 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aed1e504e324e74b5ca082cb5226e83'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:54.518809 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1436/2868] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:28:54 2022] DELETE /identity/v3/users/6aed1e504e324e74b5ca082cb5226e83 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:28:54.523331 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02bdee-5534-4ed6-ba79-8390d86ce029 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:54.523802 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02bdee-5534-4ed6-ba79-8390d86ce029 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:54.523930 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02bdee-5534-4ed6-ba79-8390d86ce029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:54.544494 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-9e02bdee-5534-4ed6-ba79-8390d86ce029 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:28:54.545698 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-9e02bdee-5534-4ed6-ba79-8390d86ce029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:54.606739 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1433/2869] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:28:54.616330 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327b854-be77-41a1-8ada-dab2e7b3e931 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:54.617745 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-0327b854-be77-41a1-8ada-dab2e7b3e931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:54.677552 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327b854-be77-41a1-8ada-dab2e7b3e931 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:54.681759 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd240d7-bc28-4253-a6e6-442565f95af2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:54.682400 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd240d7-bc28-4253-a6e6-442565f95af2 service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:54.682687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd240d7-bc28-4253-a6e6-442565f95af2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:54.682964 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd240d7-bc28-4253-a6e6-442565f95af2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:54.692024 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd240d7-bc28-4253-a6e6-442565f95af2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:54.693461 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd240d7-bc28-4253-a6e6-442565f95af2 service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:54.704082 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1437/2870] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:28:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:28:55.114046 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02bdee-5534-4ed6-ba79-8390d86ce029 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:55.116628 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-9e02bdee-5534-4ed6-ba79-8390d86ce029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:55.136337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02bdee-5534-4ed6-ba79-8390d86ce029 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:55.141387 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf491ada-ec33-41a8-95bb-b66cd70ba270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:55.142113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf491ada-ec33-41a8-95bb-b66cd70ba270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:55.142478 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf491ada-ec33-41a8-95bb-b66cd70ba270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:55.142808 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf491ada-ec33-41a8-95bb-b66cd70ba270 admin admin] PATH_INFO: `/v3/projects/4f74925a477e4561bdf1c111f63c17a9` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:55.144057 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf491ada-ec33-41a8-95bb-b66cd70ba270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f74925a477e4561bdf1c111f63c17a9)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:55.146483 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf491ada-ec33-41a8-95bb-b66cd70ba270 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:55.273072 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:28:55.276437 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-cf491ada-ec33-41a8-95bb-b66cd70ba270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f74925a477e4561bdf1c111f63c17a9', 'request_id': 'req-cf491ada-ec33-41a8-95bb-b66cd70ba270'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:55.282000 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-cf491ada-ec33-41a8-95bb-b66cd70ba270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f74925a477e4561bdf1c111f63c17a9', 'request_id': 'req-cf491ada-ec33-41a8-95bb-b66cd70ba270'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:55.288267 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-cf491ada-ec33-41a8-95bb-b66cd70ba270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f74925a477e4561bdf1c111f63c17a9', 'request_id': 'req-cf491ada-ec33-41a8-95bb-b66cd70ba270'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:55.360553 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-cf491ada-ec33-41a8-95bb-b66cd70ba270 admin admin] The token cache is being invalidate because project 4f74925a477e4561bdf1c111f63c17a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81771) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:28:55.360835 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-cf491ada-ec33-41a8-95bb-b66cd70ba270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:55.361443 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-cf491ada-ec33-41a8-95bb-b66cd70ba270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:28:55.362981 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1434/2871] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:28:55 2022] DELETE /identity/v3/projects/4f74925a477e4561bdf1c111f63c17a9 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:28:55.367754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6067d-80e6-4a88-a0fb-0f4b27f1c20b None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:55.368239 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6067d-80e6-4a88-a0fb-0f4b27f1c20b None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:55.368398 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6067d-80e6-4a88-a0fb-0f4b27f1c20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:55.387922 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-2bd6067d-80e6-4a88-a0fb-0f4b27f1c20b None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:28:55.389158 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-2bd6067d-80e6-4a88-a0fb-0f4b27f1c20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:55.406094 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:28:55.447901 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1438/2872] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:28:55.455505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4985f82-ec68-4cbd-9e91-f3b0a559963a None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:55.455791 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4985f82-ec68-4cbd-9e91-f3b0a559963a None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:55.456065 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4985f82-ec68-4cbd-9e91-f3b0a559963a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:55.476047 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-b4985f82-ec68-4cbd-9e91-f3b0a559963a None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:28:55.477235 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-b4985f82-ec68-4cbd-9e91-f3b0a559963a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:55.485726 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1435/2873] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:28:55.489493 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6067d-80e6-4a88-a0fb-0f4b27f1c20b None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:55.499060 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6067d-80e6-4a88-a0fb-0f4b27f1c20b None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:55.503790 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bc7e2-8916-4edf-bacb-da4f18316181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:55.504391 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bc7e2-8916-4edf-bacb-da4f18316181 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:55.504673 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bc7e2-8916-4edf-bacb-da4f18316181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:55.504944 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bc7e2-8916-4edf-bacb-da4f18316181 admin admin] PATH_INFO: `/v3/domains` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:55.505578 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bc7e2-8916-4edf-bacb-da4f18316181 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81770) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 08:28:55.505960 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bc7e2-8916-4edf-bacb-da4f18316181 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:55.507596 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bc7e2-8916-4edf-bacb-da4f18316181 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:55.519875 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1439/2874] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 23 08:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 08:28:55.524264 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4985f82-ec68-4cbd-9e91-f3b0a559963a None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:55.534569 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4985f82-ec68-4cbd-9e91-f3b0a559963a None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:55.539305 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280cc64-919e-46cd-b549-b8cfd792c243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:55.539901 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280cc64-919e-46cd-b549-b8cfd792c243 admin admin] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:55.540181 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280cc64-919e-46cd-b549-b8cfd792c243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:55.540459 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280cc64-919e-46cd-b549-b8cfd792c243 admin admin] PATH_INFO: `/v3/projects` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:55.541344 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280cc64-919e-46cd-b549-b8cfd792c243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:55.543328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280cc64-919e-46cd-b549-b8cfd792c243 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:55.672463 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1436/2875] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 23 08:28:55 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:28:55.676588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bc7e2-8916-4edf-bacb-da4f18316181 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:55.687319 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bc7e2-8916-4edf-bacb-da4f18316181 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:55.742063 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b947c0-3f06-426e-b744-a6bf4bc47681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:55.742602 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b947c0-3f06-426e-b744-a6bf4bc47681 admin admin] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:55.742881 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b947c0-3f06-426e-b744-a6bf4bc47681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:55.743157 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b947c0-3f06-426e-b744-a6bf4bc47681 admin admin] PATH_INFO: `/v3/users` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:55.744393 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b947c0-3f06-426e-b744-a6bf4bc47681 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:55.746302 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b947c0-3f06-426e-b744-a6bf4bc47681 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:55.876652 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1440/2876] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 23 08:28:55 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 08:28:55.880770 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280cc64-919e-46cd-b549-b8cfd792c243 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:55.892448 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280cc64-919e-46cd-b549-b8cfd792c243 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:55.897534 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c09ab-21c9-4046-82e8-e75257f86328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:55.898165 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c09ab-21c9-4046-82e8-e75257f86328 admin admin] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:55.898489 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c09ab-21c9-4046-82e8-e75257f86328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:55.898765 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c09ab-21c9-4046-82e8-e75257f86328 admin admin] PATH_INFO: `/v3/roles` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:55.899434 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c09ab-21c9-4046-82e8-e75257f86328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:55.901508 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c09ab-21c9-4046-82e8-e75257f86328 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:55.911956 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1437/2877] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:28:55.916436 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b947c0-3f06-426e-b744-a6bf4bc47681 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:55.926674 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b947c0-3f06-426e-b744-a6bf4bc47681 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:55.931930 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5e242-e0c7-49f4-9aa9-db03018366a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:55.932502 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5e242-e0c7-49f4-9aa9-db03018366a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:55.932781 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5e242-e0c7-49f4-9aa9-db03018366a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:55.933049 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5e242-e0c7-49f4-9aa9-db03018366a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:55.933674 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5e242-e0c7-49f4-9aa9-db03018366a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:55.935323 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5e242-e0c7-49f4-9aa9-db03018366a7 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:55.945887 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1441/2878] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 23 08:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 08:28:55.951226 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c09ab-21c9-4046-82e8-e75257f86328 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:55.961306 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c09ab-21c9-4046-82e8-e75257f86328 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:55.966113 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63b64a-a5d7-4962-bd95-027107c5c428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:55.966796 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63b64a-a5d7-4962-bd95-027107c5c428 admin admin] REQUEST_METHOD: `PUT` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:55.967079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63b64a-a5d7-4962-bd95-027107c5c428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:55.967355 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63b64a-a5d7-4962-bd95-027107c5c428 admin admin] PATH_INFO: `/v3/projects/84b0b32cd85442808e1299cf33a918d9/users/298953a41da542f885820102d229cbf4/roles/4ed852223bc54be09a9487ff788b7644` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:55.982112 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63b64a-a5d7-4962-bd95-027107c5c428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84b0b32cd85442808e1299cf33a918d9, user_id=298953a41da542f885820102d229cbf4, role_id=4ed852223bc54be09a9487ff788b7644)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:55.984839 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63b64a-a5d7-4962-bd95-027107c5c428 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:56.106310 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1438/2879] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 23 08:28:55 2022] PUT /identity/v3/projects/84b0b32cd85442808e1299cf33a918d9/users/298953a41da542f885820102d229cbf4/roles/4ed852223bc54be09a9487ff788b7644 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:28:56.111435 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b7f41-9974-451a-866f-cf44a4e4bf9f None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:56.111726 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b7f41-9974-451a-866f-cf44a4e4bf9f None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:56.112004 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b7f41-9974-451a-866f-cf44a4e4bf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:56.130943 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-456b7f41-9974-451a-866f-cf44a4e4bf9f None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:28:56.132306 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-456b7f41-9974-451a-866f-cf44a4e4bf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:56.190767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1442/2880] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:28:56.201173 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63b64a-a5d7-4962-bd95-027107c5c428 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:56.202927 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-1e63b64a-a5d7-4962-bd95-027107c5c428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:56.260068 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63b64a-a5d7-4962-bd95-027107c5c428 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:56.264099 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f653d-52d7-4ab8-bc42-69db404dda83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:56.264717 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f653d-52d7-4ab8-bc42-69db404dda83 service neutron] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:56.264993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f653d-52d7-4ab8-bc42-69db404dda83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:56.265262 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f653d-52d7-4ab8-bc42-69db404dda83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:56.274857 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f653d-52d7-4ab8-bc42-69db404dda83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:56.276845 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f653d-52d7-4ab8-bc42-69db404dda83 service neutron] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:56.286222 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1439/2881] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:28:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:28:57.483795 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2afa9-b60d-47bb-8563-808934a9ab68 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:57.484338 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2afa9-b60d-47bb-8563-808934a9ab68 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:57.484338 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2afa9-b60d-47bb-8563-808934a9ab68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:57.516012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-eeb2afa9-b60d-47bb-8563-808934a9ab68 None None] MFA Rules not processed for user `298953a41da542f885820102d229cbf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:28:57.517887 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-eeb2afa9-b60d-47bb-8563-808934a9ab68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:57.537578 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:28:57.595845 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1443/2882] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:28:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 08:28:57.607300 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f653d-52d7-4ab8-bc42-69db404dda83 service neutron] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:28:57.608758 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-111f653d-52d7-4ab8-bc42-69db404dda83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:28:57.675999 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f653d-52d7-4ab8-bc42-69db404dda83 service neutron] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:28:57.680337 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb2d9c-94d9-4403-b98f-88097c5366c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e2f6c4d8f4798a5fa271bb0b0154b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:28:57.680944 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb2d9c-94d9-4403-b98f-88097c5366c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:28:57.681989 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb2d9c-94d9-4403-b98f-88097c5366c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:28:57.682373 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb2d9c-94d9-4403-b98f-88097c5366c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:28:57.691101 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb2d9c-94d9-4403-b98f-88097c5366c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:28:57.692604 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb2d9c-94d9-4403-b98f-88097c5366c6 service cinder] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:28:57.704401 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1440/2883] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:28:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:29:00.544278 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60ac1b-bf7d-4fe7-96d4-66adee7e50d4 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:29:00.544838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60ac1b-bf7d-4fe7-96d4-66adee7e50d4 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:29:00.544838 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60ac1b-bf7d-4fe7-96d4-66adee7e50d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:29:00.563718 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-8d60ac1b-bf7d-4fe7-96d4-66adee7e50d4 None None] MFA Rules not processed for user `298953a41da542f885820102d229cbf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:29:00.564925 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-8d60ac1b-bf7d-4fe7-96d4-66adee7e50d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:29:00.572288 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1444/2884] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:29:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:29:07.698794 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:DELETE=4,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:29:10.559012 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=22 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:29:37.752486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a024b2-22b5-447f-a4a9-3910ae032b90 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:29:37.753015 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a024b2-22b5-447f-a4a9-3910ae032b90 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:29:37.753015 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a024b2-22b5-447f-a4a9-3910ae032b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:29:37.772621 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-92a024b2-22b5-447f-a4a9-3910ae032b90 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:29:37.773818 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-92a024b2-22b5-447f-a4a9-3910ae032b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:29:37.781505 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1441/2885] 10.222.0.40 () {58 vars in 1016 bytes} [Tue Aug 23 08:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:29:37.804356 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60ac1b-bf7d-4fe7-96d4-66adee7e50d4 None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:29:37.805729 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-8d60ac1b-bf7d-4fe7-96d4-66adee7e50d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:29:37.879272 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60ac1b-bf7d-4fe7-96d4-66adee7e50d4 None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:29:37.884692 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e33e7-8fe6-44a2-ac4e-7724a89922bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:29:37.885312 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e33e7-8fe6-44a2-ac4e-7724a89922bd service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:29:37.885588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e33e7-8fe6-44a2-ac4e-7724a89922bd service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:29:37.885857 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e33e7-8fe6-44a2-ac4e-7724a89922bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:29:37.893798 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e33e7-8fe6-44a2-ac4e-7724a89922bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:29:37.895424 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e33e7-8fe6-44a2-ac4e-7724a89922bd service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:29:37.904655 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1445/2886] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:29:43.141959 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36fc2c-4b34-4b00-bd28-6ed6bc0bc72b None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:29:43.142548 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36fc2c-4b34-4b00-bd28-6ed6bc0bc72b None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:29:43.142548 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36fc2c-4b34-4b00-bd28-6ed6bc0bc72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:29:43.165585 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-7e36fc2c-4b34-4b00-bd28-6ed6bc0bc72b None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:29:43.166813 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-7e36fc2c-4b34-4b00-bd28-6ed6bc0bc72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:29:43.174611 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1442/2887] 10.222.0.40 () {58 vars in 1016 bytes} [Tue Aug 23 08:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:29:43.198479 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e33e7-8fe6-44a2-ac4e-7724a89922bd service nova] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:29:43.200260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-d06e33e7-8fe6-44a2-ac4e-7724a89922bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:29:43.214969 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e33e7-8fe6-44a2-ac4e-7724a89922bd service nova] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:29:43.220872 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4bbd9-530c-485e-940b-25ad45f70f5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:29:43.221496 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4bbd9-530c-485e-940b-25ad45f70f5a service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:29:43.221774 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4bbd9-530c-485e-940b-25ad45f70f5a service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:29:43.222047 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4bbd9-530c-485e-940b-25ad45f70f5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:29:43.231879 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4bbd9-530c-485e-940b-25ad45f70f5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:29:43.233600 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4bbd9-530c-485e-940b-25ad45f70f5a service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:29:43.246413 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1446/2888] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:29:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:29:47.737521 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef3c5e-d75d-439d-8583-376bac3285b4 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:29:47.738055 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef3c5e-d75d-439d-8583-376bac3285b4 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:29:47.738227 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef3c5e-d75d-439d-8583-376bac3285b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:29:47.757741 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-edef3c5e-d75d-439d-8583-376bac3285b4 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:29:47.758968 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-edef3c5e-d75d-439d-8583-376bac3285b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:29:47.766700 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1443/2889] 10.222.0.40 () {58 vars in 1016 bytes} [Tue Aug 23 08:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:29:47.787169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4bbd9-530c-485e-940b-25ad45f70f5a service nova] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:29:47.798400 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4bbd9-530c-485e-940b-25ad45f70f5a service nova] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:29:47.804535 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f51a8-ce94-4810-abd5-1fc59dafabc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:29:47.805130 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f51a8-ce94-4810-abd5-1fc59dafabc6 service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:29:47.805411 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f51a8-ce94-4810-abd5-1fc59dafabc6 service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:29:47.805688 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f51a8-ce94-4810-abd5-1fc59dafabc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:29:47.813895 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f51a8-ce94-4810-abd5-1fc59dafabc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:29:47.815544 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f51a8-ce94-4810-abd5-1fc59dafabc6 service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:29:47.824901 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1447/2890] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:29:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:29:51.730500 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e42b47-384d-4d8f-a60e-233e772ac009 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:29:51.730991 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e42b47-384d-4d8f-a60e-233e772ac009 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:29:51.731119 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e42b47-384d-4d8f-a60e-233e772ac009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:29:51.749850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-d8e42b47-384d-4d8f-a60e-233e772ac009 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:29:51.751073 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-d8e42b47-384d-4d8f-a60e-233e772ac009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:29:51.758880 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1444/2891] 10.222.0.40 () {58 vars in 1016 bytes} [Tue Aug 23 08:29:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:29:51.779401 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f51a8-ce94-4810-abd5-1fc59dafabc6 service nova] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:29:51.791302 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f51a8-ce94-4810-abd5-1fc59dafabc6 service nova] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:29:51.796630 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6492ae4-3287-4d22-a83b-3ec2f5ac5563 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:29:51.797214 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6492ae4-3287-4d22-a83b-3ec2f5ac5563 service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:29:51.797489 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6492ae4-3287-4d22-a83b-3ec2f5ac5563 service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:29:51.797757 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6492ae4-3287-4d22-a83b-3ec2f5ac5563 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:29:51.805690 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6492ae4-3287-4d22-a83b-3ec2f5ac5563 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:29:51.807327 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6492ae4-3287-4d22-a83b-3ec2f5ac5563 service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:29:51.816407 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1448/2892] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:29:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:29:56.018862 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b975d9-3296-4443-9c16-74925a213528 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:29:56.019374 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b975d9-3296-4443-9c16-74925a213528 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:29:56.019476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b975d9-3296-4443-9c16-74925a213528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:29:56.038800 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-86b975d9-3296-4443-9c16-74925a213528 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:29:56.039982 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-86b975d9-3296-4443-9c16-74925a213528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:29:56.047765 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1445/2893] 10.222.0.40 () {58 vars in 1016 bytes} [Tue Aug 23 08:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:29:56.073121 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6492ae4-3287-4d22-a83b-3ec2f5ac5563 service nova] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:29:56.085159 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6492ae4-3287-4d22-a83b-3ec2f5ac5563 service nova] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:29:56.090575 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb8fd2-deb6-450e-af1f-7af9d91af5ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:29:56.091169 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb8fd2-deb6-450e-af1f-7af9d91af5ce service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:29:56.091446 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb8fd2-deb6-450e-af1f-7af9d91af5ce service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:29:56.091718 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb8fd2-deb6-450e-af1f-7af9d91af5ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:29:56.099657 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb8fd2-deb6-450e-af1f-7af9d91af5ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:29:56.101347 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb8fd2-deb6-450e-af1f-7af9d91af5ce service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:29:56.110883 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1449/2894] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:29:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:30:00.255605 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764cfbe-11a7-43bb-9f12-c38f660e6e25 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:30:00.256218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764cfbe-11a7-43bb-9f12-c38f660e6e25 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:30:00.256218 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764cfbe-11a7-43bb-9f12-c38f660e6e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:30:00.263898 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=16 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:30:00.276915 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-2764cfbe-11a7-43bb-9f12-c38f660e6e25 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:30:00.278104 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-2764cfbe-11a7-43bb-9f12-c38f660e6e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:30:00.285786 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1446/2895] 10.222.0.40 () {58 vars in 1016 bytes} [Tue Aug 23 08:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:30:00.307089 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb8fd2-deb6-450e-af1f-7af9d91af5ce service nova] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:30:00.318137 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb8fd2-deb6-450e-af1f-7af9d91af5ce service nova] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:30:00.324235 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80293244-e98a-4bb4-a786-6e80773ca730 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:30:00.324822 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80293244-e98a-4bb4-a786-6e80773ca730 service nova] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:30:00.325098 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80293244-e98a-4bb4-a786-6e80773ca730 service nova] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:30:00.325368 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80293244-e98a-4bb4-a786-6e80773ca730 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:30:00.333448 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80293244-e98a-4bb4-a786-6e80773ca730 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:30:00.335040 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80293244-e98a-4bb4-a786-6e80773ca730 service nova] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:30:00.345929 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1450/2896] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:30:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:30:10.290445 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:30:10.341606 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=64 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:30:17.316820 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcbb45-2264-4fa9-916b-38b8a5b55845 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:30:17.317356 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcbb45-2264-4fa9-916b-38b8a5b55845 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:30:17.317476 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcbb45-2264-4fa9-916b-38b8a5b55845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:30:17.336781 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-86bcbb45-2264-4fa9-916b-38b8a5b55845 None None] MFA Rules not processed for user `298953a41da542f885820102d229cbf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:30:17.338570 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-86bcbb45-2264-4fa9-916b-38b8a5b55845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:30:17.345514 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1447/2897] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 23 08:30:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:30:17.640130 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80293244-e98a-4bb4-a786-6e80773ca730 service nova] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:30:17.641581 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-80293244-e98a-4bb4-a786-6e80773ca730 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:30:17.655120 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80293244-e98a-4bb4-a786-6e80773ca730 service nova] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:30:17.658798 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ef3e0-dd0f-43c3-877b-15fbe3a576da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4239cee14f954e95b4a6b0af2e8799b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:30:17.659409 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ef3e0-dd0f-43c3-877b-15fbe3a576da service neutron] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:30:17.659707 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ef3e0-dd0f-43c3-877b-15fbe3a576da service neutron] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:30:17.659974 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ef3e0-dd0f-43c3-877b-15fbe3a576da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:30:17.661798 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-f97ef3e0-dd0f-43c3-877b-15fbe3a576da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:30:17.672603 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ef3e0-dd0f-43c3-877b-15fbe3a576da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:30:17.674021 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ef3e0-dd0f-43c3-877b-15fbe3a576da service neutron] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:30:17.682268 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1451/2898] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:30:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:30:27.331456 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=3 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:30:27.678302 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=6 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:30:28.103587 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcbb45-2264-4fa9-916b-38b8a5b55845 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:30:28.116673 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcbb45-2264-4fa9-916b-38b8a5b55845 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:30:28.122190 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27eb419-8190-4819-aed5-cd55eb4d9eb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:30:28.122814 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27eb419-8190-4819-aed5-cd55eb4d9eb1 service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:30:28.123089 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27eb419-8190-4819-aed5-cd55eb4d9eb1 service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:30:28.123358 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27eb419-8190-4819-aed5-cd55eb4d9eb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:30:28.125081 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-b27eb419-8190-4819-aed5-cd55eb4d9eb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:30:28.137834 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27eb419-8190-4819-aed5-cd55eb4d9eb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:30:28.139452 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27eb419-8190-4819-aed5-cd55eb4d9eb1 service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:30:28.150078 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1448/2899] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:30:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:30:36.342405 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040ef26-fbd3-4b2a-8637-30308b8f45be None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:30:36.342987 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040ef26-fbd3-4b2a-8637-30308b8f45be None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:30:36.343099 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040ef26-fbd3-4b2a-8637-30308b8f45be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:30:36.363955 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-9040ef26-fbd3-4b2a-8637-30308b8f45be None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:30:36.365836 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-9040ef26-fbd3-4b2a-8637-30308b8f45be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:30:36.374077 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1452/2900] 10.222.0.40 () {58 vars in 1016 bytes} [Tue Aug 23 08:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:30:36.394702 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27eb419-8190-4819-aed5-cd55eb4d9eb1 service nova] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:30:36.406650 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27eb419-8190-4819-aed5-cd55eb4d9eb1 service nova] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:30:36.412296 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6ccf4-7ddf-471f-a6b5-a031fe45d97c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:30:36.412891 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6ccf4-7ddf-471f-a6b5-a031fe45d97c service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:30:36.413167 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6ccf4-7ddf-471f-a6b5-a031fe45d97c service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:30:36.413439 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6ccf4-7ddf-471f-a6b5-a031fe45d97c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:30:36.423212 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6ccf4-7ddf-471f-a6b5-a031fe45d97c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:30:36.424875 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6ccf4-7ddf-471f-a6b5-a031fe45d97c service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:30:36.434990 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1449/2901] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:30:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:30:40.993835 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84559d-cf21-4444-9c99-9ed664c88925 None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:30:40.994416 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84559d-cf21-4444-9c99-9ed664c88925 None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:30:40.994539 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84559d-cf21-4444-9c99-9ed664c88925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:30:41.015727 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-ea84559d-cf21-4444-9c99-9ed664c88925 None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:30:41.016959 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-ea84559d-cf21-4444-9c99-9ed664c88925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:30:41.025260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1453/2902] 10.222.0.40 () {58 vars in 1016 bytes} [Tue Aug 23 08:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:30:41.047249 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6ccf4-7ddf-471f-a6b5-a031fe45d97c service nova] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:30:41.059666 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6ccf4-7ddf-471f-a6b5-a031fe45d97c service nova] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:30:41.065312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8883137-1061-4095-9f5c-9ecaa477ffa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:30:41.065908 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8883137-1061-4095-9f5c-9ecaa477ffa3 service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:30:41.066184 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8883137-1061-4095-9f5c-9ecaa477ffa3 service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:30:41.066486 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8883137-1061-4095-9f5c-9ecaa477ffa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:30:41.075253 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8883137-1061-4095-9f5c-9ecaa477ffa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:30:41.076850 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8883137-1061-4095-9f5c-9ecaa477ffa3 service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:30:41.087302 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1450/2903] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:30:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:30:44.767934 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754fa71-cd4c-4c73-961a-5d248d783d2f None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:30:44.768419 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754fa71-cd4c-4c73-961a-5d248d783d2f None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:30:44.768532 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754fa71-cd4c-4c73-961a-5d248d783d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:30:44.787333 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-3754fa71-cd4c-4c73-961a-5d248d783d2f None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:30:44.788540 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-3754fa71-cd4c-4c73-961a-5d248d783d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:30:44.797187 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1454/2904] 10.222.0.40 () {58 vars in 1016 bytes} [Tue Aug 23 08:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:30:44.819793 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8883137-1061-4095-9f5c-9ecaa477ffa3 service nova] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:30:44.831369 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8883137-1061-4095-9f5c-9ecaa477ffa3 service nova] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:30:44.836626 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a34413-2944-4c67-be37-85fb187ab672 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:30:44.841891 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a34413-2944-4c67-be37-85fb187ab672 service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:30:44.841891 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a34413-2944-4c67-be37-85fb187ab672 service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:30:44.841891 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a34413-2944-4c67-be37-85fb187ab672 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:30:44.845914 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a34413-2944-4c67-be37-85fb187ab672 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:30:44.847562 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a34413-2944-4c67-be37-85fb187ab672 service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:30:44.857411 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1451/2905] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:30:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:30:49.102394 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b05fb-9443-4b5f-b25e-5787f95b551f None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:30:49.102896 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b05fb-9443-4b5f-b25e-5787f95b551f None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:30:49.103011 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b05fb-9443-4b5f-b25e-5787f95b551f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:30:49.121931 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-444b05fb-9443-4b5f-b25e-5787f95b551f None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:30:49.123154 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-444b05fb-9443-4b5f-b25e-5787f95b551f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:30:49.130835 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1455/2906] 10.222.0.40 () {58 vars in 1016 bytes} [Tue Aug 23 08:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:30:49.159107 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a34413-2944-4c67-be37-85fb187ab672 service nova] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:30:49.170480 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a34413-2944-4c67-be37-85fb187ab672 service nova] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:30:49.175932 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7034ac0-f1ac-49fc-8caf-172c97f29be5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:30:49.176518 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7034ac0-f1ac-49fc-8caf-172c97f29be5 service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:30:49.176800 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7034ac0-f1ac-49fc-8caf-172c97f29be5 service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:30:49.177074 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7034ac0-f1ac-49fc-8caf-172c97f29be5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:30:49.185240 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7034ac0-f1ac-49fc-8caf-172c97f29be5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:30:49.186855 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7034ac0-f1ac-49fc-8caf-172c97f29be5 service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:30:49.196073 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1452/2907] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:30:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:30:53.378107 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd0831-5c92-4a35-adfb-b69c1f89c57f None None] REQUEST_METHOD: `POST` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:30:53.378683 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd0831-5c92-4a35-adfb-b69c1f89c57f None None] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:30:53.378683 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd0831-5c92-4a35-adfb-b69c1f89c57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:30:53.397588 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.auth.core [None req-1bdd0831-5c92-4a35-adfb-b69c1f89c57f None None] MFA Rules not processed for user `168687f5011542bc8d7ca334411c2990`. Rule list: `[]` (Enabled: `True`). {{(pid=81770) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:30:53.398754 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-1bdd0831-5c92-4a35-adfb-b69c1f89c57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:30:53.407341 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1456/2908] 10.222.0.40 () {58 vars in 1016 bytes} [Tue Aug 23 08:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:30:53.430864 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7034ac0-f1ac-49fc-8caf-172c97f29be5 service nova] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:30:53.442741 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7034ac0-f1ac-49fc-8caf-172c97f29be5 service nova] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:30:53.448212 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72015700-abe0-47ab-93b9-b131ab16fe36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:30:53.448883 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72015700-abe0-47ab-93b9-b131ab16fe36 service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:30:53.449163 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72015700-abe0-47ab-93b9-b131ab16fe36 service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:30:53.449420 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72015700-abe0-47ab-93b9-b131ab16fe36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:30:53.457693 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72015700-abe0-47ab-93b9-b131ab16fe36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:30:53.459295 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72015700-abe0-47ab-93b9-b131ab16fe36 service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:30:53.469004 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1453/2909] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:30:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 08:31:03.393030 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=15 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:31:03.464425 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=36 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:31:18.511484 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd0831-5c92-4a35-adfb-b69c1f89c57f None None] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:31:18.512863 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-1bdd0831-5c92-4a35-adfb-b69c1f89c57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:31:18.580937 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd0831-5c92-4a35-adfb-b69c1f89c57f None None] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:31:18.586131 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314725d1-bc6e-45e9-af02-c8aaa6a3b537 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e92560dd9da4c7cbcac5a84bcaca483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:31:18.586765 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314725d1-bc6e-45e9-af02-c8aaa6a3b537 service placement] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:31:18.587047 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314725d1-bc6e-45e9-af02-c8aaa6a3b537 service placement] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:31:18.587321 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314725d1-bc6e-45e9-af02-c8aaa6a3b537 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:31:18.589050 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-314725d1-bc6e-45e9-af02-c8aaa6a3b537 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:31:18.600806 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314725d1-bc6e-45e9-af02-c8aaa6a3b537 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:31:18.602402 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314725d1-bc6e-45e9-af02-c8aaa6a3b537 service placement] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:31:18.612528 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1457/2910] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:31:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:31:27.721973 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72015700-abe0-47ab-93b9-b131ab16fe36 service nova] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:31:27.735751 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72015700-abe0-47ab-93b9-b131ab16fe36 service nova] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:31:27.741481 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ceb0b-a172-4fb1-884b-8d049ad78415 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5c55e5c1cea47f29d378ea457384a31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:31:27.743033 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ceb0b-a172-4fb1-884b-8d049ad78415 service nova] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:31:27.743033 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ceb0b-a172-4fb1-884b-8d049ad78415 service nova] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:31:27.743033 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ceb0b-a172-4fb1-884b-8d049ad78415 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:31:27.746681 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-b08ceb0b-a172-4fb1-884b-8d049ad78415 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:31:27.760593 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ceb0b-a172-4fb1-884b-8d049ad78415 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:31:27.762215 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ceb0b-a172-4fb1-884b-8d049ad78415 service nova] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:31:27.777759 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1454/2911] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:31:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:31:28.607978 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=32 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:31:29.736735 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314725d1-bc6e-45e9-af02-c8aaa6a3b537 service placement] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:31:29.738972 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-314725d1-bc6e-45e9-af02-c8aaa6a3b537 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:31:29.753460 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314725d1-bc6e-45e9-af02-c8aaa6a3b537 service placement] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:31:29.758607 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548808f-e23c-4d35-a8d2-4c81da8f72e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e92560dd9da4c7cbcac5a84bcaca483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:31:29.759217 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548808f-e23c-4d35-a8d2-4c81da8f72e9 service placement] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:31:29.759496 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548808f-e23c-4d35-a8d2-4c81da8f72e9 service placement] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:31:29.759767 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548808f-e23c-4d35-a8d2-4c81da8f72e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:31:29.761486 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-b548808f-e23c-4d35-a8d2-4c81da8f72e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:31:29.774438 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548808f-e23c-4d35-a8d2-4c81da8f72e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:31:29.776029 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548808f-e23c-4d35-a8d2-4c81da8f72e9 service placement] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:31:29.786231 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1458/2912] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:31:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:31:29.849400 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ceb0b-a172-4fb1-884b-8d049ad78415 service nova] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:31:29.860764 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ceb0b-a172-4fb1-884b-8d049ad78415 service nova] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:31:29.865551 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ac2bd-9519-4ff7-bfde-46b787a05d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:31:29.866173 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ac2bd-9519-4ff7-bfde-46b787a05d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:31:29.866493 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ac2bd-9519-4ff7-bfde-46b787a05d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:31:29.866767 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ac2bd-9519-4ff7-bfde-46b787a05d4c admin admin] PATH_INFO: `/v3/users/298953a41da542f885820102d229cbf4` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:31:29.867868 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ac2bd-9519-4ff7-bfde-46b787a05d4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=298953a41da542f885820102d229cbf4)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:31:29.869830 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ac2bd-9519-4ff7-bfde-46b787a05d4c admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:31:30.079565 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-1b2ac2bd-9519-4ff7-bfde-46b787a05d4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '298953a41da542f885820102d229cbf4'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:30.080139 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-1b2ac2bd-9519-4ff7-bfde-46b787a05d4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '298953a41da542f885820102d229cbf4'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:30.080746 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-1b2ac2bd-9519-4ff7-bfde-46b787a05d4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '298953a41da542f885820102d229cbf4'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:30.150957 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-1b2ac2bd-9519-4ff7-bfde-46b787a05d4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '298953a41da542f885820102d229cbf4'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:30.164097 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-1b2ac2bd-9519-4ff7-bfde-46b787a05d4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '298953a41da542f885820102d229cbf4'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:30.176972 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1455/2913] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:31:29 2022] DELETE /identity/v3/users/298953a41da542f885820102d229cbf4 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:31:30.450627 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548808f-e23c-4d35-a8d2-4c81da8f72e9 service placement] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:31:30.462540 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548808f-e23c-4d35-a8d2-4c81da8f72e9 service placement] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:31:30.519885 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e7446-a556-4b88-99c6-986e83079a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:31:30.520599 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e7446-a556-4b88-99c6-986e83079a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:31:30.520880 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e7446-a556-4b88-99c6-986e83079a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:31:30.521152 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e7446-a556-4b88-99c6-986e83079a69 admin admin] PATH_INFO: `/v3/projects/84b0b32cd85442808e1299cf33a918d9` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:31:30.522254 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e7446-a556-4b88-99c6-986e83079a69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84b0b32cd85442808e1299cf33a918d9)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:31:30.524231 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e7446-a556-4b88-99c6-986e83079a69 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:31:30.662660 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-660e7446-a556-4b88-99c6-986e83079a69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84b0b32cd85442808e1299cf33a918d9', 'request_id': 'req-660e7446-a556-4b88-99c6-986e83079a69'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:30.668265 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-660e7446-a556-4b88-99c6-986e83079a69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84b0b32cd85442808e1299cf33a918d9', 'request_id': 'req-660e7446-a556-4b88-99c6-986e83079a69'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:30.681222 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-660e7446-a556-4b88-99c6-986e83079a69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84b0b32cd85442808e1299cf33a918d9', 'request_id': 'req-660e7446-a556-4b88-99c6-986e83079a69'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:30.749866 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-660e7446-a556-4b88-99c6-986e83079a69 admin admin] The token cache is being invalidate because project 84b0b32cd85442808e1299cf33a918d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:31:30.750551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-660e7446-a556-4b88-99c6-986e83079a69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:30.751074 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-660e7446-a556-4b88-99c6-986e83079a69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:30.752640 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1459/2914] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:31:30 2022] DELETE /identity/v3/projects/84b0b32cd85442808e1299cf33a918d9 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:31:36.870963 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf18ab-8c64-4b97-a565-3fce3a097196 None None] REQUEST_METHOD: `POST` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:31:36.871431 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf18ab-8c64-4b97-a565-3fce3a097196 None None] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:31:36.871553 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf18ab-8c64-4b97-a565-3fce3a097196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:31:36.890844 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.auth.core [None req-7eaf18ab-8c64-4b97-a565-3fce3a097196 None None] MFA Rules not processed for user `970300b51d504a2bbc48158855f02f34`. Rule list: `[]` (Enabled: `True`). {{(pid=81771) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 08:31:36.892244 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-7eaf18ab-8c64-4b97-a565-3fce3a097196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:31:36.949984 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1456/2915] 10.222.0.57 () {58 vars in 967 bytes} [Tue Aug 23 08:31:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 08:31:36.992248 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e7446-a556-4b88-99c6-986e83079a69 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:31:36.993659 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-660e7446-a556-4b88-99c6-986e83079a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:31:37.070570 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e7446-a556-4b88-99c6-986e83079a69 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:31:37.075790 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47745ff5-c2b0-405f-a8f0-042f6ca08802 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4718cad0c0b9461d9c4152d7ea4b385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:31:37.076399 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47745ff5-c2b0-405f-a8f0-042f6ca08802 service swift] REQUEST_METHOD: `GET` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:31:37.076686 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47745ff5-c2b0-405f-a8f0-042f6ca08802 service swift] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:31:37.076960 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47745ff5-c2b0-405f-a8f0-042f6ca08802 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:31:37.085687 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47745ff5-c2b0-405f-a8f0-042f6ca08802 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:31:37.087326 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47745ff5-c2b0-405f-a8f0-042f6ca08802 service swift] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:31:37.095188 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1460/2916] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 23 08:31:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 08:31:45.194870 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf18ab-8c64-4b97-a565-3fce3a097196 None None] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:31:45.196385 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-7eaf18ab-8c64-4b97-a565-3fce3a097196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:31:45.262280 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf18ab-8c64-4b97-a565-3fce3a097196 None None] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:31:45.266708 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9345165-ee4d-4d5d-a4bf-eb01238570fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:31:45.267332 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9345165-ee4d-4d5d-a4bf-eb01238570fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:31:45.267664 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9345165-ee4d-4d5d-a4bf-eb01238570fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:31:45.267983 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9345165-ee4d-4d5d-a4bf-eb01238570fd admin admin] PATH_INFO: `/v3/users/f8b31aefa153498e99c11f325838f96b` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:31:45.269133 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9345165-ee4d-4d5d-a4bf-eb01238570fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8b31aefa153498e99c11f325838f96b)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:31:45.271079 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9345165-ee4d-4d5d-a4bf-eb01238570fd admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:31:45.275551 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:31:45.456745 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-a9345165-ee4d-4d5d-a4bf-eb01238570fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8b31aefa153498e99c11f325838f96b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:45.457396 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-a9345165-ee4d-4d5d-a4bf-eb01238570fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8b31aefa153498e99c11f325838f96b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:45.457994 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-a9345165-ee4d-4d5d-a4bf-eb01238570fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8b31aefa153498e99c11f325838f96b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:45.554885 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-a9345165-ee4d-4d5d-a4bf-eb01238570fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8b31aefa153498e99c11f325838f96b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:45.567757 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-a9345165-ee4d-4d5d-a4bf-eb01238570fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8b31aefa153498e99c11f325838f96b'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:45.580733 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1457/2917] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:31:45 2022] DELETE /identity/v3/users/f8b31aefa153498e99c11f325838f96b => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:31:45.820608 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47745ff5-c2b0-405f-a8f0-042f6ca08802 service swift] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:31:45.832553 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47745ff5-c2b0-405f-a8f0-042f6ca08802 service swift] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:31:45.840253 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:31:45.893982 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2ba73-0552-4744-a8d9-faad982f0e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:31:45.894640 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2ba73-0552-4744-a8d9-faad982f0e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:31:45.894925 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2ba73-0552-4744-a8d9-faad982f0e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:31:45.895215 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2ba73-0552-4744-a8d9-faad982f0e46 admin admin] PATH_INFO: `/v3/projects/33e9aef48ee94f5a9ee5086c708d4bb5` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:31:45.896415 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2ba73-0552-4744-a8d9-faad982f0e46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33e9aef48ee94f5a9ee5086c708d4bb5)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:31:45.898351 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2ba73-0552-4744-a8d9-faad982f0e46 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:31:46.062938 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-93b2ba73-0552-4744-a8d9-faad982f0e46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33e9aef48ee94f5a9ee5086c708d4bb5', 'request_id': 'req-93b2ba73-0552-4744-a8d9-faad982f0e46'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:46.069671 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-93b2ba73-0552-4744-a8d9-faad982f0e46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33e9aef48ee94f5a9ee5086c708d4bb5', 'request_id': 'req-93b2ba73-0552-4744-a8d9-faad982f0e46'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:46.077299 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-93b2ba73-0552-4744-a8d9-faad982f0e46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33e9aef48ee94f5a9ee5086c708d4bb5', 'request_id': 'req-93b2ba73-0552-4744-a8d9-faad982f0e46'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:46.170462 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-93b2ba73-0552-4744-a8d9-faad982f0e46 admin admin] The token cache is being invalidate because project 33e9aef48ee94f5a9ee5086c708d4bb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:31:46.170749 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-93b2ba73-0552-4744-a8d9-faad982f0e46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:46.171361 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-93b2ba73-0552-4744-a8d9-faad982f0e46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:46.172832 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1461/2918] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:31:45 2022] DELETE /identity/v3/projects/33e9aef48ee94f5a9ee5086c708d4bb5 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:31:46.177659 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9345165-ee4d-4d5d-a4bf-eb01238570fd admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:31:46.179106 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-a9345165-ee4d-4d5d-a4bf-eb01238570fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:31:46.192889 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9345165-ee4d-4d5d-a4bf-eb01238570fd admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:31:46.247168 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616557f3-2c70-4f0b-bec4-37ca640cc435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:31:46.247798 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616557f3-2c70-4f0b-bec4-37ca640cc435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:31:46.248058 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616557f3-2c70-4f0b-bec4-37ca640cc435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:31:46.248328 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616557f3-2c70-4f0b-bec4-37ca640cc435 admin admin] PATH_INFO: `/v3/users/e4da8ab9406b495483e170f0dc2b7076` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:31:46.249436 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616557f3-2c70-4f0b-bec4-37ca640cc435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4da8ab9406b495483e170f0dc2b7076)` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:31:46.251380 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616557f3-2c70-4f0b-bec4-37ca640cc435 admin admin] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:31:46.448993 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-616557f3-2c70-4f0b-bec4-37ca640cc435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4da8ab9406b495483e170f0dc2b7076'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:46.449724 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-616557f3-2c70-4f0b-bec4-37ca640cc435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4da8ab9406b495483e170f0dc2b7076'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:46.450468 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-616557f3-2c70-4f0b-bec4-37ca640cc435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4da8ab9406b495483e170f0dc2b7076'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:46.525450 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-616557f3-2c70-4f0b-bec4-37ca640cc435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4da8ab9406b495483e170f0dc2b7076'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:46.538192 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.notifications [None req-616557f3-2c70-4f0b-bec4-37ca640cc435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4da8ab9406b495483e170f0dc2b7076'} {{(pid=81771) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:46.551091 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1458/2919] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 23 08:31:46 2022] DELETE /identity/v3/users/e4da8ab9406b495483e170f0dc2b7076 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:31:46.778485 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2ba73-0552-4744-a8d9-faad982f0e46 admin admin] Authenticating user token {{(pid=81770) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:31:46.779942 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.fernet_utils [None req-93b2ba73-0552-4744-a8d9-faad982f0e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81770) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:31:46.793813 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2ba73-0552-4744-a8d9-faad982f0e46 admin admin] Validating token access rules against request {{(pid=81770) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:31:46.851676 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fa43b-4c10-40e0-b0d6-1a3bb63309c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '168687f5011542bc8d7ca334411c2990', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89fa3cf81b7a47a1bca14aee1213ee84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81770) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:31:46.852309 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fa43b-4c10-40e0-b0d6-1a3bb63309c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:31:46.852595 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fa43b-4c10-40e0-b0d6-1a3bb63309c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:31:46.852870 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fa43b-4c10-40e0-b0d6-1a3bb63309c8 admin admin] PATH_INFO: `/v3/projects/8530ab1308dd41ddb8caf8f8215eda24` {{(pid=81770) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:31:46.853989 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fa43b-4c10-40e0-b0d6-1a3bb63309c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8530ab1308dd41ddb8caf8f8215eda24)` {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:31:46.855933 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fa43b-4c10-40e0-b0d6-1a3bb63309c8 admin admin] RBAC: Authorization granted {{(pid=81770) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:31:47.011180 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:31:47.018542 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-431fa43b-4c10-40e0-b0d6-1a3bb63309c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8530ab1308dd41ddb8caf8f8215eda24', 'request_id': 'req-431fa43b-4c10-40e0-b0d6-1a3bb63309c8'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:47.023966 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-431fa43b-4c10-40e0-b0d6-1a3bb63309c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8530ab1308dd41ddb8caf8f8215eda24', 'request_id': 'req-431fa43b-4c10-40e0-b0d6-1a3bb63309c8'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:47.030055 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-431fa43b-4c10-40e0-b0d6-1a3bb63309c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8530ab1308dd41ddb8caf8f8215eda24', 'request_id': 'req-431fa43b-4c10-40e0-b0d6-1a3bb63309c8'} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:47.102714 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-431fa43b-4c10-40e0-b0d6-1a3bb63309c8 admin admin] The token cache is being invalidate because project 8530ab1308dd41ddb8caf8f8215eda24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81770) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 08:31:47.103120 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-431fa43b-4c10-40e0-b0d6-1a3bb63309c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:47.103751 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG keystone.notifications [None req-431fa43b-4c10-40e0-b0d6-1a3bb63309c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81770) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 08:31:47.105260 dv-cinder-854070-4-smb devstack@keystone.service[81770]: [pid: 81770|app: 0|req: 1462/2920] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 23 08:31:46 2022] DELETE /identity/v3/projects/8530ab1308dd41ddb8caf8f8215eda24 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 08:31:56.547125 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=77,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:31:57.137551 dv-cinder-854070-4-smb devstack@keystone.service[81770]: DEBUG dbcounter [-] [81770] Writing DB stats keystone:SELECT=10,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:36:25.493339 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616557f3-2c70-4f0b-bec4-37ca640cc435 admin admin] Authenticating user token {{(pid=81771) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 08:36:25.499255 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-616557f3-2c70-4f0b-bec4-37ca640cc435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:36:25.637282 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616557f3-2c70-4f0b-bec4-37ca640cc435 admin admin] Validating token access rules against request {{(pid=81771) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 08:36:25.696312 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d8e56-743a-4304-8322-21f4c595e1d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e92560dd9da4c7cbcac5a84bcaca483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80ab70ab6b9415c98017d05512c33eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81771) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 08:36:25.696919 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d8e56-743a-4304-8322-21f4c595e1d6 service placement] REQUEST_METHOD: `GET` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 08:36:25.697451 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d8e56-743a-4304-8322-21f4c595e1d6 service placement] SCRIPT_NAME: `/identity` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 08:36:25.697725 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d8e56-743a-4304-8322-21f4c595e1d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81771) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 08:36:25.699479 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.fernet_utils [None req-df9d8e56-743a-4304-8322-21f4c595e1d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81771) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 08:36:25.710561 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d8e56-743a-4304-8322-21f4c595e1d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 08:36:25.712080 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d8e56-743a-4304-8322-21f4c595e1d6 service placement] RBAC: Authorization granted {{(pid=81771) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 08:36:25.721874 dv-cinder-854070-4-smb devstack@keystone.service[81771]: [pid: 81771|app: 0|req: 1459/2921] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 23 08:36:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 08:36:35.717744 dv-cinder-854070-4-smb devstack@keystone.service[81771]: DEBUG dbcounter [-] [81771] Writing DB stats keystone:SELECT=89 {{(pid=81771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}